Assessing the influence of different validation protocols on Ocean Colour match-up analyses

Abstract Multiple approaches have been used by the Ocean Colour community for validating satellite-derived products using in situ data, with most of them derived from mainly two approaches, one suggested by Bailey and Werdell (2006) (BW06) and one suggested by Zibordi et al. (2009a) (Z09), each with a different set of quality checking and spatiotemporal collocation criteria. The question remains what sort of information is added or missed when choosing one over the other. In this work, the differences among validation approaches were determined by using a common dataset of in situ and satellite data. The match-up exercise was separated into two groups of datasets based on the spatial resolution of the sensors to be validated. Sentinel-3A/OLCI data were selected as a representation of medium spatial resolution sensors, and two validation approaches were selected to this match-up dataset. The high spatial resolution sensors were represented by Sentinel-2A/MSI data, and three validation approaches were tested. Data from the AERONET-OC network were chosen as the common in situ dataset. For Sentinel-3A/OLCI, the number of match-ups varies depending on the validation approach used. Bailey and Werdell (2006) produces 20% more match-ups for Sentinel-3A/OLCI due to its more relaxed filtering criteria compared to the criteria applied by Zibordi et al. (2009a) . The validation metrics vary between different validation methods giving a different impression of accuracy of the satellite products. Also, the satellite data selected by BW06 have a statistical distribution with a higher median and standard deviation when compared to Z09. Similar findings are also confirmed for the match-up analysis conducted for Sentinel-2A/MSI. Therefore, although a common reference dataset was used, the validation statistical results were influenced by the validation approach selected. This does not suggest that one validation protocol is better than the other, but it implies that validation statistics reported in different studies may not always be directly comparable. Additionally, it was determined that BW06 could be a better fit when trying to obtain a sufficient number of match-ups for calibration purposes in the shortest time

ACIX-Aqua: A global assessment of atmospheric correction methods for Landsat-8 and Sentinel-2 over lakes, rivers, and coastal waters

Atmospheric correction over inland and coastal waters is one of the major remaining challenges in aquatic remote sensing, often hindering the quantitative retrieval of biogeochemical variables and analysis of their spatial and temporal variability within aquatic environments. The Atmospheric Correction Intercomparison Exercise (ACIX-Aqua), a joint NASA – ESA activity, was initiated to enable a thorough evaluation of eight state-of-the-art atmospheric correction (AC) processors available for Landsat-8 and Sentinel-2 data processing. Over 1000 radiometric matchups from both freshwaters (rivers, lakes, reservoirs) and coastal waters were utilized to examine the quality of derived aquatic reflectances (̂ρw). This dataset originated from two sources: Data gathered from the international scientific community (henceforth called Community Validation Database, CVD), which captured predominantly inland water observations, and the Ocean Color component of AERONET measurements (AERONET-OC), representing primarily coastal ocean environments. This volume of data permitted the evaluation of the AC processors individually (using all the matchups) and comparatively (across seven different Optical Water Types, OWTs) using common matchups. We found that the performance of the AC processors differed for CVD and AERONET-OC matchups, likely reflecting inherent variability in aquatic and atmospheric properties between the two datasets. For the former, the median errors in ̂ρw(560) and ̂ρw(664) were found to range from 20 to 30% for best-performing processors. Using the AERONET-OC matchups, our performance assessments showed that median errors within the 15–30% range in these spectral bands may be achieved. The largest uncertainties were associated with the blue bands (25 to 60%) for best-performing processors considering both CVD and AERONET-OC assessments. We further assessed uncertainty propagation to the downstream products such as near-surface concentration of chlorophyll-a (Chla) and Total Suspended Solids (TSS). Using satellite matchups from the CVD along with in situ Chla and TSS, we found that 20–30% uncertainties in ̂ρw(490 ≤ λ ≤ 743 nm) yielded 25–70% uncertainties in derived Chla and TSS products for topperforming AC processors. We summarize our results using performance matrices guiding the satellite user community through the OWT-specific relative performance of AC processors. Our analysis stresses the need for better representation of aerosols, particularly absorbing ones, and improvements in corrections for sky- (or sun-) glint and adjacency effects, in order to achieve higher quality downstream products in freshwater and coastal ecosystems

Advancing cyanobacteria biomass estimation from hyperspectral observations: Demonstrations with HICO and PRISMA imagery

Retrieval of the phycocyanin concentration (PC), a characteristic pigment of, and proxy for, cyanobacteria biomass, from hyperspectral satellite remote sensing measurements is challenging due to uncertainties in the remote sensing reflectance (∆Rrs) resulting from atmospheric correction and instrument radiometric noise. Although several individual algorithms have been proven to capture local variations in cyanobacteria biomass in specific regions, their performance has not been assessed on hyperspectral images from satellite sensors. Our work leverages a machine-learning model, Mixture Density Networks (MDNs), trained on a large (N = 939) dataset of collocated in situ chlorophyll-a concentrations (Chla), PCs, and remote sensing reflectance (Rrs) measurements to estimate PC from all relevant spectral bands. The performance of the developed model is demonstrated via PC maps produced from select images of the Hyperspectral Imager for the Coastal Ocean (HICO) and Italian Space Agency's PRecursore IperSpettrale della Missione Applicativa (PRISMA) using a matchup dataset. As input to the MDN, we incorporate a combination of widely used band ratios (BRs) and line heights (LHs) taken from existing multispectral algorithms, that have been proven for both Chla and PC estimation, as well as novel BRs and LHs to increase the overall cyanobacteria biomass estimation accuracy and reduce the sensitivity to ∆Rrs. When trained on a random half of the dataset, the MDN achieves uncertainties of 44.3%, which is less than half of the uncertainties of all viable optimized multispectral PC algorithms. The MDN is notably better than multispectral algorithms at preventing overestimation on low (10 mg m−3). According to our extensive assessments, the developed model is anticipated to enable practical PC products from PRISMA and HICO, therefore the model is promising for planned hyperspectral missions, such as the Plankton Aerosol and Cloud Ecosystem (PACE). This advancement will enhance the complementary roles of hyperspectral radiometry from satellite and low-altitude platforms for quantifying and monitoring cyanobacteria harmful algal blooms at both large and local spatial scales

ACIX-Aqua: A global assessment of atmospheric correction methods for Landsat-8 and Sentinel-2 over lakes, rivers, and coastal waters

Atmospheric correction over inland and coastal waters is one of the major remaining challenges in aquatic remote sensing, often hindering the quantitative retrieval of biogeochemical variables and analysis of their spatial and temporal variability within aquatic environments. The Atmospheric Correction Intercomparison Exercise (ACIX-Aqua), a joint NASA – ESA activity, was initiated to enable a thorough evaluation of eight state-of-the-art atmospheric correction (AC) processors available for Landsat-8 and Sentinel-2 data processing. Over 1000 radiometric matchups from both freshwaters (rivers, lakes, reservoirs) and coastal waters were utilized to examine the quality of derived aquatic reflectances (̂ρw). This dataset originated from two sources: Data gathered from the international scientific community (henceforth called Community Validation Database, CVD), which captured predominantly inland water observations, and the Ocean Color component of AERONET measurements (AERONET-OC), representing primarily coastal ocean environments. This volume of data permitted the evaluation of the AC processors individually (using all the matchups) and comparatively (across seven different Optical Water Types, OWTs) using common matchups. We found that the performance of the AC processors differed for CVD and AERONET-OC matchups, likely reflecting inherent variability in aquatic and atmospheric properties between the two datasets. For the former, the median errors in ̂ρw(560) and ̂ρw(664) were found to range from 20 to 30% for best-performing processors. Using the AERONET-OC matchups, our performance assessments showed that median errors within the 15–30% range in these spectral bands may be achieved. The largest uncertainties were associated with the blue bands (25 to 60%) for best-performing processors considering both CVD and AERONET-OC assessments. We further assessed uncertainty propagation to the downstream products such as near-surface concentration of chlorophyll-a (Chla) and Total Suspended Solids (TSS). Using satellite matchups from the CVD along with in situ Chla and TSS, we found that 20–30% uncertainties in ̂ρw(490 ≤ λ ≤ 743 nm) yielded 25–70% uncertainties in derived Chla and TSS products for topperforming AC processors. We summarize our results using performance matrices guiding the satellite user community through the OWT-specific relative performance of AC processors. Our analysis stresses the need for better representation of aerosols, particularly absorbing ones, and improvements in corrections for sky- (or sun-) glint and adjacency effects, in order to achieve higher quality downstream products in freshwater and coastal ecosystems

Advancing cyanobacteria biomass estimation from hyperspectral observations: Demonstrations with HICO and PRISMA imagery

Retrieval of the phycocyanin concentration (PC), a characteristic pigment of, and proxy for, cyanobacteria biomass, from hyperspectral satellite remote sensing measurements is challenging due to uncertainties in the remote sensing reflectance (∆Rrs) resulting from atmospheric correction and instrument radiometric noise. Although several individual algorithms have been proven to capture local variations in cyanobacteria biomass in specific regions, their performance has not been assessed on hyperspectral images from satellite sensors. Our work leverages a machine-learning model, Mixture Density Networks (MDNs), trained on a large (N = 939) dataset of collocated in situ chlorophyll-a concentrations (Chla), PCs, and remote sensing reflectance (Rrs) measurements to estimate PC from all relevant spectral bands. The performance of the developed model is demonstrated via PC maps produced from select images of the Hyperspectral Imager for the Coastal Ocean (HICO) and Italian Space Agency’s PRecursore IperSpettrale della Missione Applicativa (PRISMA) using a matchup dataset. As input to the MDN, we incorporate a combination of widely used band ratios (BRs) and line heights (LHs) taken from existing multispectral algorithms, that have been proven for both Chla and PC esti�mation, as well as novel BRs and LHs to increase the overall cyanobacteria biomass estimation accuracy and reduce the sensitivity to ∆Rrs. When trained on a random half of the dataset, the MDN achieves uncertainties of 44.3%, which is less than half of the uncertainties of all viable optimized multispectral PC algorithms. The MDN is notably better than multispectral algorithms at preventing overestimation on low (10 mg m− 3). According to our extensive assessments, the developed model is anticipated to enable practical PC products from PRISMA and HICO, therefore the model is promising for planned hyperspectral missions, such as the Plankton Aerosol and Cloud Ecosystem (PACE). This advancement will enhance the complementary roles of hyperspectral radiometry from satellite and low-altitude platforms for quantifying and monitoring cyanobacteria harmful algal blooms at both large and local spatial scales

Field Intercomparison of Radiometer Measurements for Ocean Colour Validation

A field intercomparison was conducted at the Acqua Alta Oceanographic Tower (AAOT) in the northern Adriatic Sea, from 9 to 19 July 2018 to assess differences in the accuracy of in- and above-water radiometer measurements used for the validation of ocean colour products. Ten measurement systems were compared. Prior to the intercomparison, the absolute radiometric calibration of all sensors was carried out using the same standards and methods at the same reference laboratory. Measurements were performed under clear sky conditions, relatively low sun zenith angles, moderately low sea state and on the same deployment platform and frame (except in-water systems). The weighted average of five above-water measurements was used as baseline reference for comparisons. For downwelling irradiance (), there was generally good agreement between sensors with differences of <6% for most of the sensors over the spectral range 400 nm–665 nm. One sensor exhibited a systematic bias, of up to 11%, due to poor cosine response. For sky radiance () the spectrally averaged difference between optical systems was <2.5% with a root mean square error (RMS) <0.01 mWm−2 nm−1 sr−1. For total above-water upwelling radiance (), the difference was <3.5% with an RMS <0.009 mWm−2 nm−1 sr−1. For remote-sensing reflectance (), the differences between above-water TriOS RAMSES were <3.5% and <2.5% at 443 and 560 nm, respectively, and were <7.5% for some systems at 665 nm. Seabird HyperSAS sensors were on average within 3.5% at 443 nm, 1% at 560 nm, and 3% at 665 nm. The differences between the weighted mean of the above-water and in-water systems was <15.8% across visible bands. A sensitivity analysis showed that accounted for the largest fraction of the variance in , which suggests that minimizing the errors arising from this measurement is the most important variable in reducing the inter-group differences in . The differences may also be due, in part, to using five of the above-water systems as a reference. To avoid this, in situ normalized water-leaving radiance () was therefore compared to AERONET-OC SeaPRiSM as an alternative reference measurement. For the TriOS-RAMSES and Seabird-Hyperspectral Surface Acquisition System (HyperSAS) sensors the differences were similar across the visible spectra with 4.7% and 4.9%, respectively. The difference between SeaPRiSM and two in-water systems at blue, green and red bands was 11.8%. This was partly due to temporal and spatial differences in sampling between the in-water and above-water systems and possibly due to uncertainties in instrument self-shading for one of the in-water measurements

A Review of Protocols for Fiducial Reference Measurements of Water-Leaving Radiance for Validation of Satellite Remote-Sensing Data over Water

This paper reviews the state of the art of protocols for measurement of water-leaving radiance in the context of fiducial reference measurements (FRM) of water reflectance for satellite validation. Measurement of water reflectance requires the measurement of water-leaving radiance and downwelling irradiance just above water. For the former there are four generic families of method, based on: (1) underwater radiometry at fixed depths; or (2) underwater radiometry with vertical profiling; or (3) above-water radiometry with skyglint correction; or (4) on-water radiometry with skylight blocked. Each method is described generically in the FRM context with reference to the measurement equation, documented implementations and the intra-method diversity of deployment platform and practice. Ideal measurement conditions are stated, practical recommendations are provided on best practice and guidelines for estimating the measurement uncertainty are provided for each protocol-related component of the measurement uncertainty budget. The state of the art for measurement of water-leaving radiance is summarized, future perspectives are outlined, and the question of which method is best adapted to various circumstances (water type, wavelength) is discussed. This review is based on practice and papers of the aquatic optics community for the validation of water reflectance estimated from satellite data but can be relevant also for other applications such as the development or validation of algorithms for remote-sensing estimation of water constituents including chlorophyll a concentration, inherent optical properties and related products