On statistical approaches to generate Level 3 products from satellite remote sensing retrievals

Satellite remote sensing of trace gases such as carbon dioxide (CO$_2$) has increased our ability to observe and understand Earth's climate. However, these remote sensing data, specifically~Level 2 retrievals, tend to be irregular in space and time, and hence, spatio-temporal prediction is required to infer values at any location and time point. Such inferences are not only required to answer important questions about our climate, but they are also needed for validating the satellite instrument, since Level 2 retrievals are generally not co-located with ground-based remote sensing instruments. Here, we discuss statistical approaches to construct Level 3 products from Level 2 retrievals, placing particular emphasis on the strengths and potential pitfalls when using statistical prediction in this context. Following this discussion, we use a spatio-temporal statistical modelling framework known as fixed rank kriging (FRK) to obtain global predictions and prediction standard errors of column-averaged carbon dioxide based on Version 7r and Version 8r retrievals from the Orbiting Carbon Observatory-2 (OCO-2) satellite. The FRK predictions allow us to validate statistically the Level 2 retrievals globally even though the data are at locations and at time points that do not coincide with validation data. Importantly, the validation takes into account the prediction uncertainty, which is dependent both on the temporally-varying density of observations around the ground-based measurement sites and on the spatio-temporal high-frequency components of the trace gas field that are not explicitly modelled. Here, for validation of remotely-sensed CO$_2$ data, we use observations from the Total Carbon Column Observing Network. We demonstrate that the resulting FRK product based on Version 8r compares better with TCCON data than that based on Version 7r.Comment: 28 pages, 10 figures, 4 table

The Orbiting Carbon Observatory-2: first 18 months of science data products

The Orbiting Carbon Observatory-2 (OCO-2) is the first National Aeronautics and Space Administration (NASA) satellite designed to measure atmospheric carbon dioxide (CO_2) with the accuracy, resolution, and coverage needed to quantify CO_2 fluxes (sources and sinks) on regional scales. OCO-2 was successfully launched on 2 July 2014 and has gathered more than 2 years of observations. The v7/v7r operational data products from September 2014 to January 2016 are discussed here. On monthly timescales, 7 to 12 % of these measurements are sufficiently cloud and aerosol free to yield estimates of the column-averaged atmospheric CO_2 dry air mole fraction, X_(CO)_2, that pass all quality tests. During the first year of operations, the observing strategy, instrument calibration, and retrieval algorithm were optimized to improve both the data yield and the accuracy of the products. With these changes, global maps of X_(CO)_2 derived from the OCO-2 data are revealing some of the most robust features of the atmospheric carbon cycle. This includes X_(CO)_2 enhancements co-located with intense fossil fuel emissions in eastern US and eastern China, which are most obvious between October and December, when the north–south X_(CO)_2 gradient is small. Enhanced X_(CO)_2 coincident with biomass burning in the Amazon, central Africa, and Indonesia is also evident in this season. In May and June, when the north–south X_(CO)_2 gradient is largest, these sources are less apparent in global maps. During this part of the year, OCO-2 maps show a more than 10 ppm reduction in X_(CO)_2 across the Northern Hemisphere, as photosynthesis by the land biosphere rapidly absorbs CO_2. As the carbon cycle science community continues to analyze these OCO-2 data, information on regional-scale sources (emitters) and sinks (absorbers) which impart X_(CO)_2 changes on the order of 1 ppm, as well as far more subtle features, will emerge from this high-resolution global dataset

The Greenhouse Gas Climate Change Initiative (GHG-CCI): comparative validation of GHG-CCI SCIAMACHY/ENVISAT and TANSO-FTS/GOSAT CO₂ and CH₄ retrieval algorithm products with measurements from the TCCON

Column-averaged dry-air mole fractions of carbon dioxide and methane have been retrieved from spectra acquired by the TANSO-FTS (Thermal And Near-infrared Sensor for carbon Observations-Fourier Transform Spectrometer) and SCIAMACHY (Scanning Imaging Absorption Spectrometer for Atmospheric Cartography) instruments on board GOSAT (Greenhouse gases Observing SATellite) and ENVISAT (ENVIronmental SATellite), respectively, using a range of European retrieval algorithms. These retrievals have been compared with data from ground-based high-resolution Fourier transform spectrometers (FTSs) from the Total Carbon Column Observing Network (TCCON). The participating algorithms are the weighting function modified differential optical absorption spectroscopy (DOAS) algorithm (WFMD, University of Bremen), the Bremen optimal estimation DOAS algorithm (BESD, University of Bremen), the iterative maximum a posteriori DOAS (IMAP, Jet Propulsion Laboratory (JPL) and Netherlands Institute for Space Research algorithm (SRON)), the proxy and full-physics versions of SRON's RemoTeC algorithm (SRPR and SRFP, respectively) and the proxy and full-physics versions of the University of Leicester's adaptation of the OCO (Orbiting Carbon Observatory) algorithm (OCPR and OCFP, respectively). The goal of this algorithm inter-comparison was to identify strengths and weaknesses of the various so-called round- robin data sets generated with the various algorithms so as to determine which of the competing algorithms would proceed to the next round of the European Space Agency's (ESA) Greenhouse Gas Climate Change Initiative (GHG-CCI) project, which is the generation of the so-called Climate Research Data Package (CRDP), which is the first version of the Essential Climate Variable (ECV) "greenhouse gases" (GHGs). For XCO₂, all algorithms reach the precision requirements for inverse modelling (< 8 ppm), with only WFMD having a lower precision (4.7 ppm) than the other algorithm products (2.4–2.5 ppm). When looking at the seasonal relative accuracy (SRA, variability of the bias in space and time), none of the algorithms have reached the demanding < 0.5 ppm threshold. For XCH₄, the precision for both SCIAMACHY products (50.2 ppb for IMAP and 76.4 ppb for WFMD) fails to meet the < 34 ppb threshold for inverse modelling, but note that this work focusses on the period after the 2005 SCIAMACHY detector degradation. The GOSAT XCH₄ precision ranges between 18.1 and 14.0 ppb. Looking at the SRA, all GOSAT algorithm products reach the < 10 ppm threshold (values ranging between 5.4 and 6.2 ppb). For SCIAMACHY, IMAP and WFMD have a SRA of 17.2 and 10.5 ppb, respectively

The Orbiting Carbon Observatory-2: first 18 months of science data products

The Orbiting Carbon Observatory-2 (OCO-2) is the first National Aeronautics and Space Administration (NASA) satellite designed to measure atmospheric carbon dioxide (CO_2) with the accuracy, resolution, and coverage needed to quantify CO_2 fluxes (sources and sinks) on regional scales. OCO-2 was successfully launched on 2 July 2014 and has gathered more than 2 years of observations. The v7/v7r operational data products from September 2014 to January 2016 are discussed here. On monthly timescales, 7 to 12 % of these measurements are sufficiently cloud and aerosol free to yield estimates of the column-averaged atmospheric CO_2 dry air mole fraction, X_(CO)_2, that pass all quality tests. During the first year of operations, the observing strategy, instrument calibration, and retrieval algorithm were optimized to improve both the data yield and the accuracy of the products. With these changes, global maps of X_(CO)_2 derived from the OCO-2 data are revealing some of the most robust features of the atmospheric carbon cycle. This includes X_(CO)_2 enhancements co-located with intense fossil fuel emissions in eastern US and eastern China, which are most obvious between October and December, when the north–south X_(CO)_2 gradient is small. Enhanced X_(CO)_2 coincident with biomass burning in the Amazon, central Africa, and Indonesia is also evident in this season. In May and June, when the north–south X_(CO)_2 gradient is largest, these sources are less apparent in global maps. During this part of the year, OCO-2 maps show a more than 10 ppm reduction in X_(CO)_2 across the Northern Hemisphere, as photosynthesis by the land biosphere rapidly absorbs CO_2. As the carbon cycle science community continues to analyze these OCO-2 data, information on regional-scale sources (emitters) and sinks (absorbers) which impart X_(CO)_2 changes on the order of 1 ppm, as well as far more subtle features, will emerge from this high-resolution global dataset

Ensemble-based satellite-derived carbon dioxide and methane column-averaged dry-air mole fraction data sets (2003-2018) for carbon and climate applications

Satellite retrievals of column-averaged dry-air mole fractions of carbon dioxide (CO₂) and methane (CH₄), denoted XCO₂ and XCH₄, respectively, have been used in recent years to obtain information on natural and anthropogenic sources and sinks and for other applications such as comparisons with climate models. Here we present new data sets based on merging several individual satellite data products in order to generate consistent long-term climate data records (CDRs) of these two Essential Climate Variables (ECVs). These ECV CDRs, which cover the time period 2003–2018, have been generated using an ensemble of data products from the satellite sensors SCIAMACHY/ENVISAT and TANSO-FTS/GOSAT and (for XCO₂) for the first time also including data from the Orbiting Carbon Observatory 2 (OCO-2) satellite. Two types of products have been generated: (i) Level 2 (L2) products generated with the latest version of the ensemble median algorithm (EMMA) and (ii) Level 3 (L3) products obtained by gridding the corresponding L2 EMMA products to obtain a monthly 5∘×5∘ data product in Obs4MIPs (Observations for Model Intercomparisons Project) format. The L2 products consist of daily NetCDF (Network Common Data Form) files, which contain in addition to the main parameters, i.e., XCO₂ or XCH₄, corresponding uncertainty estimates for random and potential systematic uncertainties and the averaging kernel for each single (quality-filtered) satellite observation. We describe the algorithms used to generate these data products and present quality assessment results based on comparisons with Total Carbon Column Observing Network (TCCON) ground-based retrievals. We found that the XCO₂ Level 2 data set at the TCCON validation sites can be characterized by the following figures of merit (the corresponding values for the Level 3 product are listed in brackets) – single-observation random error (1σ): 1.29 ppm (monthly: 1.18 ppm); global bias: 0.20 ppm (0.18 ppm); and spatiotemporal bias or relative accuracy (1σ): 0.66 ppm (0.70 ppm). The corresponding values for the XCH₄ products are single-observation random error (1σ): 17.4 ppb (monthly: 8.7 ppb); global bias: −2.0 ppb (−2.9 ppb); and spatiotemporal bias (1σ): 5.0 ppb (4.9 ppb). It has also been found that the data products exhibit very good long-term stability as no significant long-term bias trend has been identified. The new data sets have also been used to derive annual XCO₂ and XCH₄ growth rates, which are in reasonable to good agreement with growth rates from the National Oceanic and Atmospheric Administration (NOAA) based on marine surface observations. The presented ECV data sets are available (from early 2020 onwards) via the Climate Data Store (CDS, https://cds.climate.copernicus.eu/, last access: 10 January 2020) of the Copernicus Climate Change Service (C3S, https://climate.copernicus.eu/, last access: 10 January 2020)

How bias correction goes wrong: measurement of X_(CO_2) affected by erroneous surface pressure estimates

All measurements of X_(CO_2) from space have systematic errors. To reduce a large fraction of these errors, a bias correction is applied to X_(CO_2) retrieved from GOSAT and OCO-2 spectra using the ACOS retrieval algorithm. The bias correction uses, among other parameters, the surface pressure difference between the retrieval and the meteorological reanalysis. Relative errors in the surface pressure estimates, however, propagate nearly 1:1 into relative errors in bias-corrected X_(CO_2). For OCO-2, small errors in the knowledge of the pointing of the observatory (up to ∼130 arcsec) introduce a bias in X_(CO_2) in regions with rough topography. Erroneous surface pressure estimates are also caused by a coding error in ACOS version 8, sampling meteorological analyses at wrong times (up to 3 h after the overpass time). Here, we derive new geolocations for OCO-2's eight footprints and show how using improved knowledge of surface pressure estimates in the bias correction reduces errors in OCO-2's v9 X_(CO_2) data

An eleven year record of XCO2 estimates derived from GOSAT measurements using the NASA ACOS version 9 retrieval algorithm

The Thermal And Near infrared Sensor for carbon Observation – Fourier Transform Spectrometer (TANSO-FTS) on the Japanese Greenhouse gases Observing SATellite (GOSAT) has been returning data since April 2009. The version 9 (v9) Atmospheric Carbon Observations from Space (ACOS) Level 2 Full Physics (L2FP) retrieval algorithm (Kiel et al., 2019) was used to derive estimates of carbon dioxide (CO2) dry air mole fraction (XCO2) from the TANSO-FTS measurements collected over it's first eleven years of operation. The bias correction and quality filtering of the L2FP XCO2 product were evaluated using estimates derived from the Total Carbon Column Observing Network (TCCON) as well as values simulated from a suite of global atmospheric inverse modeling systems (models). In addition, the v9 ACOS GOSAT XCO2 results were compared with collocated XCO2 estimates derived from NASA's Orbiting Carbon Observatory-2 (OCO-2), using the version 10 (v10) ACOS L2FP algorithm. These tests indicate that the v9 ACOS GOSAT XCO2 product has improved throughput, scatter and bias, when compared to the earlier v7.3 ACOS GOSAT product, which extended through mid 2016. Of the 37 million (M) soundings collected by GOSAT through June 2020, approximately 20 % were selected for processing by the v9 L2FP algorithm after screening for clouds and other artifacts. After post-processing, 5.4 % of the soundings (2M out of 37M) were assigned a “good” XCO2 quality flag, as compared to 3.9 % in v7.3 (< 1M out of 24M). After quality filtering and bias correction, the differences in XCO2 between ACOS GOSAT v9 and both TCCON and models have a scatter (one sigma) of approximately 1 ppm for ocean-glint observations and 1 to 1.5 ppm for land observations. Similarly, global mean biases are less than approximately 0.2 ppm. Seasonal mean biases relative to the v10 OCO-2 XCO2 product are of order 0.1 ppm for observations over land. However, for ocean-glint observations, seasonal mean biases relative to OCO-2 range from 0.2 to 0.6 ppm, with substantial variation in time and latitude. The ACOS GOSAT v9 XCO2 data are available on the NASA Goddard Earth Science Data and Information Services Center (GES-DISC). The v9 ACOS Data User's Guide (DUG) describes best-use practices for the data. This dataset should be especially useful for studies of carbon cycle phenomena that span a full decade or more, and may serve as a useful complement to the shorter OCO-2 v10 dataset, which begins in September 2014

OCO-3 early mission operations and initial (vEarly) XCO₂ and SIF retrievals

NASA's Orbiting Carbon Observatory-3 (OCO-3) was installed on the International Space Station (ISS) on 10 May 2019. OCO-3 combines the flight spare spectrometer from the Orbiting Carbon Observatory-2 (OCO-2) mission, which has been in operation since 2014, with a new Pointing Mirror Assembly (PMA) that facilitates observations of non-nadir targets from the nadir-oriented ISS platform. The PMA is a new feature of OCO-3, which is being used to collect data in all science modes, including nadir (ND), sun-glint (GL), target (TG), and the new snapshot area mapping (SAM) mode. This work provides an initial assessment of the OCO-3 instrument and algorithm performance, highlighting results from the first 8 months of operations spanning August 2019 through March 2020. During the In-Orbit Checkout (IOC) phase, critical systems such as power and cooling were verified, after which the OCO-3 spectrometer and PMA were subjected to a series of rigorous tests. First light of the OCO-3 spectrometer was on 26 June 2019, with full science operations beginning on 6 August 2019. The OCO-3 spectrometer on-orbit performance is consistent with that seen during preflight testing. Signal to noise ratios are in the expected range needed for high quality retrievals of the column-averaged carbon dioxide (CO₂) dry-air mole fraction (XCO₂) and solar-induced chlorophyll fluorescence (SIF), which will be used to help quantify and constrain the global carbon cycle. The first public release of OCO-3 Level 2 (L2) data products, called “vEarly”, is being distributed by NASA's Goddard Earth Sciences Data and Information Services Center (GES DISC). The intent of the vEarly product is to evaluate early mission performance, facilitate comparisons with OCO-2 products, and identify key areas to improve for the next data release. The vEarly XCO2 exhibits a root-mean-squared-error (RMSE) of ≃ 1, 1, 2 ppm versus a truth proxy for nadir-land, TG&SAM, and glint-water observations, respectively. The vEarly SIF shows a correlation with OCO-2 measurements of >0.9 for highly coincident soundings. Overall, the Level 2 SIF and XCO₂ products look very promising, with performance comparable to OCO-2. A follow-on version of the OCO-3 L2 product containing a number of refinements, e.g., instrument calibration, pointing accuracy, and retrieval algorithm tuning, is anticipated by early in 2021