Gap-filling using machine learning : implementations and applications in remote sensing

Gap-filling is an important preprocessing step in remote sensing applications because it enables successful sensor-based studies by greatly recovering the Earth’s surface records lost due to sensor failures and cloud cover. To date, a great number of methods have been proposed to reconstruct missing data in remote sensing images, but methods that deliver satisfactory performance in handling large-area gaps over heterogeneous landscapes are scant. To address this problem, this thesis proposes two methods—Missing Observations Prediction based on Spectral-Temporal Metrics (MOPSTM) and Spectral and Temporal Information for Missing Data Reconstruction (STIMDR)—that are capable of recovering small and large-area gaps in Landsat time series. Machine learning algorithms are used to implement MOPSTM and STIMDR. MOPSTM applies the k-Nearest Neighbors (k-NN) regression to the target image (i.e. image that is to be reconstructed) and spectral-temporal metrics (STMs, e.g. statistical quantiles) derived from a 1-year Landsat time series. Improved from MOPSTM, STIMDR achieves more powerful performance by employing an effective mechanic that excludes dissimilar data in a longer time series (e.g., changes in land cover). The proposed methods are compared site-to-site with six state-of-the-art gap-filling methods including three temporal interpolation methods and three hybrid methods. With higher accuracy in four study sites located in Kenya, Finland, Germany, and China, MOPSTM and STIMDR have indicated more robust performance than other methods, with STIMDR yielding higher accuracy than MOPSTM. Although gap-filling methods are proposed with increasing frequency, their necessity and effects are rarely evaluated, so this has become an unsolved research gap. This thesis addresses this research gap using land use and land cover (LULC) classification and tree canopy cover (TCC) modelling with the assistance of machine learning algorithms. Random forest algorithm is used to examine whether gap-filled images outperform non-gap-filled (or actual) images in LULC and TCC applications. The results indicate that (i) gap-filled images achieve no worse performance in LULC classification than the actual image, and (ii) gap-filled predictors derived from the Landsat time series deliver better performance on average than non-gap-filled predictors in TCC modelling. Therefore, we conclude that gap-filling has positive effects on LULC classification and TCC modelling, which justifies its inclusion in image preprocessing workflows.-

Spectral Temporal Information for Missing Data Reconstruction (STIMDR) of Landsat Reflectance Time Series

The number of Landsat time-series applications has grown substantially because of its approximately 50-year history and relatively high spatial resolution for observing long term changes in the Earth’s surface. However, missing observations (i.e., gaps) caused by clouds and cloud shadows, orbit and sensing geometry, and sensor issues have broadly limited the development of Landsat time-series applications. Due to the large area and temporal and spatial irregularity of time-series gaps, it is difficult to find an efficient and highly precise method to fill them. The Missing Observation Prediction based on Spectral-Temporal Metrics (MOPSTM) method has been proposed and delivered good performance in filling large-area gaps of single-date Landsat images. However, it can be less practical for a time series longer than one year due to the lack of mechanics that exclude dissimilar data in time series (e.g., different phenology or changes in land cover). To solve this problem, this study proposes a new gap-filling method, Spectral Temporal Information for Missing Data Reconstruction (STIMDR), and examines its performance in Landsat reflectance time series. Two groups of experiments, including 2000 × 2000 pixel Landsat single-date images and Landsat time series acquired from four sites (Kenya, Finland, Germany, and China), were performed to test the new method. We simulated artificial gaps to evaluate predicted pixel values with real observations. Quantitative and qualitative evaluations of gap-filled images through comparisons with other state-of-the-art methods confirmed the more robust and accurate performance of the proposed method. In addition, the proposed method was also able to fill gaps contaminated by extreme cloud cover for a period (e.g., winter in high-latitude areas). A down-stream task of random forest supervised classification through both gap-filled simulated datasets and the original valid datasets verified that STIMDR-generated products are relevant to the user community for land cover applications

Evaluation of MODIS and VIIRS Cloud-Gap-Filled Snow-Cover Products for Production of an Earth Science Data Record

MODerate resolution Imaging Spectroradiometer (MODIS) cryosphere products have been available since 2000 following the 1999 launch of the Terra MODIS and the 2002 launch of the Aqua MODIS and include global snow-cover extent (SCE) (swath, daily, and 8 d composites) at 500 m and 5 km spatial resolutions. These products are used extensively in hydrological modeling and climate studies. Reprocessing of the complete snow-cover data record, from Collection 5 (C5) to Collection 6 (C6) and Collection 6.1 (C6.1), has provided improvements in the MODIS product suite. Suomi National Polar-orbiting Partnership (S-NPP) Visible Infrared Imaging Radiometer Suite (VIIRS) Collection 1 (C1) snow-cover products at a 375 m spatial resolution have been available since 2011 and are currently being reprocessed for Collection 2 (C2). Both the MODIS C6.1 and the VIIRS C2 products will be available for download from the National Snow and Ice Data Center beginning in early 2020 with the complete time series available in 2020. To address the need for a cloud-reduced or cloud-free daily SCE product for both MODIS and VIIRS, a daily cloud-gap-filled (CGF) snow-cover algorithm was developed for MODIS C6.1 and VIIRS C2 processing. MOD10A1F (Terra) and MYD10A1F (Aqua) are daily, 500 m resolution CGF SCE map products from MODIS. VNP10A1F is the daily, 375 m resolution CGF SCE map product from VIIRS. These CGF products include quality-assurance data such as cloud-persistence statistics showing the age of the observation in each pixel. The objective of this paper is to introduce the new MODIS and VIIRS standard CGF daily SCE products and to provide a preliminary evaluation of uncertainties in the gap-filling methodology so that the products can be used as the basis for a moderate-resolution Earth science data record (ESDR) of SCE. Time series of the MODIS and VIIRS CGF products have been developed and evaluated at selected study sites in the US and southern Canada. Observed differences, although small, are largely attributed to cloud masking and differences in the time of day of image acquisition. A nearly 3-month time-series comparison of Terra MODIS and S-NPP VIIRS CGF snow-cover maps for a large study area covering all or parts of 11 states in the western US and part of southwestern Canada reveals excellent correspondence between the Terra MODIS and S-NPP VIIRS products, with a mean difference of 11 070 sqkm, which is 0.45 % of the study area. According to our preliminary validation of the Terra and Aqua MODIS CGF SCE products in the western US study area, we found higher accuracy of the Terra product compared with the Aqua product. The MODIS CGF SCE data record beginning in 2000 has been extended into the VIIRS era, which should last at least through the early 2030s

시공간 해상도 향상을 통한 식생 변화 모니터링

학위논문(박사) -- 서울대학교대학원 : 환경대학원 협동과정 조경학, 2023. 2. 류영렬.육상 생태계에서 대기권과 생물권의 상호 작용을 이해하기 위해서는 식생 변화의 모니터링이 필요하다. 이 때, 위성영상은 지표면을 관측하여 식생지도를 제공할 수 있지만, 지표변화의 상세한 정보는 구름이나 위성 이미지의 공간 해상도에 의해 제한되었다. 또한 위성영상의 시공간 해상도가 식생지도를 통한 광합성 모니터링에 미치는 영향은 완전히 밝혀지지 않았다. 본 논문에서는 고해상도 식생 지도를 일단위로 생성하기 위성 영상의 시공간 해상도를 향상시키는 것을 목표로 하였다. 고해상도 위성영상을 활용한 식생 변화 모니터링을 시공간적으로 확장하기 위해 1) 정지궤도 위성을 활용한 영상융합을 통해 시간해상도 향상, 2) 적대적생성네트워크를 활용한 공간해상도 향상, 3) 시공간해상도가 높은 위성영상을 토지피복이 균질하지 않은 공간에서 식물 광합성 모니터링을 수행하였다. 이처럼, 위성기반 원격탐지에서 새로운 기술이 등장함에 따라 현재 및 과거의 위성영상은 시공간 해상도 측면에서 향상되어 식생 변화의 모니터링 할 수 있다. 제2장에서는 정지궤도위성영상을 활용하는 시공간 영상융합으로 식물의 광합성을 모니터링 했을 때, 시간해상도가 향상됨을 보였다. 시공간 영상융합 시, 구름탐지, 양방향 반사 함수 조정, 공간 등록, 시공간 융합, 시공간 결측치 보완 등의 과정을 거친다. 이 영상융합 산출물은 경작관리 등으로 식생 지수의 연간 변동이 큰 두 장소(농경지와 낙엽수림)에서 평가하였다. 그 결과, 시공간 영상융합 산출물은 결측치 없이 현장관측을 예측하였다 (R2 = 0.71, 상대 편향 = 5.64% 농경지; R2 = 0.79, 상대 편향 = -13.8%, 활엽수림). 시공간 영상융합은 식생 지도의 시공간 해상도를 점진적으로 개선하여, 식물 생장기동안 위성영상이 현장 관측을 과소 평가를 줄였다. 영상융합은 높은 시공간 해상도로 광합성 지도를 일간격으로 생성하기에 이를 활용하여 위성 영상의 제한된 시공간 해상도로 밝혀지지 않은 식물변화의 과정을 발견하길 기대한다. 식생의 공간분포은 정밀농업과 토지 피복 변화 모니터링을 위해 필수적이다. 고해상도 위성영상으로 지구 표면을 관측하는 것을 용이하게 해졌다. 특히 Planet Fusion은 초소형위성군 데이터를 최대한 활용해 데이터 결측이 없는 3m 공간 해상도의 지표 표면 반사도이다. 그러나 과거 위성 센서(Landsat의 경우 30~60m)의 공간 해상도는 식생의 공간적 변화를 상세 분석하는 것을 제한했다. 제3장에서는 Landsat 데이터의 공간 해상도를 향상하기 위해 Planet Fusion 및 Landsat 8 데이터를 사용하여 이중 적대적 생성 네트워크(the dual RSS-GAN)를 학습시켜, 고해상도 정규화 식생 지수(NDVI)와 식물 근적외선 반사(NIRv)도를 생성하는 한다. 타워기반 현장 식생지수(최대 8년)와 드론기반 초분광지도로 the dual RSS-GAN의 성능을 대한민국 내 두 대상지(농경지와 활엽수림)에서 평가했다. The dual RSS-GAN은 Landsat 8 영상의 공간해상도를 향상시켜 공간 표현을 보완하고 식생 지수의 계절적 변화를 포착했다(R2> 0.96). 그리고 the dual RSS-GAN은 Landsat 8 식생 지수가 현장에 비해 과소 평가되는 것을 완화했다. 현장 관측에 비해 이중 RSS-GAN과 Landsat 8의 상대 편향 값 각각 -0.8% 에서 -1.5%, -10.3% 에서 -4.6% 였다. 이러한 개선은 Planet Fusion의 공간정보를 이중 RSS-GAN로 학습하였기에 가능했다. 헤당 연구 결과는 Landsat 영상의 공간 해상도를 향상시켜 숨겨진 공간 정보를 제공하는 새로운 접근 방식이다. 고해상도에서 식물 광합성 지도는 토지피복이 복잡한 공간에서 탄소 순환 모니터링시 필수적이다. 그러나 Sentinel-2, Landsat 및 MODIS와 같이 태양 동조 궤도에 있는 위성은 공간 해상도가 높거나 시간 해상도 높은 위성영상만 제공할 수 있다. 최근 발사된 초소형위성군은 이러한 해상도 한계을 극복할 수 있다. 특히 Planet Fusion은 초소형위성 자료의 시공간 해상도로 지표면을 관측할 수 있다. 4장에서, Planet Fusion 지표반사도를 이용하여 식생에서 반사된 근적외선 복사(NIRvP)를 3m 해상도 지도를 일간격으로 생성했다. 그런 다음 미국 캘리포니아주 새크라멘토-샌 호아킨 델타의 플럭스 타워 네트워크 데이터와 비교하여 식물 광합성을 추정하기 위한 NIRvP 지도의 성능을 평가하였다. 전체적으로 NIRvP 지도는 습지의 잦은 수위 변화에도 불구하고 개별 대상지의 식물 광합성의 시간적 변화를 포착하였다. 그러나 대상지 전체에 대한 NIRvP 지도와 식물 광합성 사이의 관계는 NIRvP 지도를 플럭스 타워 관측범위와 일치시킬 때만 높은 상관관계를 보였다. 관측범위를 일치시킬 경우, NIRvP 지도는 식물 광합성을 추정하는 데 있어 현장 NIRvP보다 우수한 성능을 보였다. 이러한 성능 차이는 플럭스 타워 관측범위를 일치시킬 때, 연구 대상지 간의 NIRvP-식물 광합성 관계의 기울기가 일관성을 보였기 때문이다. 본 연구 결과는 위성 관측을 플럭스 타워 관측범위와 일치시키는 것의 중요성을 보여주고 높은 시공간 해상도로 식물 광합성을 원격으로 모니터링하는 초소형위성군 자료의 잠재력을 보여준다.Monitoring changes in terrestrial vegetation is essential to understanding interactions between atmosphere and biosphere, especially terrestrial ecosystem. To this end, satellite remote sensing offer maps for examining land surface in different scales. However, the detailed information was hindered under the clouds or limited by the spatial resolution of satellite imagery. Moreover, the impacts of spatial and temporal resolution in photosynthesis monitoring were not fully revealed. In this dissertation, I aimed to enhance the spatial and temporal resolution of satellite imagery towards daily gap-free vegetation maps with high spatial resolution. In order to expand vegetation change monitoring in time and space using high-resolution satellite images, I 1) improved temporal resolution of satellite dataset through image fusion using geostationary satellites, 2) improved spatial resolution of satellite dataset using generative adversarial networks, and 3) showed the use of high spatiotemporal resolution maps for monitoring plant photosynthesis especially over heterogeneous landscapes. With the advent of new techniques in satellite remote sensing, current and past datasets can be fully utilized for monitoring vegetation changes in the respect of spatial and temporal resolution. In Chapter 2, I developed the integrated system that implemented geostationary satellite products in the spatiotemporal image fusion method for monitoring canopy photosynthesis. The integrated system contains the series of process (i.e., cloud masking, nadir bidirectional reflectance function adjustment, spatial registration, spatiotemporal image fusion, spatial gap-filling, temporal-gap-filling). I conducted the evaluation of the integrated system over heterogeneous rice paddy landscape where the drastic land cover changes were caused by cultivation management and deciduous forest where consecutive changes occurred in time. The results showed that the integrated system well predict in situ measurements without data gaps (R2 = 0.71, relative bias = 5.64% at rice paddy site; R2 = 0.79, relative bias = -13.8% at deciduous forest site). The integrated system gradually improved the spatiotemporal resolution of vegetation maps, reducing the underestimation of in situ measurements, especially during peak growing season. Since the integrated system generates daily canopy photosynthesis maps for monitoring dynamics among regions of interest worldwide with high spatial resolution. I anticipate future efforts to reveal the hindered information by the limited spatial and temporal resolution of satellite imagery. Detailed spatial representations of terrestrial vegetation are essential for precision agricultural applications and the monitoring of land cover changes in heterogeneous landscapes. The advent of satellite-based remote sensing has facilitated daily observations of the Earths surface with high spatial resolution. In particular, a data fusion product such as Planet Fusion has realized the delivery of daily, gap-free surface reflectance data with 3-m pixel resolution through full utilization of relatively recent (i.e., 2018-) CubeSat constellation data. However, the spatial resolution of past satellite sensors (i.e., 30–60 m for Landsat) has restricted the detailed spatial analysis of past changes in vegetation. In Chapter 3, to overcome the spatial resolution constraint of Landsat data for long-term vegetation monitoring, we propose a dual remote-sensing super-resolution generative adversarial network (dual RSS-GAN) combining Planet Fusion and Landsat 8 data to simulate spatially enhanced long-term time-series of the normalized difference vegetation index (NDVI) and near-infrared reflectance from vegetation (NIRv). We evaluated the performance of the dual RSS-GAN against in situ tower-based continuous measurements (up to 8 years) and remotely piloted aerial system-based maps of cropland and deciduous forest in the Republic of Korea. The dual RSS-GAN enhanced spatial representations in Landsat 8 images and captured seasonal variation in vegetation indices (R2 > 0.95, for the dual RSS-GAN maps vs. in situ data from all sites). Overall, the dual RSS-GAN reduced Landsat 8 vegetation index underestimations compared with in situ measurements; relative bias values of NDVI ranged from −3.2% to 1.2% and −12.4% to −3.7% for the dual RSS-GAN and Landsat 8, respectively. This improvement was caused by spatial enhancement through the dual RSS-GAN, which captured fine-scale information from Planet Fusion. This study presents a new approach for the restoration of hidden sub-pixel spatial information in Landsat images. Mapping canopy photosynthesis in both high spatial and temporal resolution is essential for carbon cycle monitoring in heterogeneous areas. However, well established satellites in sun-synchronous orbits such as Sentinel-2, Landsat and MODIS can only provide either high spatial or high temporal resolution but not both. Recently established CubeSat satellite constellations have created an opportunity to overcome this resolution trade-off. In particular, Planet Fusion allows full utilization of the CubeSat data resolution and coverage while maintaining high radiometric quality. In Chapter 4, I used the Planet Fusion surface reflectance product to calculate daily, 3-m resolution, gap-free maps of the near-infrared radiation reflected from vegetation (NIRvP). I then evaluated the performance of these NIRvP maps for estimating canopy photosynthesis by comparing with data from a flux tower network in Sacramento-San Joaquin Delta, California, USA. Overall, NIRvP maps captured temporal variations in canopy photosynthesis of individual sites, despite changes in water extent in the wetlands and frequent mowing in the crop fields. When combining data from all sites, however, I found that robust agreement between NIRvP maps and canopy photosynthesis could only be achieved when matching NIRvP maps to the flux tower footprints. In this case of matched footprints, NIRvP maps showed considerably better performance than in situ NIRvP in estimating canopy photosynthesis both for daily sum and data around the time of satellite overpass (R2 = 0.78 vs. 0.60, for maps vs. in situ for the satellite overpass time case). This difference in performance was mostly due to the higher degree of consistency in slopes of NIRvP-canopy photosynthesis relationships across the study sites for flux tower footprint-matched maps. Our results show the importance of matching satellite observations to the flux tower footprint and demonstrate the potential of CubeSat constellation imagery to monitor canopy photosynthesis remotely at high spatio-temporal resolution.Chapter 1. Introduction 2 1. Background 2 1.1 Daily gap-free surface reflectance using geostationary satellite products 2 1.2 Monitoring past vegetation changes with high-spatial-resolution 3 1.3 High spatiotemporal resolution vegetation photosynthesis maps 4 2. Purpose of Research 4 Chapter 2. Generating daily gap-filled BRDF adjusted surface reflectance product at 10 m resolution using geostationary satellite product for monitoring daily canopy photosynthesis 6 1. Introduction 6 2. Methods 11 2.1 Study sites 11 2.2 In situ measurements 13 2.3 Satellite products 14 2.4 Integrated system 17 2.5 Canopy photosynthesis 21 2.6 Evaluation 23 3. Results and discussion 24 3.1 Comparison of STIF NDVI and NIRv with in situ NDVI and NIRv 24 3.2 Comparison of STIF NIRvP with in situ NIRvP 28 4. Conclusion 31 Chapter 3. Super-resolution of historic Landsat imagery using a dual Generative Adversarial Network (GAN) model with CubeSat constellation imagery for monitoring vegetation changes 32 1. Introduction 32 2. Methods 38 2.1 Real-ESRGAN model 38 2.2 Study sites 40 2.3 In situ measurements 42 2.4 Vegetation index 44 2.5 Satellite data 45 2.6 Planet Fusion 48 2.7 Dual RSS-GAN via fine-tuned Real-ESRGAN 49 2.8 Evaluation 54 3. Results 57 3.1 Comparison of NDVI and NIRv maps from Planet Fusion, Sentinel 2 NBAR, and Landsat 8 NBAR data with in situ NDVI and NIRv 57 3.2 Comparison of dual RSS-SRGAN model results with Landsat 8 NDVI and NIRv 60 3.3 Comparison of dual RSS-GAN model results with respect to in situ time-series NDVI and NIRv 63 3.4 Comparison of the dual RSS-GAN model with NDVI and NIRv maps derived from RPAS 66 4. Discussion 70 4.1 Monitoring changes in terrestrial vegetation using the dual RSS-GAN model 70 4.2 CubeSat data in the dual RSS-GAN model 72 4.3 Perspectives and limitations 73 5. Conclusion 78 Appendices 79 Supplementary material 82 Chapter 4. Matching high resolution satellite data and flux tower footprints improves their agreement in photosynthesis estimates 85 1. Introduction 85 2. Methods 89 2.1 Study sites 89 2.2 In situ measurements 92 2.3 Planet Fusion NIRvP 94 2.4 Flux footprint model 98 2.5 Evaluation 98 3. Results 105 3.1 Comparison of Planet Fusion NIRv and NIRvP with in situ NIRv and NIRvP 105 3.2 Comparison of instantaneous Planet Fusion NIRv and NIRvP with against tower GPP estimates 108 3.3 Daily GPP estimation from Planet Fusion -derived NIRvP 114 4. Discussion 118 4.1 Flux tower footprint matching and effects of spatial and temporal resolution on GPP estimation 118 4.2 Roles of radiation component in GPP mapping 123 4.3 Limitations and perspectives 126 5. Conclusion 133 Appendix 135 Supplementary Materials 144 Chapter 5. Conclusion 153 Bibliography 155 Abstract in Korea 199 Acknowledgements 202박

A method for predicting large-area missing observations in Landsat time series using spectral-temporal metrics

Combined with increasing computing ability, the free and open access to Landsat archive has enabled the changes on the Earth’s surface to be monitored for almost 50 years. However, due to missing observations that result from clouds, cloud shadows, and scan line corrector failure, the Landsat data record is neither a continuous nor consistent time series. We present a new gap-filling method, Missing Observation Prediction based on Spectral-Temporal Metrics (MOPSTM), which uses spectral-temporal metrics computed from Landsat one-year time series and the k-Nearest Neighbor (k-NN) regression. Herein, we demonstrate the performance of MOPSTM by using five, nearly cloud-free, full scene Landsat images from Kenya, Finland, Germany, the USA, and China. Cloud masks from the images with extensive cloud cover were used to simulate large-area gaps, with the highest value we tested being 92% of missing data. The gap-filling accuracy was assessed quantitatively considering all five sites and different land use/land cover types, and the MOPSTM algorithm performed better than the spectral angle-mapper based spatiotemporal similarity (SAMSTS) gap-filling algorithm. The mean RMSE values of MOPSTM were 0.010, 0.012, 0.025, 0.012, and 0.018 for the five sites, while those of SAMSTS were 0.011, 0.017, 0.038, 0.014, and 0.023, respectively. Furthermore, MOPSTM had mean coefficient of determination (R2) values of 0.90, 0.86, 0.78, 0.92, and 0.89, which were higher than those for SAMSTS (0.84, 0.75, 0.55, 0.89, and 0.83). The performance of MOPSTM was not considerably affected by image gap sizes as images ranging from gap sizes of 51% of the image all the way to 92% of the image yielded similar gap-filling accuracy. Also, MOPSTM does not require local parametertuning except for the k values in the k-NN regression, and it can make a gap-free image from any acquisition date. MOPSTM provides a new spectral-temporal approach to generate the gap-free imagery for typical Landsat applications, such as land use, land cover, and forest monitoring.Peer reviewe

Impact of Preprocessing on Tree Canopy Cover Modelling : Does Gap-Filling of Landsat Time Series Improve Modelling Accuracy?

Preprocessing of Landsat images is a double-edged sword, transforming the raw data into a useful format but potentially introducing unwanted values with unnecessary steps. Through recovering missing data of satellite images in time series analysis, gap-filling is an important, highly developed, preprocessing procedure, but its necessity and effects in numerous Landsat applications, such as tree canopy cover (TCC) modelling, are rarely examined. We address this barrier by providing a quantitative comparison of TCC modelling using predictor variables derived from Landsat time series that included gap-filling versus those that did not include gap-filling and evaluating the effects that gap-filling has on modelling TCC. With 1-year Landsat time series from a tropical region located in Taita Hills, Kenya, and a reference TCC map in 0–100 scales derived from airborne laser scanning data, we designed comparable random forest modelling experiments to address the following questions: 1) Does gap-filling improve TCC modelling based on time series predictor variables including the seasonal composites (SC), spectral-temporal metrics (STMs), and harmonic regression (HR) coefficients? 2) What is the difference in TCC modelling between using gap-filled pixels and using valid (actual or cloud-free) pixels? Two gap-filling methods, one temporal-based method (Steffen spline interpolation) and one hybrid method (MOPSTM) have been examined. We show that gap-filled predictors derived from the Landsat time series delivered better performance on average than non-gap-filled predictors with the average of median RMSE values for Steffen-filled and MOPSTM-filled SC’s being 17.09 and 16.57 respectively, while for non-gap-filled predictors, it was 17.21. MOPSTM-filled SC is 3.7% better than non-gap-filled SC on RMSE, and Steffen-filled SC is 0.7% better than non-gap-filled SC on RMSE. The positive effects of gap-filling may be reduced when there are sufficient high-quality valid observations to generate a seasonal composite. The single-date experiment suggests that gap-filled data (e.g. RMSE of 16.99, 17.71, 16.24, and 17.85 with 100% gap-filled pixels as training and test datasets for four seasons) may deliver no worse performance than valid data (e.g. RMSE of 15.46, 17.07, 16.31, and 18.14 with 100% valid pixels as training and test datasets for four seasons). Thus, we conclude that gap-filling has a positive effect on the accuracy of TCC modelling, which justifies its inclusion in image preprocessing workflows.Peer reviewe

Mapping daily evapotranspiration at Landsat spatial scales during the BEAREX’08 field campaign

Robust spatial information about environmental water use at field scales and daily to seasonal timesteps will benefit many applications in agriculture and water resource management. This information is particularly critical in arid climates where freshwater resources are limited or expensive, and groundwater supplies are being depleted at unsustainable rates to support irrigated agriculture as well as municipal and industrial uses. Gridded evapotranspiration (ET) information at field scales can be obtained periodically using land–surface temperature-based surface energy balance algorithms applied to moderate resolution satellite data from systems like Landsat, which collects thermal-band imagery every 16 days at a resolution of approximately 100 m. The challenge is in finding methods for interpolating between ET snapshots developed at the time of a clear-sky Landsat overpass to provide complete daily time-series over a growing season. This study examines the efficacy of a simple gap-filling algorithm designed for applications in data-sparse regions, which does not require local ground measurements of weather or rainfall, or estimates of soil texture. The algorithm relies on general conservation of the ratio between actual ET and a reference ET, generated from satellite insolation data and standard meteorological fields from a mesoscale model. The algorithm was tested with ET retrievals from the Atmosphere–Land Exchange Inverse (ALEXI) surface energy balance model and associated DisALEXI flux disaggregation technique, which uses Landsat-scale thermal imagery to reduce regional ALEXI maps to a finer spatial resolution. Daily ET at the Landsat scale was compared with lysimeter and eddy covariance flux measurements collected during the Bushland Evapotranspiration and Agricultural Remote sensing EXperiment of 2008 (BEAREX08), conducted in an irrigated agricultural area in the Texas Panhandle under highly advective conditions. The simple gap-filling algorithm performed reasonably at most sites, reproducing observed cumulative ET to within 5–10% over the growing period from emergence to peak biomass in both rainfed and irrigated fields

Development of a simplified technique for gap filling of Normalize Difference Vegetation Index (NDVI) time series data

The presence of gaps or missing values in time series prevents the practical use of such data. The current research aims at developing a simplified, straightforward technique for gap-filling the time series data of the Normalize Difference Vegetation Index (NDVI) generated using Moderate Resolution Imaging Spectroradiometer (MODIS). This research assumes that a relationship exists between the pixel location, date of acquisition and its NDVI value within a defined timeline. Therefore, two relatively simple methods were tested: the Multiple Linear Regression (MLR) analysis and the Artificial Neural Networks (ANN)to fill the NDVI missing values. While MLR is a well-known simple statistical method, the ANN has been successfully applied for the analysis of various scientific data, including the gap-filling of time series data. Nevertheless, ANN proved its supremacy in such approach. The accuracy of estimation utilizing the developed ANN model reached an average of r2 of 0.8, while the average accuracy of MLR was about 0.3. Nevertheless, the developed model could only be applied within the same timeframe of the images used for developing the model. Otherwise, the accuracy of determination was reduced significantly. The results showed that according to its performance, ANN are promising for filling missing data of NDVI time series and could be applied to any other vegetation indices as well

Technical note: A view from space on global flux towers by MODIS and Landsat: The FluxnetEO dataset

Funding Information: Acknowledgements. We thank the team at the ICOS Carbon Portal for their support in publishing the FluxnetEO data sets, with great thanks in particular to Ute Karstens and Zois Zogopoulos. SW acknowledges funding from an ESA Living Planet Fellowship in the project Vad3e mecum. Alexey Vasilevich Panov acknowledges funding from the Max Planck Society (Germany), Russian Foundation for Basic Re- search, Krasnoyarsk Territory and Krasnoyarsk Regional Fund of Science, project no. 20-45-242908. Frederik Schrader and Christian Brümmer acknowledge funds from the German Federal Ministry of Food and Agriculture (BMEL) received through Thünen Institute of Climate-Smart Agriculture. Simon Besnard acknowledges funding from the European Union through the BIOMAS-CAT (project code: 4000115192/18/I/NB) (https://eo4society.esa. int/projects/biomascat/, last access: 3 May 2022) and VERIFY (project code: BO-55-101-006) (https://cordis.europa.eu/project/id/ 776810, last access: 3 May 2022) projects. Funding Information: Financial support. This research has been supported by the Euro- Publisher Copyright: © 2022 Sophia Walther et al.The eddy-covariance technique measures carbon, water, and energy fluxes between the land surface and the atmosphere at hundreds of sites globally. Collections of standardised and homogenised flux estimates such as the LaThuile, Fluxnet2015, National Ecological Observatory Network (NEON), Integrated Carbon Observation System (ICOS), AsiaFlux, AmeriFlux, and Terrestrial Ecosystem Research Network (TERN)/OzFlux data sets are invaluable to study land surface processes and vegetation functioning at the ecosystem scale. Space-borne measurements give complementary information on the state of the land surface in the surroundings of the towers. They aid the interpretation of the fluxes and support the benchmarking of terrestrial biosphere models. However, insufficient quality and frequent and/or long gaps are recurrent problems in applying the remotely sensed data and may considerably affect the scientific conclusions. Here, we describe a standardised procedure to extract, quality filter, and gap-fill Earth observation data from the MODIS instruments and the Landsat satellites. The methods consistently process surface reflectance in individual spectral bands, derived vegetation indices, and land surface temperature. A geometrical correction estimates the magnitude of land surface temperature as if seen from nadir or 40g off-nadir. Finally, we offer the community living data sets of pre-processed Earth observation data, where version 1.0 features the MCD43A4/A2 and MxD11A1 MODIS products and Landsat Collection 1 Tier 1 and Tier 2 products in a radius of 2 km around 338 flux sites. The data sets we provide can widely facilitate the integration of activities in the eddy-covariance, remote sensing, and modelling fields.publishersversionpublishe