Estimating Surface Soil Moisture from SMAP Observations Using a Neural Network Technique

A Neural Network (NN) algorithm was developed to estimate global surface soil moisture for April 2015 to March 2017 with a 2-3 day repeat frequency using passive microwave observations from the Soil Moisture Active Passive (SMAP) satellite, surface soil temperatures from the NASA Goddard Earth Observing System Model version 5 (GEOS-5) land modeling system, and Moderate Resolution Imaging Spectroradiometer-based vegetation water content. The NN was trained on GEOS-5 soil moisture target data, making the NN estimates consistent with the GEOS-5 climatology, such that they may ultimately be assimilated into this model without further bias correction. Evaluated against in situ soil moisture measurements, the average unbiased root mean square error (ubRMSE), correlation and anomaly correlation of the NN retrievals were 0.037 m(exp. 3)m(exp. -3), 0.70 and 0.66, respectively, against SMAP core validation site measurements and 0.026 m(exp. 3)m(exp. -3), 0.58 and 0.48, respectively, against International Soil Moisture Network (ISMN) measurements. At the core validation sites, the NN retrievals have a significantly higher skill than the GEOS-5 model estimates and a slightly lower correlation skill than the SMAP Level-2 Passive (L2P) product. The feasibility of the NN method was reflected by a lower ubRMSE compared to the L2P retrievals as well as a higher skill when ancillary parameters in physically-based retrievals were uncertain. Against ISMN measurements, the skill of the two retrieval products was more comparable. A triple collocation analysis against Advanced Microwave Scanning Radiometer 2 (AMSR2) and Advanced Scatterometer (ASCAT) soil moisture retrievals showed that the NN and L2P retrieval errors have a similar spatial distribution, but the NN retrieval errors are generally lower in densely vegetated regions and transition zones

Evaluation of SMAP, SMOS-IC, FY3B, JAXA, and LPRM Soil Moisture Products over the Qinghai-Tibet Plateau and Its Surrounding Areas

© 2019 by the authors. High-quality and long time-series soil moisture (SM) data are increasingly required for the Qinghai-Tibet Plateau (QTP) to more accurately and effectively assess climate change. In this study, to evaluate the accuracy and effectiveness of SM data, five passive microwave remotely sensed SM products are collected over the QTP, including those from the soil moisture active passive (SMAP), soil moisture and ocean salinity INRA-CESBIO (SMOS-IC), Fengyun-3B microwave radiation image (FY3B), and two SM products derived from the advanced microwave scanning radiometer 2 (AMSR2). The two AMSR2 products are generated by the land parameter retrieval model (LPRM) and the Japan Aerospace Exploration Agency (JAXA) algorithm, respectively. The SM products are evaluated through a two-stage data comparison method. The first stage is direct validation at the grid scale. Five SM products are compared with corresponding in situ measurements at five in situ networks, including Heihe, Naqu, Pali, Maqu, and Ngari. Another stage is indirect validation at the regional scale, where the uncertainties of the data are quantified by using a three-cornered hat (TCH) method. The results at the regional scale indicate that soil moisture is underestimated by JAXA and overestimated by LPRM, some noise is contained in temporal variations in SMOS-IC, and FY3B has relatively low absolute accuracy. The uncertainty of SMAP is the lowest among the five products over the entire QTP. In the SM map composed by five SM products with the lowest pixel-level uncertainty, 66.64% of the area is covered by SMAP (JAXA: 19.39%, FY3B: 10.83%, LPRM: 2.11%, and SMOS-IC: 1.03%). This study reveals some of the reasons for the different performances of these five SM products, mainly from the perspective of the parameterization schemes of their corresponding retrieval algorithms. Specifically, the parameterization configurations and corresponding input datasets, including the land-surface temperature, the vegetation optical depth, and the soil dielectric mixing model are analyzed and discussed. This study provides quantitative evidence to better understand the uncertainties of SM products and explain errors that originate from the retrieval algorithms

HUMAN AND CLIMATE IMPACTS ON FLOODING VIA REMOTE SENSING, BIG DATA ANALYTICS, AND MODELING

Over the last 20 years, the amount of streamflow has greatly increased and spring snowmelt floods have occurred more frequently in the north-central U.S. In the Red River of the North Basin (RRB) overlying portions of North Dakota and Minnesota, six of the 13 major floods over the past 100 years have occurred since the late 1990s. Based on numerous previous studies as well as senior flood forecasters’ experiences, recent hydrological changes related to human modifications [e.g. artificial subsurface drainage (SSD) expansion] and climate change are potential causes of notable forecasting failures over the past decade. My dissertation focuses on the operational and scientific gaps in current forecasting models and observational data and provides insights and value to both the practitioner and the research community. First, the current flood forecasting model needs both the location and installation timing of SSD and SSD physics. SSD maps were developed using satellite “big” data and a machine learning technique. Next, using the maps with a land surface model, the impacts of SSD expansion on regional hydrological changes were quantified. In combination with model physics, the inherent uncertainty in the airborne gamma snow survey observations hinders the accurate flood forecasting model. The operational airborne gamma snow water equivalent (SWE) measurements were improved by updating antecedent surface moisture conditions using satellite observations on soil moisture. From a long-term perspective, flood forecasters and state governments need knowledge of historical changes in snowpack and snowmelt to help flood management and to develop strategies to adapt to climate changes. However, historical snowmelt trends have not been quantified in the north-central U.S. due to the limited historical snow data. To overcome this, the current available historical long-term SWE products were evaluated across diverse regions and conditions. Using the most reliable SWE product, a trend analysis quantified the magnitude of change extreme snowpack and melt events over the past 36 years. Collectively, this body of research demonstrates that human and climate impacts, as well as limited and noisy data, cause uncertainties in flood prediction in the great plains, but integrated approaches using remote sensing, big data analytics, and modeling can quantify the hydrological changes and reduce the uncertainties. This dissertation improves the practice of flood forecasting in Red River of the North Basin and advances research in hydrology and snow science

Microwave Indices from Active and Passive Sensors for Remote Sensing Applications

Past research has comprehensively assessed the capabilities of satellite sensors operating at microwave frequencies, both active (SAR, scatterometers) and passive (radiometers), for the remote sensing of Earth’s surface. Besides brightness temperature and backscattering coefficient, microwave indices, defined as a combination of data collected at different frequencies and polarizations, revealed a good sensitivity to hydrological cycle parameters such as surface soil moisture, vegetation water content, and snow depth and its water equivalent. The differences between microwave backscattering and emission at more frequencies and polarizations have been well established in relation to these parameters, enabling operational retrieval algorithms based on microwave indices to be developed. This Special Issue aims at providing an overview of microwave signal capabilities in estimating the main land parameters of the hydrological cycle, e.g., soil moisture, vegetation water content, and snow water equivalent, on both local and global scales, with a particular focus on the applications of microwave indices

Advanced methods for earth observation data synergy for geophysical parameter retrieval

The first part of the thesis focuses on the analysis of relevant factors to estimate the response time between satellite-based and in-situ soil moisture (SM) using a Dynamic Time Warping (DTW). DTW was applied to the SMOS L4 SM, and was compared to in-situ root-zone SM in the REMEDHUS network in Western Spain. The method was customized to control the evolution of time lag during wetting and drying conditions. Climate factors in combination with crop growing seasons were studied to reveal SM-related processes. The heterogeneity of land use was analyzed using high-resolution images of NDVI from Sentinel-2 to provide information about the level of spatial representativity of SMOS data to each in-situ station. The comparison of long-term precipitation records and potential evapotranspiration allowed estimation of SM seasons describing different SM conditions depending on climate and soil properties. The second part of the thesis focuses on data-driven methods for sea ice segmentation and parameter retrieval. A Bayesian framework is employed to segment sets of multi-source satellite data. The Bayesian unsupervised learning algorithm allows to investigate the ‘hidden link’ between multiple data. The statistical properties are accounted for by a Gaussian Mixture Model, and the spatial interactions are reflected using Hidden Markov Random Fields. The algorithm segments spatial data into a number of classes, which are represented as a latent field in physical space and as clusters in feature space. In a first application, a two-step probabilistic approach based on Expectation-Maximization and the Bayesian segmentation algorithm was used to segment SAR images to discriminate surface water from sea ice types. Information on surface roughness is contained in the radar backscattering images which can be - in principle - used to detect melt ponds and to estimate high-resolution sea ice concentration (SIC). In a second study, the algorithm was applied to multi-incidence angle TB data from the SMOS L1C product to harness the its sensitivity to thin ice. The spatial patterns clearly discriminate well-determined areas of open water, old sea ice and a transition zone, which is sensitive to thin sea ice thickness (SIT) and SIC. In a third application, SMOS and the AMSR2 data are used to examine the joint effect of CIMR-like observations. The information contained in the low-frequency channels allows to reveal ranges of thin sea ice, and thicker ice can be determined from the relationship between the high-frequency channels and changing conditions as the sea ice ages. The proposed approach is suitable for merging large data sets and provides metrics for class analysis, and to make informed choices about integrating data from future missions into sea ice products. A regression neural network approach was investigated with the goal to infer SIT using TB data from the Flexible Microwave Payload 2 (FMPL-2) of the FSSCat mission. Two models - covering thin ice up to 0.6m and the full-range of SIT - were trained on Arctic data using ground truth data derived from the SMOS and Cryosat-2. This work demonstrates that moderate-cost CubeSat missions can provide valuable data for applications in Earth observation.La primera parte de la tesis se centra en el análisis de los factores relevantes para estimar el tiempo de respuesta entre la humedad del suelo (SM) basada en el satélite y la in-situ, utilizando una deformación temporal dinámica (DTW). El DTW se aplicó al SMOS L4 SM, y se comparó con la SM in-situ en la red REMEDHUS en el oeste de España. El método se adaptó para controlar la evolución del desfase temporal durante diferentes condiciones de humedad y secado. Se estudiaron los factores climáticos en combinación con los períodos de crecimiento de los cultivos para revelar los procesos relacionados con la SM. La heterogeneidad del uso del suelo se analizó utilizando imágenes de alta resolución de NDVI de Sentinel-2 para proporcionar información sobre el nivel de representatividad espacial de los datos de SMOS a cada estación in situ. La comparación de los patrones de precipitación a largo plazo y la evapotranspiración potencial permitió estimar las estaciones de SM que describen diferentes condiciones de SM en función del clima y las propiedades del suelo. La segunda parte de esta tesis se centra en métodos dirigidos por datos para la segmentación del hielo marino y la obtención de parámetros. Se emplea un método de inferencia bayesiano para segmentar conjuntos de datos satelitales de múltiples fuentes. El algoritmo de aprendizaje bayesiano no supervisado permite investigar el “vínculo oculto” entre múltiples datos. Las propiedades estadísticas se contabilizan mediante un modelo de mezcla gaussiana, y las interacciones espaciales se reflejan mediante campos aleatorios ocultos de Markov. El algoritmo segmenta los datos espaciales en una serie de clases, que se representan como un campo latente en el espacio físico y como clústeres en el espacio de las variables. En una primera aplicación, se utilizó un enfoque probabilístico de dos pasos basado en la maximización de expectativas y el algoritmo de segmentación bayesiano para segmentar imágenes SAR con el objetivo de discriminar el agua superficial de los tipos de hielo marino. La información sobre la rugosidad de la superficie está contenida en las imágenes de backscattering del radar, que puede utilizarse -en principio- para detectar estanques de deshielo y estimar la concentración de hielo marino (SIC) de alta resolución. En un segundo estudio, el algoritmo se aplicó a los datos TB de múltiples ángulos de incidencia del producto SMOS L1C para aprovechar su sensibilidad al hielo fino. Los patrones espaciales discriminan claramente áreas bien determinadas de aguas abiertas, hielo marino viejo y una zona de transición, que es sensible al espesor del hielo marino fino (SIT) y al SIC. En una tercera aplicación, se utilizan los datos de SMOS y de AMSR2 para examinar el efecto conjunto de las observaciones tipo CIMR. La información contenida en los canales de baja frecuencia permite revelar rangos de hielo marino delgado, y el hielo más grueso puede determinarse a partir de la relación entre los canales de alta frecuencia y las condiciones cambiantes a medida que el hielo marino envejece. El enfoque propuesto es adecuado para fusionar grandes conjuntos de datos y proporciona métricas para el análisis de clases, y para tomar decisiones informadas sobre la integración de datos de futuras misiones en los productos de hielo marino. Se investigó un enfoque de red neuronal de regresión con el objetivo de inferir el SIT utilizando datos de TB de la carga útil de microondas flexible 2 (FMPL-2) de la misión FSSCat. Se entrenaron dos modelos - que cubren el hielo fino hasta 0.6 m y el rango completo del SIT - con datos del Ártico utilizando datos de “ground truth” derivados del SMOS y del Cryosat-2. Este trabajo demuestra que las misiones CubeSat de coste moderado pueden proporcionar datos valiosos para aplicaciones de observación de la Tierra.Postprint (published version

Perspective Chapter: Downscaling of Satellite Soil Moisture Estimates

Soil moisture is a key parameter in the hydrological cycle and plays a critical role in global climate. The capacity to forecast drought and floods, manage water resources, and make field-scale decisions depends on accurate and thorough information on soil moisture. In addition to the instrument-based field observation approaches, dynamic mapping of soil moisture has been made possible by satellite remote sensing technologies. Estimates of soil moisture at a global and regional scale from optical and thermal remote sensing have been explored, and considerable advancements have been made. However, these global soil moisture products have coarse spatial resolutions and are typically unsuitable for field-level hydrological and agricultural applications. In this regard, this chapter presents a comprehensive review of the latest downscaling methods to improve the coarse-spatial and temporal resolution of soil moisture products. The main approaches discussed in the chapter include active passive fusion, optical/thermal based, topography based, and data assimilation methods. The physical background, current status, advantages and limitations associated with each downscaling approach has been thoroughly examined. Each of these optical/thermal, microwave-based methods for soil moisture estimation involves intricate derivation at different spatiotemporal scales, which can be combined using recent advances in machine learning

Ground, Proximal, and Satellite Remote Sensing of Soil Moisture

Soil moisture (SM) is a key hydrologic state variable that is of significant importance for numerous Earth and environmental science applications that directly impact the global environment and human society. Potential applications include, but are not limited to, forecasting of weather and climate variability; prediction and monitoring of drought conditions; management and allocation of water resources; agricultural plant production and alleviation of famine; prevention of natural disasters such as wild fires, landslides, floods, and dust storms; or monitoring of ecosystem response to climate change. Because of the importance and wide‐ranging applicability of highly variable spatial and temporal SM information that links the water, energy, and carbon cycles, significant efforts and resources have been devoted in recent years to advance SM measurement and monitoring capabilities from the point to the global scales. This review encompasses recent advances and the state‐of‐the‐art of ground, proximal, and novel SM remote sensing techniques at various spatial and temporal scales and identifies critical future research needs and directions to further advance and optimize technology, analysis and retrieval methods, and the application of SM information to improve the understanding of critical zone moisture dynamics. Despite the impressive progress over the last decade, there are still many opportunities and needs to, for example, improve SM retrieval from remotely sensed optical, thermal, and microwave data and opportunities for novel applications of SM information for water resources management, sustainable environmental development, and food security

Remote Sensing of Environmental Changes in Cold Regions

This Special Issue gathers papers reporting recent advances in the remote sensing of cold regions. It includes contributions presenting improvements in modeling microwave emissions from snow, assessment of satellite-based sea ice concentration products, satellite monitoring of ice jam and glacier lake outburst floods, satellite mapping of snow depth and soil freeze/thaw states, near-nadir interferometric imaging of surface water bodies, and remote sensing-based assessment of high arctic lake environment and vegetation recovery from wildfire disturbances in Alaska. A comprehensive review is presented to summarize the achievements, challenges, and opportunities of cold land remote sensing

Spatial downscaling and gap-filling of SMAP soil moisture to high resolution using MODIS surface variables and machine learning approaches over ShanDian River Basin, China

High-resolution soil moisture (SM) information is essential for regional to global hydrological and agricultural applications. The Soil Moisture Active Passive (SMAP) offers daily global composites of SM at coarse-resolution 9 and 36 km, with data gaps limiting its local application to depict SM distribution in detail. To overcome the aforementioned problem, a downscaling and gap-filling novel approach was adopted, using random forest (RF) and artificial neural network (ANN) algorithms to downscale SMAP SM data, using land-surface variables from moderate-resolution imaging spectroradiometer (MODIS) onboard Aqua and Terra satellites from the years 2018 to 2019. Firstly, four combinations (RF+Aqua, RF+Terra, ANN+Aqua, and ANN+Terra) were developed. Each combination downscaled SMAP SM at a high resolution (1 km). These combinations were evaluated by using error matrices and in situ SM at different scales in the ShanDian River (SDR) Basin. The combination RF+Terra showed a better performance, with a low averaged unbiased root mean square error (ubRMSE) of 0.034 (Formula presented.) / (Formula presented.) and high averaged correlation (R) of 0.54 against the small-, medium-, and large-scale in situ SM. Secondly, the impact of various land covers was examined by using downscaled SMAP and in situ SM. Vegetation attenuation makes woodland more error-prone and less correlated than grassland and farmland. Finally, the RF+Terra and ANN+Terra combinations were selected for their higher accuracy in gap filling of downscaled SMAP SM. The gap-filled downscaled SMAP SM results were compared spatially with China Land Data Assimilation System (CLDAS) SM and in situ SM. The RF+Terra combination outcomes were more humid than ANN+Terra combination results in the SDR basin. Overall, the RF+Terra combination gap-filled data showed high R (0.40) and less ubRMSE (0.064 (Formula presented.) / (Formula presented.)) against in situ SM, which was close to CLDAS SM. This study showed that the proposed RF- and ANN-based downscaling methods have a potential to improve the spatial resolution and gap-filling of SMAP SM at a high resolution (1 km)