An artificial neural network approach for soil moisture retrieval using passive microwave data

Soil moisture is a key variable that defines land surface-atmosphere (boundary layer) interactions, by contributing directly to the surface energy and water balance. Soil moisture values derived from remote sensing platforms only accounts for the near surface soil layers, generally the top 5cm. Passive microwave data at L-band (1.4 GHz, 21cm wavelength) measurements are shown to be a very effective observation for surface soil moisture retrieval. The first space-borne L-band mission dedicated to observing soil moisture, the European Space Agency's (ESA) Soil Moisture and Ocean Salinity (SMOS) mission, was launched on 2nd November 2009.Artificial Neural Network (ANN) methods have been used to empirically ascertain the complex statistical relationship between soil moisture and brightness temperature in the presence of vegetation cover. The current problem faced by this method is its inability to predict soil moisture values that are 'out-of-range' of the training data.In this research, an optimization model is developed for the Backpropagation Neural Network model. This optimization model utilizes the combination of the mean and standard deviation of the soil moisture values, together with the prediction process at different pre-determined, equal size regions to cope with the spatial and temporal variation of soil moisture values. This optimized model coupled with an ANN of optimum architecture, in terms of inputs and the number of neurons in the hidden layers, is developed to predict scale-to-scale and downscaling of soil moisture values. The dependency on the accuracy of the mean and standard deviation values of soil moisture data is also studied in this research by simulating the soil moisture values using a multiple regression model. This model obtains very encouraging results for these research problems.The data used to develop and evaluate the model in this research has been obtained from the National Airborne Field Experiments in 2005

Estimating Root Zone Soil Moisture Across the Eastern United States with Passive Microwave Satellite Data and a Simple Hydrologic Model

Root zone soil moisture (RZSM) affects many natural processes and is an important component of environmental modeling, but it is expensive and challenging to monitor for relatively small spatial extents. Satellite datasets offer ample spatial coverage of near-surface soil moisture content at up to a daily time-step, but satellite-derived data products are currently too coarse in spatial resolution to use directly for many environmental applications, such as those for small catchments. This study investigated the use of passive microwave satellite soil moisture data products in a simple hydrologic model to provide root zone soil moisture estimates across a small catchment over a two year time period and the Eastern U.S. (EUS) at a 1 km resolution over a decadal time-scale. The physically based soil moisture analytical relationship (SMAR) was calibrated and tested with the Advanced Microwave Scanning Radiometer (AMSRE), Soil Moisture Ocean Salinity (SMOS), and Soil Moisture Active Passive (SMAP) data products. The SMAR spatial model relies on maps of soil physical properties and was first tested at the Shale Hills experimental catchment in central Pennsylvania. The model met a root mean square error (RMSE) benchmark of 0.06 cm3 cm−3 at 66% of the locations throughout the catchment. Then, the SMAR spatial model was calibrated at up to 68 sites (SCAN and AMERIFLUX network sites) that monitor soil moisture across the EUS region, and maps of SMAR parameters were generated for each satellite data product. The average RMSE for RZSM estimates from each satellite data product is <0.06 cm3 cm−3. Lastly, the 1 km EUS regional RZSM maps were tested with data from the Shale Hills, which was set aside for validating the regional SMAR, and the RMSE between the RZSM predictions and the catchment average is 0.042 cm3 cm−3. This study offers a promising approach for generating long time-series of regional RZSM maps with the same spatial resolution of soil property maps

Ground, Proximal, and Satellite Remote Sensing of Soil Moisture

Soil moisture (SM) is a key hydrologic state variable that is of significant importance for numerous Earth and environmental science applications that directly impact the global environment and human society. Potential applications include, but are not limited to, forecasting of weather and climate variability; prediction and monitoring of drought conditions; management and allocation of water resources; agricultural plant production and alleviation of famine; prevention of natural disasters such as wild fires, landslides, floods, and dust storms; or monitoring of ecosystem response to climate change. Because of the importance and wide‐ranging applicability of highly variable spatial and temporal SM information that links the water, energy, and carbon cycles, significant efforts and resources have been devoted in recent years to advance SM measurement and monitoring capabilities from the point to the global scales. This review encompasses recent advances and the state‐of‐the‐art of ground, proximal, and novel SM remote sensing techniques at various spatial and temporal scales and identifies critical future research needs and directions to further advance and optimize technology, analysis and retrieval methods, and the application of SM information to improve the understanding of critical zone moisture dynamics. Despite the impressive progress over the last decade, there are still many opportunities and needs to, for example, improve SM retrieval from remotely sensed optical, thermal, and microwave data and opportunities for novel applications of SM information for water resources management, sustainable environmental development, and food security

Impact of Rescaling Approaches in Simple Fusion of Soil Moisture Products

In this study, the impact of various rescaling approaches in the framework of data fusion is explored. Four different soil moisture products (Advanced Scatterometer; Advanced Microwave Scanning Radiometer for EOS, AMSR-E; Antecedent Precipitation Index; and Global Land Data Assimilation System-NOAH) are fused. The systematic differences between products are removed before the fusion utilizing various rescaling approaches focusing on different methods (regression, variance/cumulative distribution function (CDF) matching, multivariate adaptive regression splines, and support vector machines based), stationarity assumptions (constant or time-varying rescaling coefficients), and time-frequency techniques (periodic or nonperiodic high- and low-frequency components). Given that statistical descriptions (e.g., standard deviation and correlation coefficient) of reference data sets are utilized in rescaling approaches, the precision of the selected reference data set also impacts the final fused product precision. Experiments are validated over 542 soil moisture monitoring sites selected from the International Soil Moisture Network data sets between 2007 and 2011. Overall, results highlight the importance of reference data set selection-particularly that a more precise reference product yields a higher precision fused soil moisture product. This conclusion is sensitive neither to the number of fused products nor the rescaling procedure. Among rescaling approaches, the precision of fused products is most affected by the choice of rescaling stationary assumption and time-frequency decomposition technique. Variations in rescaling methods have only a small impact on the precision of pair fused products. In contrast, utilizing a time-varying stationary assumption and nonperiodic decomposition technique produces correlation improvements of 0.07 [-] and 0.02 [-], respectively, versus the other widely implemented rescaling approaches

Advanced methods for earth observation data synergy for geophysical parameter retrieval

The first part of the thesis focuses on the analysis of relevant factors to estimate the response time between satellite-based and in-situ soil moisture (SM) using a Dynamic Time Warping (DTW). DTW was applied to the SMOS L4 SM, and was compared to in-situ root-zone SM in the REMEDHUS network in Western Spain. The method was customized to control the evolution of time lag during wetting and drying conditions. Climate factors in combination with crop growing seasons were studied to reveal SM-related processes. The heterogeneity of land use was analyzed using high-resolution images of NDVI from Sentinel-2 to provide information about the level of spatial representativity of SMOS data to each in-situ station. The comparison of long-term precipitation records and potential evapotranspiration allowed estimation of SM seasons describing different SM conditions depending on climate and soil properties. The second part of the thesis focuses on data-driven methods for sea ice segmentation and parameter retrieval. A Bayesian framework is employed to segment sets of multi-source satellite data. The Bayesian unsupervised learning algorithm allows to investigate the ‘hidden link’ between multiple data. The statistical properties are accounted for by a Gaussian Mixture Model, and the spatial interactions are reflected using Hidden Markov Random Fields. The algorithm segments spatial data into a number of classes, which are represented as a latent field in physical space and as clusters in feature space. In a first application, a two-step probabilistic approach based on Expectation-Maximization and the Bayesian segmentation algorithm was used to segment SAR images to discriminate surface water from sea ice types. Information on surface roughness is contained in the radar backscattering images which can be - in principle - used to detect melt ponds and to estimate high-resolution sea ice concentration (SIC). In a second study, the algorithm was applied to multi-incidence angle TB data from the SMOS L1C product to harness the its sensitivity to thin ice. The spatial patterns clearly discriminate well-determined areas of open water, old sea ice and a transition zone, which is sensitive to thin sea ice thickness (SIT) and SIC. In a third application, SMOS and the AMSR2 data are used to examine the joint effect of CIMR-like observations. The information contained in the low-frequency channels allows to reveal ranges of thin sea ice, and thicker ice can be determined from the relationship between the high-frequency channels and changing conditions as the sea ice ages. The proposed approach is suitable for merging large data sets and provides metrics for class analysis, and to make informed choices about integrating data from future missions into sea ice products. A regression neural network approach was investigated with the goal to infer SIT using TB data from the Flexible Microwave Payload 2 (FMPL-2) of the FSSCat mission. Two models - covering thin ice up to 0.6m and the full-range of SIT - were trained on Arctic data using ground truth data derived from the SMOS and Cryosat-2. This work demonstrates that moderate-cost CubeSat missions can provide valuable data for applications in Earth observation.La primera parte de la tesis se centra en el análisis de los factores relevantes para estimar el tiempo de respuesta entre la humedad del suelo (SM) basada en el satélite y la in-situ, utilizando una deformación temporal dinámica (DTW). El DTW se aplicó al SMOS L4 SM, y se comparó con la SM in-situ en la red REMEDHUS en el oeste de España. El método se adaptó para controlar la evolución del desfase temporal durante diferentes condiciones de humedad y secado. Se estudiaron los factores climáticos en combinación con los períodos de crecimiento de los cultivos para revelar los procesos relacionados con la SM. La heterogeneidad del uso del suelo se analizó utilizando imágenes de alta resolución de NDVI de Sentinel-2 para proporcionar información sobre el nivel de representatividad espacial de los datos de SMOS a cada estación in situ. La comparación de los patrones de precipitación a largo plazo y la evapotranspiración potencial permitió estimar las estaciones de SM que describen diferentes condiciones de SM en función del clima y las propiedades del suelo. La segunda parte de esta tesis se centra en métodos dirigidos por datos para la segmentación del hielo marino y la obtención de parámetros. Se emplea un método de inferencia bayesiano para segmentar conjuntos de datos satelitales de múltiples fuentes. El algoritmo de aprendizaje bayesiano no supervisado permite investigar el “vínculo oculto” entre múltiples datos. Las propiedades estadísticas se contabilizan mediante un modelo de mezcla gaussiana, y las interacciones espaciales se reflejan mediante campos aleatorios ocultos de Markov. El algoritmo segmenta los datos espaciales en una serie de clases, que se representan como un campo latente en el espacio físico y como clústeres en el espacio de las variables. En una primera aplicación, se utilizó un enfoque probabilístico de dos pasos basado en la maximización de expectativas y el algoritmo de segmentación bayesiano para segmentar imágenes SAR con el objetivo de discriminar el agua superficial de los tipos de hielo marino. La información sobre la rugosidad de la superficie está contenida en las imágenes de backscattering del radar, que puede utilizarse -en principio- para detectar estanques de deshielo y estimar la concentración de hielo marino (SIC) de alta resolución. En un segundo estudio, el algoritmo se aplicó a los datos TB de múltiples ángulos de incidencia del producto SMOS L1C para aprovechar su sensibilidad al hielo fino. Los patrones espaciales discriminan claramente áreas bien determinadas de aguas abiertas, hielo marino viejo y una zona de transición, que es sensible al espesor del hielo marino fino (SIT) y al SIC. En una tercera aplicación, se utilizan los datos de SMOS y de AMSR2 para examinar el efecto conjunto de las observaciones tipo CIMR. La información contenida en los canales de baja frecuencia permite revelar rangos de hielo marino delgado, y el hielo más grueso puede determinarse a partir de la relación entre los canales de alta frecuencia y las condiciones cambiantes a medida que el hielo marino envejece. El enfoque propuesto es adecuado para fusionar grandes conjuntos de datos y proporciona métricas para el análisis de clases, y para tomar decisiones informadas sobre la integración de datos de futuras misiones en los productos de hielo marino. Se investigó un enfoque de red neuronal de regresión con el objetivo de inferir el SIT utilizando datos de TB de la carga útil de microondas flexible 2 (FMPL-2) de la misión FSSCat. Se entrenaron dos modelos - que cubren el hielo fino hasta 0.6 m y el rango completo del SIT - con datos del Ártico utilizando datos de “ground truth” derivados del SMOS y del Cryosat-2. Este trabajo demuestra que las misiones CubeSat de coste moderado pueden proporcionar datos valiosos para aplicaciones de observación de la Tierra.Postprint (published version

A roadmap for high-resolution satellite soil moisture applications – confronting product characteristics with user requirements

Soil moisture observations are of broad scientific interest and practical value for a wide range of applications. The scientific community has made significant progress in estimating soil moisture from satellite-based Earth observation data, particularly in operationalizing coarse-resolution (25-50 km) soil moisture products. This review summarizes existing applications of satellite-derived soil moisture products and identifies gaps between the characteristics of currently available soil moisture products and the application requirements from various disciplines. We discuss the efforts devoted to the generation of high-resolution soil moisture products from satellite Synthetic Aperture Radar (SAR) data such as Sentinel-1 C-band backscatter observations and/or through downscaling of existing coarse-resolution microwave soil moisture products. Open issues and future opportunities of satellite-derived soil moisture are discussed, providing guidance for further development of operational soil moisture products and bridging the gap between the soil moisture user and supplier communities

Désagrégation de l'humidité du sol issue des produits satellitaires micro-ondes passives et exploration de son utilisation pour l'amélioration de la modélisation et la prévision hydrologique

De plus en plus de produits satellitaires en micro-ondes passives sont disponibles. Cependant, leur large résolution spatiale (25-50 km) n’en font pas un outil adéquat pour des applications hydrologiques à une échelle locale telles que la modélisation et la prévision hydrologiques. Dans de nombreuses études, une désagrégation d’échelle de l’humidité du sol des produits satellites micro-ondes est faite puis validée avec des mesures in-situ. Toutefois, l’utilisation de ces données issues d’une désagrégation d’échelle n’a pas encore été pleinement étudiée pour des applications en hydrologie. Ainsi, l’objectif de cette thèse est de proposer une méthode de désagrégation d’échelle de l’humidité du sol issue de données satellitaires en micro-ondes passives (Satellite Passive Microwave Active and Passive - SMAP) à différentes résolutions spatiales afin d’évaluer leur apport sur l’amélioration potentielle des modélisations et prévisions hydrologiques. À partir d’un modèle de forêt aléatoire, une désagrégation d’échelle de l’humidité du sol de SMAP l’amène de 36-km de résolution initialement à des produits finaux à 9-, 3- et 1-km de résolution. Les prédicteurs utilisés sont à haute résolution spatiale et de sources différentes telles que Sentinel-1A, MODIS et SRTM. L'humidité du sol issue de cette désagrégation d’échelle est ensuite assimilée dans un modèle hydrologique distribué à base physique pour tenter d’améliorer les sorties de débit. Ces expériences sont menées sur les bassins versants des rivières Susquehanna (de grande taille) et Upper-Susquehanna (en comparaison de petite taille), tous deux situés aux États-Unis. De plus, le modèle assimile aussi des données d’humidité du sol en profondeur issue d’une extrapolation verticale des données SMAP. Par ailleurs, les données d’humidité du sol SMAP et les mesures in-situ sont combinées par la technique de fusion conditionnelle. Ce produit de fusion SMAP/in-situ est assimilé dans le modèle hydrologique pour tenter d’améliorer la prévision hydrologique sur le bassin versant Au Saumon situé au Québec. Les résultats montrent que l'utilisation de l’humidité du sol à fine résolution spatiale issue de la désagrégation d’échelle améliore la représentation de la variabilité spatiale de l’humidité du sol. En effet, le produit à 1- km de résolution fournit plus de détails que les produits à 3- et 9-km ou que le produit SMAP de base à 36-km de résolution. De même, l’utilisation du produit de fusion SMAP/ in-situ améliore la qualité et la représentation spatiale de l’humidité du sol. Sur le bassin versant Susquehanna, la modélisation hydrologique s’améliore avec l’assimilation du produit de désagrégation d’échelle à 9-km, sans avoir recours à des résolutions plus fines. En revanche, sur le bassin versant Upper-Susquehanna, c’est le produit avec la résolution spatiale la plus fine à 1- km qui offre les meilleurs résultats de modélisation hydrologique. L’assimilation de l’humidité du sol en profondeur issue de l’extrapolation verticale des données SMAP n’améliore que peu la qualité du modèle hydrologique. Par contre, l’assimilation du produit de fusion SMAP/in-situ sur le bassin versant Au Saumon améliore la qualité de la prévision du débit, même si celle-ci n’est pas très significative.Abstract: The availability of satellite passive microwave soil moisture is increasing, yet its spatial resolution (i.e., 25-50 km) is too coarse to use for local scale hydrological applications such as streamflow simulation and forecasting. Many studies have attempted to downscale satellite passive microwave soil moisture products for their validation with in-situ soil moisture measurements. However, their use for hydrological applications has not yet been fully explored. Thus, the objective of this thesis is to downscale the satellite passive microwave soil moisture (i.e., Satellite Microwave Active and Passive - SMAP) to a range of spatial resolutions and explore its value in improving streamflow simulation and forecasting. The random forest machine learning technique was used to downscale the SMAP soil moisture from 36-km to 9-, 3- and 1-km spatial resolutions. A combination of host of high-resolution predictors derived from different sources including Sentinel-1A, MODIS and SRTM were used for downscaling. The downscaled SMAP soil moisture was then assimilated into a physically-based distributed hydrological model for improving streamflow simulation for Susquehanna (larger in size) and Upper Susquehanna (relatively smaller in size) watersheds, located in the United States. In addition, the vertically extrapolated SMAP soil moisture was assimilated into the model. On the other hand, the SMAP and in-situ soil moisture were merged using the conditional merging technique and the merged SMAP/in-situ soil moisture was then assimilated into the model to improve streamflow forecast over the au Saumon watershed. The results show that the downscaling improved the spatial variability of soil moisture. Indeed, the 1-km downscaled SMAP soil moisture presented a higher spatial detail of soil moisture than the 3-, 9- or original resolution (36-km) SMAP product. Similarly, the merging of SMAP and in-situ soil moisture improved the accuracy as well as spatial representation soil moisture. Interestingly, the assimilation of the 9-km downscaled SMAP soil moisture significantly improved the accuracy of streamflow simulation for the Susquehanna watershed without the need of going to higher spatial resolution, whereas for the Upper Susquehanna watershed the 1-km downscaled SMAP showed better results than the coarser resolutions. The assimilation of vertically extrapolated SMAP soil moisture only slightly further improved the accuracy of the streamflow simulation. On the other hand, the assimilation of merged SMAP/in-situ soil moisture for the au Saumon watershed improved the accuracy of streamflow forecast, yet the improvement was not that significant. Overall, this study demonstrated the potential of satellite passive microwave soil moisture for streamflow simulation and forecasting