Evaluation of SMAP Core Validation Site Representativeness Errors Using Dense Networks of In Situ Sensors and Random Forests

In order to validate its soil moisture products, the NASA Soil Moisture Active Passive (SMAP) mission utilises sites with permanent networks of in situ soil moisture sensors maintained by independent calibration and validation partners in a variety of ecosystems around the world. Measurements from each core validation site (CVS) are combined in a weighted average to produce an estimate of soil moisture at a 33-km scale that represents the SMAP’s radiometer-based retrievals. Since upscaled estimates produced in this manner are dependent on the weighting scheme applied, an independent method of quantifying their biases is needed.Here,we present one such method that uses soil moisture measurements taken from a dense, but temporary, network of soil moisture sensors deployed at each CVS to train a random forests regression expressing soil moisture in terms of a set of spatial variables. The regression then serves as an independent source of upscaled estimates against which permanent network upscaled estimates can be compared in order to calculate bias statistics.This method,which offers a systematic and unified approach to estimate bias across a variety of validation sites, was applied to estimate biases at four CVSs. The results showed that the magnitude of the uncertainty in the permanent network upscaling bias can sometimes exceed 80% of the upper limit on SMAP’s entire allowable unbiased root-mean-square error(ubRMSE).Such large CVS bias uncertainties could make it more difficult to assess biases in soil moisture estimates from SMAP

Mapping Soil Moisture from Remotely Sensed and In-situ Data with Statistical Methods

Soil moisture is an important factor for accurate prediction of agricultural productivity and rainfall runoff with hydrological models. Remote sensing satellites such as Soil Moisture Active Passive (SMAP) offer synoptic views of soil moisture distribution at a regional-to-global scale. To use the soil moisture product from these satellites, however, requires a downscaling of the data from an usually large instantaneous field of view (i.e. 36 km) to the watershed analysis scales ranging from 30 m to 1 km. In addition, validation of the soil moisture products using the ground station observations without an upscaling treatment would lead to cross-level fallacy. In the literature of geographical analysis, scale is one of the top research concens because of the needs for multi-source geospatial data fusion. This dissertation research introduced a multi-level soil moisture data assimilation and processing methodology framework based on spatial information theories. The research contains three sections: downscaling using machine learning and geographically weighted regression, upscaling ground network observation to calibrate satellite data, and spatial and temporal multi-scale data assimilation using spatio-temporal interpolation. (1) Soil moisture downscaling In the first section, a downscaling method is designed using 1-km geospatial data to obtain subpixel soil moisture from the 9-km soil moisture product of the SMAP satellite. The geospatial data includes normalized difference vegetation index (NDVI), land surface temperature (LST), gross primary productivity (GPP), topographical moisture index (TMI), with all resampled to 1-km resolution. The machine learning algorithm – random forest was used to create a prediction model of the soil moisture at a 1-km resolution. The 1-km soil moisture product was compared with the ground samples from the West Texas Mesonet (WTM) station data. The residual was then interpolated to compensate the unpredicted variability of the model. The entire process was based on the concept of regression kriging- where the regression was done by the random forest model. Results show that the downscaling approach was able to achieve better accuracy than the current statistical downscaling methods. (2) Station network data upscaling The Texas Soil Observation Network (TxSON) network was designed to test the feasibility of upscaling the in-situ data to match the scale of the SMAP data. I advanced the upscaling method by using the Voronoi polygons and block kriging with a Gaussian kernel aggregation. The upscaling algorithm was calibrated using different spatial aggregation parameters, such as the fishnet cell size and Gaussian kernel standard deviation. The use of the kriging can significantly reduce the spatial autocorrelation among the TxSON stations because of its declustering ability. The result proved the new upscaling method was better than the traditional ones. (3) Multi-scale data fusion in a spatio-temporal framework None of the current works for soil moisture statistical downscaling honors time and space equally. It is important, however, that the soil moisture products are consistent in both domains. In this section, the space-time kriging model for soil moisture downscaling and upscaling computation framework designed in the last two sections is implemented to create a spatio-temporal integrated solution to soil moisture multi-scale mapping. The present work has its novelty in using spatial statistics to reconcile the scale difference from satellite data and ground observations, and therefore proposes new theories and solutions for dealing with the modifiable areal unit problem (MAUP) incurred in soil moisture mapping from satellite and ground stations

Global evaluation of SMAP/Sentinel-1 soil moisture products

MAP/Sentinel-1 soil moisture is the latest SMAP (Soil Moisture Active Passive) product derived from synergistic utilization of the radiometry observations of SMAP and radar backscattering data of Sentinel-1. This product is the first and only global soil moisture (SM) map at 1 km and 3 km spatial resolutions. In this paper, we evaluated the SMAP/Sentinel-1 SM product from different viewpoints to better understand its quality, advantages, and likely limitations. A comparative analysis of this product and in situ measurements, for the time period March 2015 to January 2022, from 35 dense and sparse SM networks and 561 stations distributed around the world was carried out. We examined the effects of land cover, vegetation fraction, water bodies, urban areas, soil characteristics, and seasonal climatic conditions on the performance of active–passive SMAP/Sentinel-1 in estimating the SM. We also compared the performance metrics of enhanced SMAP (9 km) and SMAP/Sentinel-1 products (3 km) to analyze the effects of the active–passive disaggregation algorithm on various features of the SMAP SM maps. Results showed satisfactory agreement between SMAP/Sentinel-1 and in situ SM measurements for most sites (r values between 0.19 and 0.95 and ub-RMSE between 0.03 and 0.17), especially for dense sites without representativeness errors. Thanks to the vegetation effect correction applied in the active–passive algorithm, the SMAP/Sentinel-1 product had the highest correlation with the reference data in grasslands and croplands. Results also showed that the accuracy of the SMAP/Sentinel-1 SM product in different networks is independent of the presence of water bodies, urban areas, and soil types.Peer ReviewedPostprint (published version

Synthesis of Satellite Microwave Observations for Monitoring Global Land-Atmosphere CO2 Exchange

This dissertation describes the estimation, error quantification, and incorporation of land surface information from microwave satellite remote sensing for modeling global ecosystem land-atmosphere net CO2 exchange. Retrieval algorithms were developed for estimating soil moisture, surface water, surface temperature, and vegetation phenology from microwave imagery timeseries. Soil moisture retrievals were merged with model-based soil moisture estimates and incorporated into a light-use efficiency model for vegetation productivity coupled to a soil decomposition model. Results, including state and uncertainty estimates, were evaluated with a global eddy covariance flux tower network and other independent global model- and remote-sensing based products

The Evaluation of the Additive Information Contained in New Ecohydrological Measurements

The development of ecohydrological frameworks and theories under the ongoing global climate crisis depends on the development of new and advanced ecohydrological measurements. Currently, numerous of datasets have been collected at plot and ecosystem levels to understand the complex interactions of along the soil, plant, and atmosphere continuum. The development of new measurements costs considerable effort, time, and funding. Therefore, it is important to quantify if new measurements contain useful information for ecohydrological studies, and how the information encoded in the new measurements are transferred to understand and predict key environmental variables. In this dissertation, we show that predictions in vegetation dynamics can be improved by adding observations from advanced satellite and in situ sensor systems. First, we evaluated new satellite soil moisture and vegetation optical depth measurements by Soil Moisture Passive Active (SMAP). We find that there is more opportunity for SMAP soil moisture and vegetation observations to be useful in locations where the daily vegetation climatology cannot adequately reflect observed vegetation dynamics. We also find that the uncertainties SMAP dual channel algorithm (DCA) are largely contributed by uncertainty of the algorithm’s inputs (horizontal and vertical polarized brightness temperature), while the informational uncertainty of the SMAP DCA model itself is more related to the retrieval quality of soil moisture. The informational redundancy and synergy of the two brightness temperature measurements from SMAP are tightly related to the SMAP soil moisture retrieval quality. Finally, we apply a similar informational analysis to new isotopic measurements at the National Ecological Observation Network (NEON). We find that majority of the information from the isotope measurements collected by NEON is unique, which cannot be obtained by other meteorological variables. Carbon isotope (δ13C) provides more additional information about LH in arid locations, while the water isotope (δ2H) provides more additional information about LH at locations with higher aridity, lower mean annual temperature, and lower mean site elevation. These studies show that informational analysis is useful to evaluated how additional information is encoded in new ecohydrological measurements

Understanding and Improving the Soil Moisture Retrieval Algorithm under Space, Time and Heterogeneity

The spatial and temporal monitoring of soil moisture from remote sensing platforms plays a pivotal role in predicting the future food and water security. That is, improving soil moisture estimation at remote sensing platforms has remarkable impacts in the fields of meteorology, hydrology, agriculture, and global climate change. However, remote sensing of soil moisture for long is hindered by spatial heterogeneity in land surface variables (soil, biomass, topography, and temperature) which cause systematic and random errors in soil moisture retrievals. Most soil moisture improvement methods to date focused on the downscaling of either coarse resolution soil moisture or brightness temperature based on fine scale ancillary information of land surface variables. Comparatively little work has been done on improving the parameterization of most sensitive variables to radiative transfer model that impact soil moisture retrieval accuracy. In addition, the classic radiative transfer model assumes the vegetation and surface roughness parameters, as constant with space and time which undermines the retrieval accuracy. Also, it is largely elusive so far the discussion on the non-linearity of microwave radiative transfer model and its relationship with energy and water fluxes. In order to address the above mentioned limitations, this dissertation aims to develop and validate a soil moisture modeling framework with associated improved parameterizations for surface roughness and vegetation optical depth (VOD) in the homogeneous and heterogeneous environments. To this end, the following research work is specifically conducted: (a) conduct comprehensive sensitivity analysis on radiative transfer model with space, time and hydroclimates; (b) develop multi-scale surface roughness model which incorporates small (soil) and large (topography) surface undulations to improve soil moisture retrievals; (c) improve the parameterization of vegetation topical depth (VOD) using within-pixel biomass heterogeneity to improved soil moisture accuracy; (d) investigate the non-linearity in microwave radiative transfer model, and its association with thermal energy fluxes. The results of this study showed that: (a) the total (linear + non-linear) sensitivity of soil, temperature and biomass variables varied with spatial scale (support), time, and hydro climates, with higher non-linearity observed for dense biomass regions. This non-linearity is also governed by soil moisture availability and temperature. Among these variables, surface roughness and vegetation optical depth are most sensitive variables to radiative transfer model (RTM); (b) considering the spatial and temporal variability in parameterization of surface roughness and VOD has improved soil moisture retrieval accuracy, importantly in cropland and forest environments; and (c) the soil moisture estimated through evaporative fraction (EF) correlates higher with VOD corrected soil moisture

Désagrégation de l'humidité du sol issue des produits satellitaires micro-ondes passives et exploration de son utilisation pour l'amélioration de la modélisation et la prévision hydrologique

De plus en plus de produits satellitaires en micro-ondes passives sont disponibles. Cependant, leur large résolution spatiale (25-50 km) n’en font pas un outil adéquat pour des applications hydrologiques à une échelle locale telles que la modélisation et la prévision hydrologiques. Dans de nombreuses études, une désagrégation d’échelle de l’humidité du sol des produits satellites micro-ondes est faite puis validée avec des mesures in-situ. Toutefois, l’utilisation de ces données issues d’une désagrégation d’échelle n’a pas encore été pleinement étudiée pour des applications en hydrologie. Ainsi, l’objectif de cette thèse est de proposer une méthode de désagrégation d’échelle de l’humidité du sol issue de données satellitaires en micro-ondes passives (Satellite Passive Microwave Active and Passive - SMAP) à différentes résolutions spatiales afin d’évaluer leur apport sur l’amélioration potentielle des modélisations et prévisions hydrologiques. À partir d’un modèle de forêt aléatoire, une désagrégation d’échelle de l’humidité du sol de SMAP l’amène de 36-km de résolution initialement à des produits finaux à 9-, 3- et 1-km de résolution. Les prédicteurs utilisés sont à haute résolution spatiale et de sources différentes telles que Sentinel-1A, MODIS et SRTM. L'humidité du sol issue de cette désagrégation d’échelle est ensuite assimilée dans un modèle hydrologique distribué à base physique pour tenter d’améliorer les sorties de débit. Ces expériences sont menées sur les bassins versants des rivières Susquehanna (de grande taille) et Upper-Susquehanna (en comparaison de petite taille), tous deux situés aux États-Unis. De plus, le modèle assimile aussi des données d’humidité du sol en profondeur issue d’une extrapolation verticale des données SMAP. Par ailleurs, les données d’humidité du sol SMAP et les mesures in-situ sont combinées par la technique de fusion conditionnelle. Ce produit de fusion SMAP/in-situ est assimilé dans le modèle hydrologique pour tenter d’améliorer la prévision hydrologique sur le bassin versant Au Saumon situé au Québec. Les résultats montrent que l'utilisation de l’humidité du sol à fine résolution spatiale issue de la désagrégation d’échelle améliore la représentation de la variabilité spatiale de l’humidité du sol. En effet, le produit à 1- km de résolution fournit plus de détails que les produits à 3- et 9-km ou que le produit SMAP de base à 36-km de résolution. De même, l’utilisation du produit de fusion SMAP/ in-situ améliore la qualité et la représentation spatiale de l’humidité du sol. Sur le bassin versant Susquehanna, la modélisation hydrologique s’améliore avec l’assimilation du produit de désagrégation d’échelle à 9-km, sans avoir recours à des résolutions plus fines. En revanche, sur le bassin versant Upper-Susquehanna, c’est le produit avec la résolution spatiale la plus fine à 1- km qui offre les meilleurs résultats de modélisation hydrologique. L’assimilation de l’humidité du sol en profondeur issue de l’extrapolation verticale des données SMAP n’améliore que peu la qualité du modèle hydrologique. Par contre, l’assimilation du produit de fusion SMAP/in-situ sur le bassin versant Au Saumon améliore la qualité de la prévision du débit, même si celle-ci n’est pas très significative.Abstract: The availability of satellite passive microwave soil moisture is increasing, yet its spatial resolution (i.e., 25-50 km) is too coarse to use for local scale hydrological applications such as streamflow simulation and forecasting. Many studies have attempted to downscale satellite passive microwave soil moisture products for their validation with in-situ soil moisture measurements. However, their use for hydrological applications has not yet been fully explored. Thus, the objective of this thesis is to downscale the satellite passive microwave soil moisture (i.e., Satellite Microwave Active and Passive - SMAP) to a range of spatial resolutions and explore its value in improving streamflow simulation and forecasting. The random forest machine learning technique was used to downscale the SMAP soil moisture from 36-km to 9-, 3- and 1-km spatial resolutions. A combination of host of high-resolution predictors derived from different sources including Sentinel-1A, MODIS and SRTM were used for downscaling. The downscaled SMAP soil moisture was then assimilated into a physically-based distributed hydrological model for improving streamflow simulation for Susquehanna (larger in size) and Upper Susquehanna (relatively smaller in size) watersheds, located in the United States. In addition, the vertically extrapolated SMAP soil moisture was assimilated into the model. On the other hand, the SMAP and in-situ soil moisture were merged using the conditional merging technique and the merged SMAP/in-situ soil moisture was then assimilated into the model to improve streamflow forecast over the au Saumon watershed. The results show that the downscaling improved the spatial variability of soil moisture. Indeed, the 1-km downscaled SMAP soil moisture presented a higher spatial detail of soil moisture than the 3-, 9- or original resolution (36-km) SMAP product. Similarly, the merging of SMAP and in-situ soil moisture improved the accuracy as well as spatial representation soil moisture. Interestingly, the assimilation of the 9-km downscaled SMAP soil moisture significantly improved the accuracy of streamflow simulation for the Susquehanna watershed without the need of going to higher spatial resolution, whereas for the Upper Susquehanna watershed the 1-km downscaled SMAP showed better results than the coarser resolutions. The assimilation of vertically extrapolated SMAP soil moisture only slightly further improved the accuracy of the streamflow simulation. On the other hand, the assimilation of merged SMAP/in-situ soil moisture for the au Saumon watershed improved the accuracy of streamflow forecast, yet the improvement was not that significant. Overall, this study demonstrated the potential of satellite passive microwave soil moisture for streamflow simulation and forecasting

Ground, Proximal, and Satellite Remote Sensing of Soil Moisture

Soil moisture (SM) is a key hydrologic state variable that is of significant importance for numerous Earth and environmental science applications that directly impact the global environment and human society. Potential applications include, but are not limited to, forecasting of weather and climate variability; prediction and monitoring of drought conditions; management and allocation of water resources; agricultural plant production and alleviation of famine; prevention of natural disasters such as wild fires, landslides, floods, and dust storms; or monitoring of ecosystem response to climate change. Because of the importance and wide‐ranging applicability of highly variable spatial and temporal SM information that links the water, energy, and carbon cycles, significant efforts and resources have been devoted in recent years to advance SM measurement and monitoring capabilities from the point to the global scales. This review encompasses recent advances and the state‐of‐the‐art of ground, proximal, and novel SM remote sensing techniques at various spatial and temporal scales and identifies critical future research needs and directions to further advance and optimize technology, analysis and retrieval methods, and the application of SM information to improve the understanding of critical zone moisture dynamics. Despite the impressive progress over the last decade, there are still many opportunities and needs to, for example, improve SM retrieval from remotely sensed optical, thermal, and microwave data and opportunities for novel applications of SM information for water resources management, sustainable environmental development, and food security