SUPER-RESOLUTION IMAGING OF REMOTE SENSED BRIGHTNESS TEMPERATURE USING A CONVOLUTIONAL NEURAL NETWORK

Steady improvements to the instruments used in remote sensing has led to much higher resolution data, often contemporaneous with lower resolution instruments that continue to collect data. There is a clear opportunity to reconcile recent high resolution satellite data with the lower resolution data of the past. Super-resolution (SR) imaging is a technique that increases the spatial resolution of image data by training statistical methods on simultaneously occurring lower and higher resolution data sets. The special sensor microwave/imager (SSMI) and advanced microwave scanning radiometer (AMSR2) brightness temperature data products are well suited to super-resolution imaging, and SR can be used to standardize the higher resolution across the entire record of observations. Of the methods used in super-resolution imaging, neural networks have led to major improvements in the realm of computer vision and have seen great success in the super-resolution of photographic images. We trained two neural networks, based on the design of the Resnet, to super-resolution the 25 kilometer resolution SSMI and AMSR2 brightness temperature data products up to a 10 kilometer resolution. The mean error over all frequencies and polarizations for the AMSR and SSMI models’ predictions is 0.84% and 2.4% respectively for the years 2013 and 2019

Analyzing Machine Learning Predictions of Passive Microwave Brightness Temperature Spectral Difference Over Snow-Covered Terrain in High Mountain Asia

Snow is an important component of the terrestrial freshwater budget in high mountainAsia (HMA) and contributes to the runoff in Himalayan rivers through snowmelt. Despitethe importance of snow in HMA, considerable spatiotemporal uncertainty exists across the different estimates of snow water equivalent for this region. In order to better estimate snow water equivalent, radiative transfer models are often used in conjunction with microwave brightness temperature measurements. In this study, the efficacy of support vector machines (SVMs), a machine learning technique, to predict passive microwave brightness temperature spectral difference (1Tb) as a function of geophysical variables (snow water equivalent, snow depth, snow temperature, and snow density) is explored through a sensitivity analysis. The use of machine learning (as opposed to radiative transfer models) is a relatively new and novel approach for improving snow water equivalent estimates. The Noah-MP land surface model within the NASALand Information System framework is used to simulate the hydrologic cycle over HMA and model geophysical variables that are then used for SVM training. The SVMsserve as a nonlinear map between the geophysical space (modeled in Noah-MP) andthe observation space (1Tb as measured by the radiometer). Advanced MicrowaveScanning Radiometer-Earth Observing System measured passive microwave brightness temperatures over snow-covered locations in the HMA region are used as training data during the SVM training phase. Sensitivity of well-trained SVMs to each Noah-MP modeled state variable is assessed by computing normalized sensitivity coefficients. Sensitivity analysis results generally conform with the known first-order physics. Input states that increase volume scattering of microwave radiation, such as snow density and snow water equivalent, exhibit a plurality of positive normalized sensitivity coefficients. In general, snow temperature was the most sensitive input to the SVM predictions. The sensitivity of each state is location and time dependent. The signs of normalized sensitivity coefficients that indicate physical irrationality are ascribed to significant cross-correlation between Noah-MP simulated states and decreased SVM prediction capability at specific locations due to insufficient training data. SVM prediction pitfalls do exist that serve to highlight the limitations of this particular machine learning algorithm

SENSITIVITY ANALYSIS OF SUPPORT VECTOR MACHINE PREDICTIONS OF PASSIVE MICROWAVE BRIGHTNESS TEMPERATURES OVER SNOW-COVERED TERRAIN IN HIGH MOUNTAIN ASIA

Spatial and temporal variation of snow in High Mountain Asia is very critical as it determines contribution of snowmelt to the freshwater supply of over 136 million people. Support vector machine (SVM) prediction of passive microwave brightness temperature spectral difference (ΔTb) as a function of NASA Land Information System (LIS) modeled geophysical states is investigated through a sensitivity analysis. AMSRE ΔTb measurements over snow-covered areas in the Indus basin are used for training the SVMs. Sensitivity analysis results conform with the known first-order physics. LIS input states that are directly linked to physical temperature demonstrate relatively higher sensitivity. Accuracy of LIS modeled states is further assessed through a comparative analysis between LIS derived and Advanced Scatterometer based Freeze/Melt/Thaw categorical datasets. Highest agreement of 22%, between the two datasets, is observed for freeze state. Analyses results provide insight into LIS’s land surface modeling ability over the Indus Basin

Snow Phenology and Hydrologic Timing in the Yukon River Basin, AK, USA

The Yukon River basin encompasses over 832,000 km2 of boreal Arctic Alaska and northwest Canada, providing a major transportation corridor and multiple natural resources to regional communities. The river seasonal hydrology is defined by a long winter frozen season and a snowmelt-driven spring flood pulse. Capabilities for accurate monitoring and forecasting of the annual spring freshet and river ice breakup (RIB) in the Yukon and other northern rivers is limited, but critical for understanding hydrologic processes related to snow, and for assessing flood-related risks to regional communities. We developed a regional snow phenology record using satellite passive microwave remote sensing to elucidate interactions between the timing of upland snowmelt and the downstream spring flood pulse and RIB in the Yukon. The seasonal snow metrics included annual Main Melt Onset Date (MMOD), Snowoff (SO) and Snowmelt Duration (SMD) derived from multifrequency (18.7 and 36.5 GHz) daily brightness temperatures and a physically-based Gradient Ratio Polarization (GRP) retrieval algorithm. The resulting snow phenology record extends over a 29-year period (1988–2016) with 6.25 km grid resolution. The MMOD retrievals showed good agreement with similar snow metrics derived from in situ weather station measurements of snowpack water equivalence (r = 0.48, bias = −3.63 days) and surface air temperatures (r = 0.69, bias = 1 day). The MMOD and SO impact on the spring freshet was investigated by comparing areal quantiles of the remotely sensed snow metrics with measured streamflow quantiles over selected sub-basins. The SO 50% quantile showed the strongest (p \u3c 0.1) correspondence with the measured spring flood pulse at Stevens Village (r = 0.71) and Pilot (r = 0.63) river gaging stations, representing two major Yukon sub-basins. MMOD quantiles indicating 20% and 50% of a catchment under active snowmelt corresponded favorably with downstream RIB (r = 0.61) from 19 river observation stations spanning a range of Yukon sub-basins; these results also revealed a 14–27 day lag between MMOD and subsequent RIB. Together, the satellite based MMOD and SO metrics show potential value for regional monitoring and forecasting of the spring flood pulse and RIB timing in the Yukon and other boreal Arctic basins

Global evaluation of SMAP/Sentinel-1 soil moisture products

MAP/Sentinel-1 soil moisture is the latest SMAP (Soil Moisture Active Passive) product derived from synergistic utilization of the radiometry observations of SMAP and radar backscattering data of Sentinel-1. This product is the first and only global soil moisture (SM) map at 1 km and 3 km spatial resolutions. In this paper, we evaluated the SMAP/Sentinel-1 SM product from different viewpoints to better understand its quality, advantages, and likely limitations. A comparative analysis of this product and in situ measurements, for the time period March 2015 to January 2022, from 35 dense and sparse SM networks and 561 stations distributed around the world was carried out. We examined the effects of land cover, vegetation fraction, water bodies, urban areas, soil characteristics, and seasonal climatic conditions on the performance of active–passive SMAP/Sentinel-1 in estimating the SM. We also compared the performance metrics of enhanced SMAP (9 km) and SMAP/Sentinel-1 products (3 km) to analyze the effects of the active–passive disaggregation algorithm on various features of the SMAP SM maps. Results showed satisfactory agreement between SMAP/Sentinel-1 and in situ SM measurements for most sites (r values between 0.19 and 0.95 and ub-RMSE between 0.03 and 0.17), especially for dense sites without representativeness errors. Thanks to the vegetation effect correction applied in the active–passive algorithm, the SMAP/Sentinel-1 product had the highest correlation with the reference data in grasslands and croplands. Results also showed that the accuracy of the SMAP/Sentinel-1 SM product in different networks is independent of the presence of water bodies, urban areas, and soil types.Peer ReviewedPostprint (published version

A Blended Sea Ice Concentration Product from AMSR2 and VIIRS

An effective blended Sea-Ice Concentration (SIC) product has been developed that utilizes ice concentrations from passive microwave and visible/infrared satellite instruments, specifically the Advanced Microwave Scanning Radiometer-2 (AMSR2) and the Visible Infrared Imaging Radiometer Suite (VIIRS). The blending takes advantage of the all-sky capability of the AMSR2 sensor and the high spatial resolution of VIIRS, though it utilizes only the clear sky characteristics of VIIRS. After both VIIRS and AMSR2 images are remapped to a 1 km EASE-Grid version 2, a Best Linear Unbiased Estimator (BLUE) method is used to combine the AMSR2 and VIIRS SIC for a blended product at 1 km resolution under clear-sky conditions. Under cloudy-sky conditions the AMSR2 SIC with bias correction is used. For validation, high spatial resolution Landsat data are collocated with VIIRS and AMSR2 from 1 February 2017 to 31 October 2019. Bias, standard deviation, and root mean squared errors are calculated for the SICs of VIIRS, AMSR2, and the blended field. The blended SIC outperforms the individual VIIRS and AMSR2 SICs. The higher spatial resolution VIIRS data provide beneficial information to improve upon AMSR2 SIC under clear-sky conditions, especially during the summer melt season, as the AMSR2 SIC has a consistent negative bias near and above the melting point.</div

Long-term and high-resolution global time series of brightness temperature from copula-based fusion of SMAP enhanced and SMOS data

Long and consistent soil moisture time series at adequate spatial resolution are key to foster the application of soil moisture observations and remotely-sensed products in climate and numerical weather prediction models. The two L-band soil moisture satellite missions SMAP (Soil Moisture Active Passive) and SMOS (Soil Moisture and Ocean Salinity) are able to provide soil moisture estimates on global scales and in kilometer accuracy. However, the SMOS data record has an appropriate length of 7.5 years since late 2009, but with a coarse resolution of 25km only. In contrast, a spatially-enhanced SMAP product is available at a higher resolution of 9 km, but for a shorter time period (since March 2015 only). Being the fundamental observable from passive microwave sensors, reliable brightness temperatures (Tbs) are a mandatory precondition for satellite-based soil moisture products. We therefore develop, evaluate and apply a copula-based data fusion approach for combining SMAP Enhanced (SMAP_E) and SMOS brightness Temperature (Tb) data. The approach exploits both linear and non-linear dependencies between the two satellite-based Tb products and allows one to generate conditional SMAP_E-like random samples during the pre-SMAP period. Our resulting global Copula-combined SMOS-SMAP_E (CoSMOP) Tbs are statistically consistent with SMAP_E brightness temperatures, have a spatial resolution of 9km and cover the period from 2010 to 2018. A comparison with Service Soil Climate Analysis Network (SCAN)-sites over the Contiguous United States (CONUS) domain shows that the approach successfully reduces the average RMSE of the original SMOS data by 15%. At certain locations, improvements of 40% and more can be observed. Moreover, the median NSE can be enhanced from zero to almost 0.5. Hence, CoSMOP, which will be made freely available to the public, provides a first step towards a global, long-term, high-resolution and multi-sensor brightness temperature product, and thereby, also soil moisture

Passive Microwave Remote Sensing of Snow Layers Using Novel Wideband Radiometer Systems and RFI Mitigation

Climate change can reduce the availability of water resources in many regions, and it will affect agriculture, industry, and energy supply. Snowpack monitoring is important in water resource management as well as flood and avalanche protection. The rapid melting process due to global warming changes the snowpacks' annual statistics, including the extent, and the snow water equivalent (SWE) of seasonal snowpacks, which results in non-stationary annual statistics that should be monitored in nearly daily intervals. The development of advanced radiometric sensors capable of accurately measuring the snowpack thickness and SWE is needed for the long-term study of the snowpack parameters' statistical changes. Passive microwave radiometry provides a means for measuring the microwave emission from a scene of snow and ice. A Wideband Autocorrelation Radiometer (ac{WiBAR}) operating from 1-2~GHz measures spontaneous emission from snowpack at long wavelengths where the scattering is minimized, but the snow layer coherent effects are preserved. By using a wide bandwidth to measure the spacing between frequencies of constructive and destructive interference of the emission from the soil under the snow, it can reveal the microwave travel time through the snow, and thus the snow depth. However, narrowband radio frequency interference (RFI) in the WiBAR's frequency of operations reduces the ability of the WiBAR to measure the thickness accurately. In addition, the current WiBAR system is a frequency domain, FD-WiBAR, system that uses a field-portable spectrum analyzer to collect the data and suffers from high data acquisition time which limits its applications for spaceborne and airborne technologies. In this work, a novel frequency tunable microwave comb filter is proposed for RFI mitigation. The frequency response of the proposed filter has a pattern with many frequencies band-pass and band rejection that preserves the frequency span while reducing the RFI. Moreover, we demonstrate time-domain WiBAR, TD-WiBAR, which presented as an alternative method for FD-WiBAR, and is capable of providing faster data acquisition. A new time-domain calibration is also developed for TD-WiBAR and evaluated with the frequency domain calibration. To validate the TD-WiBAR method, simulated laboratory measurements are performed using a microwave scene simulator circuit. Then the WiBAR instrument is enhanced with the proposed comb filter and showed the RFI mitigation in time-domain mode on an instrument bench test. Furthermore, we analyze the effects of an above snow vegetation layer on brightness temperature spectra, particularly the possible decay of wave coherence arising from volume scattering in the vegetation canopy. In our analysis, the snow layer is assumed to be flat, and its upward emission and surface reflectivities are modeled by a fully coherent model, while an incoherent radiative transfer model describes the volume scattering from the vegetation layer. We proposed a unified framework of vegetation scattering using radiative transfer (RT) theory for passive and active remote sensing of vegetated land surfaces, especially those associated with moderate-to-large vegetation water contents (VWCs), e.g., forest field. The framework allows for modeling passive and active microwave signatures of the vegetated field with the same physical parameters describing the vegetation structure. The proposed model is validated with the passive and active L-band sensor (PALS) acquired in SMAPVEX12 measurements in 2012, demonstrating the applicability of this model.PHDElectrical and Computer EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/169653/1/maryamsa_1.pd