Deep learning in remote sensing: a review

Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin

Remote Sensing of Snow Cover Using Spaceborne SAR: A Review

The importance of snow cover extent (SCE) has been proven to strongly link with various natural phenomenon and human activities; consequently, monitoring snow cover is one the most critical topics in studying and understanding the cryosphere. As snow cover can vary significantly within short time spans and often extends over vast areas, spaceborne remote sensing constitutes an efficient observation technique to track it continuously. However, as optical imagery is limited by cloud cover and polar darkness, synthetic aperture radar (SAR) attracted more attention for its ability to sense day-and-night under any cloud and weather condition. In addition to widely applied backscattering-based method, thanks to the advancements of spaceborne SAR sensors and image processing techniques, many new approaches based on interferometric SAR (InSAR) and polarimetric SAR (PolSAR) have been developed since the launch of ERS-1 in 1991 to monitor snow cover under both dry and wet snow conditions. Critical auxiliary data including DEM, land cover information, and local meteorological data have also been explored to aid the snow cover analysis. This review presents an overview of existing studies and discusses the advantages, constraints, and trajectories of the current developments

Monitoring Snow Cover and Snowmelt Dynamics and Assessing their Influences on Inland Water Resources

Snow is one of the most vital cryospheric components owing to its wide coverage as well as its unique physical characteristics. It not only affects the balance of numerous natural systems but also influences various socio-economic activities of human beings. Notably, the importance of snowmelt water to global water resources is outstanding, as millions of populations rely on snowmelt water for daily consumption and agricultural use. Nevertheless, due to the unprecedented temperature rise resulting from the deterioration of climate change, global snow cover extent (SCE) has been shrinking significantly, which endangers the sustainability and availability of inland water resources. Therefore, in order to understand cryo-hydrosphere interactions under a warming climate, (1) monitoring SCE dynamics and snowmelt conditions, (2) tracking the dynamics of snowmelt-influenced waterbodies, and (3) assessing the causal effect of snowmelt conditions on inland water resources are indispensable. However, for each point, there exist many research questions that need to be answered. Consequently, in this thesis, five objectives are proposed accordingly. Objective 1: Reviewing the characteristics of SAR and its interactions with snow, and exploring the trends, difficulties, and opportunities of existing SAR-based SCE mapping studies; Objective 2: Proposing a novel total and wet SCE mapping strategy based on freely accessible SAR imagery with all land cover classes applicability and global transferability; Objective 3: Enhancing total SCE mapping accuracy by fusing SAR- and multi-spectral sensor-based information, and providing total SCE mapping reliability map information; Objective 4: Proposing a cloud-free and illumination-independent inland waterbody dynamics tracking strategy using freely accessible datasets and services; Objective 5: Assessing the influence of snowmelt conditions on inland water resources

Cryosphere Applications

Synthetic aperture radar (SAR) provides large coverage and high resolution, and it has been proven to be sensitive to both surface and near-surface features related to accumulation, ablation, and metamorphism of snow and firn. Exploiting this sensitivity, SAR polarimetry and polarimetric interferometry found application to land ice for instance for the estimation of wave extinction (which relates to sub surface ice volume structure) and for the estimation of snow water equivalent (which relates to snow density and depth). After presenting these applications, the Chapter proceeds by reviewing applications of SAR polarimetry to sea ice for the classification of different ice types, the estimation of thickness, and the characterisation of its surface. Finally, an application to the characterisation of permafrost regions is considered. For each application, the used (model-based) decomposition and polarimetric parameters are critically described, and real data results from relevant airborne campaigns and space borne acquisitions are reported

Comparative analysis of SAOCOM and Sentinel-1 data for surface soil moisture retrieval using a change detection method in a semiarid region (Douro River's basin, Spain)

The growing interest in low-frequency SAR for soil parameter retrieval has led to the development of new active L-band satellites, that will provide novel surface soil moisture products and retrieval possibilities; however, due to data unavailability so far, limited applications have investigated the use of change detection models using L-band satellite SAR data. Since July 2020, high revisit time, high-resolution acquisitions by the Satelite Argentino de Observacion COn Microondas (SAOCOM) Argentinian-Italian constellation have become accessible over Europe. Therefore, this research presents an investigation of the potential of multi-temporal L-band SAOCOM-1 for monitoring soil moisture variations underneath low and sparse agricultural vegetation. Moreover, it proposes a procedure for the mitigation of roughness contribution, by exploiting the entropy parameter derived from the dual-polarimetric decomposition. L-band sensitivity to soil moisture has been jointly evaluated in respect of Sentinel-1 C-band data by (1) comparing the temporal profiles of the backscattering coefficient, gamma(0), at VV and VH polarization, with the support of decomposition parameters (entropy and alpha), NDVI and precipitation data; (2) regression analysis with in situ soil moisture measurements, obtained by the REMEDHUS network in the Douro River basin (Spain); 3) evaluating the soil moisture retrievals obtained at C- and L- band using a change detection method. Finally, the effectiveness of the roughness normalization procedure for SAOCOM data has been validated using in situ data. L-band co-polarized gamma(0) has proved to be the best configuration for soil moisture inversion, being relatively insensitive to vegetation, as demonstrated by decomposition results and trend interpretation. Overall, regressions detected an R-2 22% higher at L-band than C-band, with values up to 0.74 for VV ((R) over bar (2)=0.32) and up to 0.47 for the VH band ((R) over bar (2)=0.14). Co-polarized data obtained R-2 on average 62.1% and 74.7% higher for SAOCOM and Sentinel-1. The retrieval models show an ubRMSD of 7.1% for SAOCOM data and 8.3% for Sentinel-1. The application of the proposed roughness normalization procedure to SAOCOM led to an ubRMSD of 6.7% improving the retrieved soil moisture trend by 7.9%. This exploratory analysis demonstrated SAOCOM data potential for soil moisture mapping and would serve as a foundation for more advanced retrieval procedures

Spaceborne L-Band Synthetic Aperture Radar Data for Geoscientific Analyses in Coastal Land Applications: A Review

The coastal zone offers among the world’s most productive and valuable ecosystems and is experiencing increasing pressure from anthropogenic impacts: human settlements, agriculture, aquaculture, trade, industrial activities, oil and gas exploitation and tourism. Earth observation has great capability to deliver valuable data at the local, regional and global scales and can support the assessment and monitoring of land‐ and water‐related applications in coastal zones. Compared to optical satellites, cloud‐cover does not limit the timeliness of data acquisition with spaceborne Synthetic Aperture Radar (SAR) sensors, which have all‐weather, day and night capabilities. Hence, active radar systems demonstrate great potential for continuous mapping and monitoring of coastal regions, particularly in cloud‐prone tropical and sub‐tropical climates. The canopy penetration capability with long radar wavelength enables L‐band SAR data to be used for coastal terrestrial environments and has been widely applied and investigated for the following geoscientific topics: mapping and monitoring of flooded vegetation and inundated areas; the retrieval of aboveground biomass; and the estimation of soil moisture. Human activities, global population growth, urban sprawl and climate change‐induced impacts are leading to increased pressure on coastal ecosystems causing land degradation, deforestation and land use change. This review presents a comprehensive overview of existing research articles that apply spaceborne L‐band SAR data for geoscientific analyses that are relevant for coastal land applications

Estimation of change in forest variables using synthetic aperture radar

Large scale mapping of changes in forest variables is needed for both environmental monitoring, planning of climate actions and sustainable forest management. Remote sensing can be used in conjunction with field data to produce wall-to-wall estimates that are practically impossible to produce using traditional field surveys. Synthetic aperture radar (SAR) can observe the forest independent of sunlight, clouds, snow, or rain, providing reliable high frequency coverage. Its wavelength determines the interaction with the forest, where longer wavelengths interact with larger structures of the trees, and shorter wavelengths interact mainly with the top part of the canopy, meaning that it can be chosen to fit specific applications. This thesis contains five studies conducted on the Remningstorp test site in southern Sweden. Studies I – III predicted above ground biomass (AGB) change using long wavelength polarimetric P- (in I) and L-band (in I – III) SAR data. The differences between the bands were small in terms of prediction quality, and the HV polarization, just as for AGB state prediction, was the polarization channel most correlated with AGB change. A moisture correction for L-band data was proposed and evaluated, and it was found that certain polarimetric measures were better for predicting AGB change than all of the polarization channels together. Study IV assessed the detectability of silvicultural treatments in short wavelength TanDEM-X interferometric phase heights. In line with earlier studies, only clear cuts were unambiguously distinguishable. Study V predicted site index and stand age by fitting height development curves to time series of TanDEM-X data. Site index and age were unbiasedly predicted for untreated plots, and the RMSE would likely decrease with longer time series. When stand age was known, SI was predicted with an RMSE comparable to that of the field based measurements. In conclusion, this thesis underscores SAR data's potential for generalizable methods for estimation of forest variable changes

Understanding of crop lodging induced changes in scattering mechanisms using RADERSAT-2 and Sentinel-1 derived metrics

Abstract. Crop lodging – the bending of crop stems from the vertical – is a major yield-reducing factor in cereal crops and causes deterioration in grain quality. Accurate assessment of crop lodging is important for improving estimates of crop yield losses, informing insurance loss adjusters and influencing management decisions for subsequent seasons. The role of remote sensing data, particularly synthetic aperture radar (SAR) data has been emphasized in the recent literature for crop lodging assessment. However, the effect of lodging on SAR scattering mechanisms is still unknown. Therefore, this research aims to understand the possible change in scattering mechanisms due to lodging by investigating SAR image pairs before and after lodging. We conducted the study in 26 wheat fields in the Bonifiche Ferraresi farm, located in Jolanda di Savoia, Ferrara, Italy. We measured temporal crop biophysical (e.g. crop angle) parameters and acquired multi-incidence angle RADARSAT-2 (R-2 FQ8-27° and R-2 FQ21-41°) and Sentinel-1 (S-1 40°) images corresponding to the time of field observations. We extracted metrics of SAR scattering mechanisms from RADARSAT-2 and Sentinel-1 image pairs in different zones using the unsupervised H/α decomposition algorithm and Wishart classifier. Contrasting results were obtained at different incidence angles. Bragg surface scattering increased in the case of S-1 (6.8%), R-2 FQ8 (1.8%) while at R-2 FQ21, it decreased (8%) after lodging. The change in double bounce scattering was more prominent at low incidence angle. These observations can guide future use of SAR-based information for operational crop lodging assessment in particular, and sustainable agriculture in general

A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

In recent years, deep learning (DL), a re-branding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, natural language processing, etc. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV; e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should be aware of, if not at the leading edge of, of advancements like DL. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as it relates to (i) inadequate data sets, (ii) human-understandable solutions for modelling physical phenomena, (iii) Big Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote Sensin