deSpeckNet: Generalizing Deep Learning Based SAR Image Despeckling

Deep learning (DL) has proven to be a suitable approach for despeckling synthetic aperture radar (SAR) images. So far, most DL models are trained to reduce speckle that follows a particular distribution, either using simulated noise or a specific set of real SAR images, limiting the applicability of these methods for real SAR images with unknown noise statistics. In this paper, we present a DL method, deSpeckNet1, that estimates the speckle noise distribution and the despeckled image simultaneously. Since it does not depend on a specific noise model, deSpeckNet generalizes well across SAR acquisitions in a variety of landcover conditions. We evaluated the performance of deSpeckNet on single polarized Sentinel-1 images acquired in Indonesia, The Democratic Republic of Congo and The Netherlands, a single polarized ALOS-2/PALSAR-2 image acquired in Japan and an Iceye X2 image acquired in Germany. In all cases, deSpeckNet was able to effectively reduce speckle and restor

Advanced machine learning algorithms for Canadian wetland mapping using polarimetric synthetic aperture radar (PolSAR) and optical imagery

Wetlands are complex land cover ecosystems that represent a wide range of biophysical conditions. They are one of the most productive ecosystems and provide several important environmental functionalities. As such, wetland mapping and monitoring using cost- and time-efficient approaches are of great interest for sustainable management and resource assessment. In this regard, satellite remote sensing data are greatly beneficial, as they capture a synoptic and multi-temporal view of landscapes. The ability to extract useful information from satellite imagery greatly affects the accuracy and reliability of the final products. This is of particular concern for mapping complex land cover ecosystems, such as wetlands, where complex, heterogeneous, and fragmented landscape results in similar backscatter/spectral signatures of land cover classes in satellite images. Accordingly, the overarching purpose of this thesis is to contribute to existing methodologies of wetland classification by proposing and developing several new techniques based on advanced remote sensing tools and optical and Synthetic Aperture Radar (SAR) imagery. Specifically, the importance of employing an efficient speckle reduction method for polarimetric SAR (PolSAR) image processing is discussed and a new speckle reduction technique is proposed. Two novel techniques are also introduced for improving the accuracy of wetland classification. In particular, a new hierarchical classification algorithm using multi-frequency SAR data is proposed that discriminates wetland classes in three steps depending on their complexity and similarity. The experimental results reveal that the proposed method is advantageous for mapping complex land cover ecosystems compared to single stream classification approaches, which have been extensively used in the literature. Furthermore, a new feature weighting approach is proposed based on the statistical and physical characteristics of PolSAR data to improve the discrimination capability of input features prior to incorporating them into the classification scheme. This study also demonstrates the transferability of existing classification algorithms, which have been developed based on RADARSAT-2 imagery, to compact polarimetry SAR data that will be collected by the upcoming RADARSAT Constellation Mission (RCM). The capability of several well-known deep Convolutional Neural Network (CNN) architectures currently employed in computer vision is first introduced in this thesis for classification of wetland complexes using multispectral remote sensing data. Finally, this research results in the first provincial-scale wetland inventory maps of Newfoundland and Labrador using the Google Earth Engine (GEE) cloud computing resources and open access Earth Observation (EO) collected by the Copernicus Sentinel missions. Overall, the methodologies proposed in this thesis address fundamental limitations/challenges of wetland mapping using remote sensing data, which have been ignored in the literature. These challenges include the backscattering/spectrally similar signature of wetland classes, insufficient classification accuracy of wetland classes, and limitations of wetland mapping on large scales. In addition to the capabilities of the proposed methods for mapping wetland complexes, the use of these developed techniques for classifying other complex land cover types beyond wetlands, such as sea ice and crop ecosystems, offers a potential avenue for further research

Permuted Spectral and Permuted Spectral-Spatial CNN Models for PolSAR- Multispectral Data based Land Cover Classification

International audienceIt is a challenge to develop methods which can process the PolSAR and multispectral (MS) data modalities together without losing information from either for remote sensing applications. This paper presents a study which attempts to introduce novel deep learning based remote sensing data processing frameworks that utilizes convolutional neural networks (CNNs) in both spatial and spectral domains to perform land cover (LC) classification with PolSAR-MS data. Also since earth observation remotely sensed data have usually larger spectral depth than normal camera image data, exploiting the spectral information in remote sensing (RS) data is crucial as well. In fact, convolutions in the sub-spectral space are intuitive and alternative to the process of feature selection. Recently, researchers have gained success in exploiting the spectral information of RS data, especially the hyperspectral data with CNNs. In this paper, exploitation of the spectral information in the PolSAR-MS data via a permuted localized spectral convolution along with localized spatial convolution is proposed. Further, the study in this paper also establishes the significance of performing permuted localized spectral convolutions over non-localized or localized spectral convolutions. Two models are proposed, namely a permuted local spectral convolutional network (Perm-LS-CNN) and a permuted local spectral-spatial convolutional network (Perm-LSS-CNN). These models are trained on ground truth class data points measured directly on the terrain. The evaluation of the generalization performance is done using ground truth knowledge on selected well known regions in the study areas. Comparison with other popular machine learning classifiers shows that the Perm-LSS-CNN model provides better classification results in terms of both accuracy and generalization

Study of the speckle noise effects over the eigen decomposition of polarimetric SAR data: a review

This paper is focused on considering the effects of speckle noise on the eigen decomposition of the co- herency matrix. Based on a perturbation analysis of the matrix, it is possible to obtain an analytical expression for the mean value of the eigenvalues and the eigenvectors, as well as for the Entropy, the Anisotroopy and the dif- ferent a angles. The analytical expressions are compared against simulated polarimetric SAR data, demonstrating the correctness of the different expressions.Peer ReviewedPostprint (published version

Polarimetric Synthetic Aperture Radar

This open access book focuses on the practical application of electromagnetic polarimetry principles in Earth remote sensing with an educational purpose. In the last decade, the operations from fully polarimetric synthetic aperture radar such as the Japanese ALOS/PalSAR, the Canadian Radarsat-2 and the German TerraSAR-X and their easy data access for scientific use have developed further the research and data applications at L,C and X band. As a consequence, the wider distribution of polarimetric data sets across the remote sensing community boosted activity and development in polarimetric SAR applications, also in view of future missions. Numerous experiments with real data from spaceborne platforms are shown, with the aim of giving an up-to-date and complete treatment of the unique benefits of fully polarimetric synthetic aperture radar data in five different domains: forest, agriculture, cryosphere, urban and oceans

Quantitative Estimation of Surface Soil Moisture in Agricultural Landscapes using Spaceborne Synthetic Aperture Radar Imaging at Different Frequencies and Polarizations

Soil moisture and its distribution in space and time plays an important role in the surface energy balance at the soil-atmosphere interface. It is a key variable influencing the partitioning of solar energy into latent and sensible heat flux as well as the partitioning of precipitation into runoff and percolation. Due to their large spatial variability, estimation of spatial patterns of soil moisture from field measurements is difficult and not feasible for large scale analyses. In the past decades, Synthetic Aperture Radar (SAR) remote sensing has proven its potential to quantitatively estimate near surface soil moisture at high spatial resolutions. Since the knowledge of the basic SAR concepts is important to understand the impact of different natural terrain features on the quantitative estimation of soil moisture and other surface parameters, the fundamental principles of synthetic aperture radar imaging are discussed. Also the two spaceborne SAR missions whose data was used in this study, the ENVISAT of the European Space Agency (ESA) and the ALOS of the Japanese Aerospace Exploration Agency (JAXA), are introduced. Subsequently, the two essential surface properties in the field of radar remote sensing, surface soil moisture and surface roughness are defined, and the established methods of their measurement are described. The in situ data used in this study, as well as the research area, the River Rur catchment, with the individual test sites where the data was collected between 2007 and 2010, are specified. On this basis, the important scattering theories in radar polarimetry are discussed and their application is demonstrated using novel polarimetric ALOS/PALSAR data. A critical review of different classical approaches to invert soil moisture from SAR imaging is provided. Five prevalent models have been chosen with the aim to provide an overview of the evolution of ideas and techniques in the field of soil moisture estimation from active microwave data. As the core of this work, a new semi-empirical model for the inversion of surface soil moisture from dual polarimetric L-band SAR data is introduced. This novel approach utilizes advanced polarimetric decomposition techniques to correct for the disturbing effects from surface roughness and vegetation on the soil moisture retrieval without the use of a priori knowledge. The land use specific algorithms for bare soil, grassland, sugar beet, and winter wheat allow quantitative estimations with accuracies in the order of 4 Vol.-%. Application of remotely sensed soil moisture patterns is demonstrated on the basis of mesoscale SAR data by investigating the variability of soil moisture patterns at different spatial scales ranging from field scale to catchment scale. The results show that the variability of surface soil moisture decreases with increasing wetness states at all scales. Finally, the conclusions from this dissertational research are summarized and future perspectives on how to extend the proposed model by means of improved ground based measurements and upcoming advances in sensor technology are discussed. The results obtained in this thesis lead to the conclusion that state-of-the-art spaceborne dual polarimetric L-band SAR systems are not only suitable to accurately retrieve surface soil moisture contents of bare as well as of vegetated agricultural fields and grassland, but for the first time also allow investigating within-field spatial heterogeneities from space

Wetland mapping and monitoring using polarimetric and interferometric synthetic aperture radar (SAR) data and tools

Wetlands are home to a great variety of flora and fauna species and provide several unique environmental functions, such as controlling floods, improving water-quality, supporting wildlife habitat, and shoreline stabilization. Detailed information on spatial distribution of wetland classes is crucial for sustainable management and resource assessment. Furthermore, hydrological monitoring of wetlands is also important for maintaining and preserving the habitat of various plant and animal species. This thesis investigates the existing knowledge and technological challenges associated with wetland mapping and monitoring and evaluates the limitations of the methodologies that have been developed to date. The study also proposes new methods to improve the characterization of these productive ecosystems using advanced remote sensing (RS) tools and data. Specifically, a comprehensive literature review on wetland monitoring using Synthetic Aperture Radar (SAR) and Interferometric SAR (InSAR) techniques is provided. The application of the InSAR technique for wetland mapping provides the following advantages: (i) the high sensitivity of interferometric coherence to land cover changes is taken into account and (ii) the exploitation of interferometric coherence for wetland classification further enhances the discrimination between similar wetland classes. A statistical analysis of the interferometric coherence and SAR backscattering variation of Canadian wetlands, which are ignored in the literature, is carried out using multi-temporal, multi-frequency, and multi-polarization SAR data. The study also examines the capability of compact polarimetry (CP) SAR data, which will be collected by the upcoming RADARSAT Constellation Mission (RCM) and will constitute the main source of SAR observation in Canada, for wetland mapping. The research in this dissertation proposes a methodology for wetland classification using the synergistic use of intensity, polarimetry, and interferometry features using a novel classification framework. Finally, this work introduces a novel model based on the deep convolutional neural network (CNN) for wetland classification that can be trained in an end-to-end scheme and is specifically designed for the classification of wetland complexes using polarimetric SAR (PolSAR) imagery. The results of the proposed methods are promising and will significantly contribute to the ongoing efforts of conservation strategies for wetlands and monitoring changes. The approaches presented in this thesis serve as frameworks, progressing towards an operational methodology for mapping wetland complexes in Canada, as well as other wetlands worldwide with similar ecological characteristics

Multidimensional and temporal SAR data representation and processing based on binary partition trees

This thesis deals with the processing of different types of multidimensional SAR data for distinct applications. Instead of handling the original pixels of the image, which correspond to very local information and are strongly contaminated by speckle noise, a region-based and multiscale data abstraction is defined, the Binary Partition Tree (BPT). In this representation, each region stands for an homogeneous area of the data, grouping pixels with similar properties and making easier its interpretation and processing. The work presented in this thesis concerns the definition of the BPT structures for Polarimetric SAR (PolSAR) images and also for temporal series of SAR acquisitions. It covers the description of the corresponding data models and the algorithms for BPT construction and its exploitation. Particular attention has been paid to the speckle filtering application. The proposed technique has proven to achieve arbitrarily large regions over homogeneous areas while also preserving the spatial resolution and the small details of the original data. As a consequence, this approach has demonstrated an improvement in the performance of the target response estimation with respect to other speckle filtering techniques. Moreover, due to the flexibility and convenience of this representation, it has been employed for other applications as scene segmentation and classification. The processing of SAR time series has also been addressed, proposing different approaches for dealing with the temporal information of the data, resulting into distinct BPT abstractions. These representations have allowed the development of speckle filtering techniques in the spatial and temporal domains and also the improvement and the definition of additional methods for classification and temporal change detection and characterization

Polarimetric Synthetic Aperture Radar, Principles and Application

Demonstrates the benefits of the usage of fully polarimetric synthetic aperture radar data in applications of Earth remote sensing, with educational and development purposes. Includes numerous up-to-date examples with real data from spaceborne platforms and possibility to use a software to support lecture practicals. Reviews theoretical principles in an intuitive way for each application topic. Covers in depth five application domains (forests, agriculture, cryosphere, urban, and oceans), with reference also to hazard monitorin