Accurate Despeckling and Estimation of Polarimetric Features by Means of a Spatial Decorrelation of the Noise in Complex PolSAR Data

In this work, we extended a procedure for the spatial decorrelation of fully-developed speckle, originally developed for single-polarization SAR data, to fully-polarimetric SAR data. The spatial correlation of the noise depends on the tapering window in the Fourier domain used by the SAR processor to avoid defocusing of targets caused by Gibbs effects. Since each polarimetric channel is focused independently of the others, the noise-whitening procedure can be performed applying the decorrelation stage to each channel separately. Equivalently, the noise-whitening stage is applied to each element of the scattering matrix before any multilooking operation, either coherent or not, is performed. In order to evaluate the impact of a spatial decorrelation of the noise on the performance of polarimetric despeckling filters, we make use of simulated PolSAR data, having user-defined polarimetric features. We optionally introduce a spatial correlation of the noise in the simulated complex data by means of a 2D separable Hamming window in the Fourier domain. Then, we remove such a correlation by using the whitening procedure and compare the accuracy of both despeckling and polarimetric features estimation for the three following cases: uncorrelated, correlated, and decorrelated images. Simulation results showed a steady improvement of performance scores, most notably the equivalent number of looks (ENL), which increased after decorrelation and closely attained the value of the uncorrelated case. Besides ENL, the benefits of the noise decorrelation hold also for polarimetric features, whose estimation accuracy is diminished by the correlation. Also, the trends of simulations were confirmed by qualitative results of experiments carried out on a true Radarsat-2 image

Image Restoration for Remote Sensing: Overview and Toolbox

Remote sensing provides valuable information about objects or areas from a distance in either active (e.g., RADAR and LiDAR) or passive (e.g., multispectral and hyperspectral) modes. The quality of data acquired by remotely sensed imaging sensors (both active and passive) is often degraded by a variety of noise types and artifacts. Image restoration, which is a vibrant field of research in the remote sensing community, is the task of recovering the true unknown image from the degraded observed image. Each imaging sensor induces unique noise types and artifacts into the observed image. This fact has led to the expansion of restoration techniques in different paths according to each sensor type. This review paper brings together the advances of image restoration techniques with particular focuses on synthetic aperture radar and hyperspectral images as the most active sub-fields of image restoration in the remote sensing community. We, therefore, provide a comprehensive, discipline-specific starting point for researchers at different levels (i.e., students, researchers, and senior researchers) willing to investigate the vibrant topic of data restoration by supplying sufficient detail and references. Additionally, this review paper accompanies a toolbox to provide a platform to encourage interested students and researchers in the field to further explore the restoration techniques and fast-forward the community. The toolboxes are provided in https://github.com/ImageRestorationToolbox.Comment: This paper is under review in GRS

deSpeckNet: Generalizing Deep Learning Based SAR Image Despeckling

Deep learning (DL) has proven to be a suitable approach for despeckling synthetic aperture radar (SAR) images. So far, most DL models are trained to reduce speckle that follows a particular distribution, either using simulated noise or a specific set of real SAR images, limiting the applicability of these methods for real SAR images with unknown noise statistics. In this paper, we present a DL method, deSpeckNet1, that estimates the speckle noise distribution and the despeckled image simultaneously. Since it does not depend on a specific noise model, deSpeckNet generalizes well across SAR acquisitions in a variety of landcover conditions. We evaluated the performance of deSpeckNet on single polarized Sentinel-1 images acquired in Indonesia, The Democratic Republic of Congo and The Netherlands, a single polarized ALOS-2/PALSAR-2 image acquired in Japan and an Iceye X2 image acquired in Germany. In all cases, deSpeckNet was able to effectively reduce speckle and restor

Extraction d'informations de changement à partir des séries temporelles d'images radar à synthèse d'ouverture

A large number of successfully launched and operated Synthetic Aperture Radar (SAR) satellites has regularly provided multitemporal SAR and polarimetric SAR (PolSAR) images with high and very high spatial resolution over immense areas of the Earth surface. SAR system is appropriate for monitoring tasks thanks to the advantage of operating in all-time and all-weather conditions. With multitemporal data, both spatial and temporal information can simultaneously be exploited to improve the results of researche works. Change detection of specific features within a certain time interval has to deal with a complex processing of SAR data and the so-called speckle which affects the backscattered signal as multiplicative noise.The aim of this thesis is to provide a methodology for simplifying the analysis of multitemporal SAR data. Such methodology can benefit from the advantages of repetitive SAR acquisitions and be able to process different kinds of SAR data (i.e. single, multipolarization SAR, etc.) for various applications. In this thesis, we first propose a general framework based on a spatio-temporal information matrix called emph{Change Detection Matrix} (CDM). This matrix contains temporal neighborhoods which are adaptive to changed and unchanged areas thanks to similarity cross tests. Then, the proposed method is used to perform three different tasks:1) multitemporal change detection with different kinds of changes, which allows the combination of multitemporal pair-wise change maps to improve the performance of change detection result;2) analysis of change dynamics in the observed area, which allows the investigation of temporal evolution of objects of interest;3) nonlocal temporal mean filtering of SAR/PolSAR image time series, which allows us to avoid smoothing change information in the time series during the filtering process.In order to illustrate the relevancy of the proposed method, the experimental works of the thesis is performed on four datasets over two test-sites: Chamonix Mont-Blanc, France and Merapi volcano, Indonesia, with different types of changes (i.e., seasonal evolution, glaciers, volcanic eruption, etc.). Observations of these test-sites are performed on four SAR images time series from single polarization to full polarization, from medium to high, very high spatial resolution: Sentinel-1, ALOS-PALSAR, RADARSAT-2 and TerraSAR-X time series.La réussite du lancement d'un grand nombre des satellites Radar à Synthèse d'Ouverture (RSO - SAR) de nouvelle génération a fourni régulièrement des images SAR et SAR polarimétrique (PolSAR) multitemporelles à haute et très haute résolution spatiale sur de larges régions de la surface de la Terre. Le système SAR est approprié pour des tâches de surveillance continue ou il offre l'avantage d'être indépendant de l'éclairement solaire et de la couverture nuageuse. Avec des données multitemporelles, l'information spatiale et temporelle peut être exploitée simultanément pour rendre plus concise, l'extraction d'information à partir des données. La détection de changement de structures spécifiques dans un certain intervalle de temps nécessite un traitement complexe des données SAR et la présence du chatoiement (speckle) qui affecte la rétrodiffusion comme un bruit multiplicatif. Le but de cette thèse est de fournir une méthodologie pour simplifier l'analyse des données multitemporelles SAR. Cette méthodologie doit bénéficier des avantages d'acquisitions SAR répétitives et être capable de traiter différents types de données SAR (images SAR mono-, multi- composantes, etc.) pour diverses applications. Au cours de cette thèse, nous proposons tout d'abord une méthode générale basée sur une matrice d'information spatio-temporelle appelée Matrice de détection de changement (CDM). Cette matrice contient des informations de changements obtenus à partir de tests croisés de similarité sur des voisinages adaptatifs. La méthode proposée est ensuite exploitée pour réaliser trois tâches différentes: 1) la détection de changement multitemporel avec différents types de changements, ce qui permet la combinaison des cartes de changement entre des paires d'images pour améliorer la performance de résultat de détection de changement; 2) l'analyse de la dynamicité de changement de la zone observée, ce qui permet l'étude de l'évolution temporelle des objets d'intérêt; 3) le filtrage nonlocal temporel des séries temporelles d'images SAR/PolSAR, ce qui permet d'éviter le lissage des informations de changement dans des séries pendant le processus de filtrage.Afin d'illustrer la pertinence de la méthode proposée, la partie expérimentale de la thèse est effectuée sur deux sites d'étude: Chamonix Mont-Blanc, France et le volcan Merapi, Indonésie, avec différents types de changements (i.e. évolution saisonnière, glaciers, éruption volcanique, etc.). Les observations de ces sites d'étude sont acquises sur quatre séries temporelles d'images SAR monocomposantes et multicomposantes de moyenne à haute et très haute résolution: des séries temporelles d'images Sentinel-1, ALOS-PALSAR, RADARSAT-2 et TerraSAR-X

Deep Learning based data-fusion methods for remote sensing applications

In the last years, an increasing number of remote sensing sensors have been launched to orbit around the Earth, with a continuously growing production of massive data, that are useful for a large number of monitoring applications, especially for the monitoring task. Despite modern optical sensors provide rich spectral information about Earth's surface, at very high resolution, they are weather-sensitive. On the other hand, SAR images are always available also in presence of clouds and are almost weather-insensitive, as well as daynight available, but they do not provide a rich spectral information and are severely affected by speckle "noise" that make difficult the information extraction. For the above reasons it is worth and challenging to fuse data provided by different sources and/or acquired at different times, in order to leverage on their diversity and complementarity to retrieve the target information. Motivated by the success of the employment of Deep Learning methods in many image processing tasks, in this thesis it has been faced different typical remote sensing data-fusion problems by means of suitably designed Convolutional Neural Networks

Synthetic Aperture Radar (SAR) Meets Deep Learning

This reprint focuses on the application of the combination of synthetic aperture radars and depth learning technology. It aims to further promote the development of SAR image intelligent interpretation technology. A synthetic aperture radar (SAR) is an important active microwave imaging sensor, whose all-day and all-weather working capacity give it an important place in the remote sensing community. Since the United States launched the first SAR satellite, SAR has received much attention in the remote sensing community, e.g., in geological exploration, topographic mapping, disaster forecast, and traffic monitoring. It is valuable and meaningful, therefore, to study SAR-based remote sensing applications. In recent years, deep learning represented by convolution neural networks has promoted significant progress in the computer vision community, e.g., in face recognition, the driverless field and Internet of things (IoT). Deep learning can enable computational models with multiple processing layers to learn data representations with multiple-level abstractions. This can greatly improve the performance of various applications. This reprint provides a platform for researchers to handle the above significant challenges and present their innovative and cutting-edge research results when applying deep learning to SAR in various manuscript types, e.g., articles, letters, reviews and technical reports

Advanced machine learning algorithms for Canadian wetland mapping using polarimetric synthetic aperture radar (PolSAR) and optical imagery

Wetlands are complex land cover ecosystems that represent a wide range of biophysical conditions. They are one of the most productive ecosystems and provide several important environmental functionalities. As such, wetland mapping and monitoring using cost- and time-efficient approaches are of great interest for sustainable management and resource assessment. In this regard, satellite remote sensing data are greatly beneficial, as they capture a synoptic and multi-temporal view of landscapes. The ability to extract useful information from satellite imagery greatly affects the accuracy and reliability of the final products. This is of particular concern for mapping complex land cover ecosystems, such as wetlands, where complex, heterogeneous, and fragmented landscape results in similar backscatter/spectral signatures of land cover classes in satellite images. Accordingly, the overarching purpose of this thesis is to contribute to existing methodologies of wetland classification by proposing and developing several new techniques based on advanced remote sensing tools and optical and Synthetic Aperture Radar (SAR) imagery. Specifically, the importance of employing an efficient speckle reduction method for polarimetric SAR (PolSAR) image processing is discussed and a new speckle reduction technique is proposed. Two novel techniques are also introduced for improving the accuracy of wetland classification. In particular, a new hierarchical classification algorithm using multi-frequency SAR data is proposed that discriminates wetland classes in three steps depending on their complexity and similarity. The experimental results reveal that the proposed method is advantageous for mapping complex land cover ecosystems compared to single stream classification approaches, which have been extensively used in the literature. Furthermore, a new feature weighting approach is proposed based on the statistical and physical characteristics of PolSAR data to improve the discrimination capability of input features prior to incorporating them into the classification scheme. This study also demonstrates the transferability of existing classification algorithms, which have been developed based on RADARSAT-2 imagery, to compact polarimetry SAR data that will be collected by the upcoming RADARSAT Constellation Mission (RCM). The capability of several well-known deep Convolutional Neural Network (CNN) architectures currently employed in computer vision is first introduced in this thesis for classification of wetland complexes using multispectral remote sensing data. Finally, this research results in the first provincial-scale wetland inventory maps of Newfoundland and Labrador using the Google Earth Engine (GEE) cloud computing resources and open access Earth Observation (EO) collected by the Copernicus Sentinel missions. Overall, the methodologies proposed in this thesis address fundamental limitations/challenges of wetland mapping using remote sensing data, which have been ignored in the literature. These challenges include the backscattering/spectrally similar signature of wetland classes, insufficient classification accuracy of wetland classes, and limitations of wetland mapping on large scales. In addition to the capabilities of the proposed methods for mapping wetland complexes, the use of these developed techniques for classifying other complex land cover types beyond wetlands, such as sea ice and crop ecosystems, offers a potential avenue for further research