Advanced techniques for classification of polarimetric synthetic aperture radar data

With various remote sensing technologies to aid Earth Observation, radar-based imaging is one of them gaining major interests due to advances in its imaging techniques in form of syn-thetic aperture radar (SAR) and polarimetry. The majority of radar applications focus on mon-itoring, detecting, and classifying local or global areas of interests to support humans within their efforts of decision-making, analysis, and interpretation of Earth’s environment. This thesis focuses on improving the classification performance and process particularly concerning the application of land use and land cover over polarimetric SAR (PolSAR) data. To achieve this, three contributions are studied related to superior feature description and ad-vanced machine-learning techniques including classifiers, principles, and data exploitation. First, this thesis investigates the application of color features within PolSAR image classi-fication to provide additional discrimination on top of the conventional scattering information and texture features. The color features are extracted over the visual presentation of fully and partially polarimetric SAR data by generation of pseudo color images. Within the experiments, the obtained results demonstrated that with the addition of the considered color features, the achieved classification performances outperformed results with common PolSAR features alone as well as achieved higher classification accuracies compared to the traditional combination of PolSAR and texture features. Second, to address the large-scale learning challenge in PolSAR image classification with the utmost efficiency, this thesis introduces the application of an adaptive and data-driven supervised classification topology called Collective Network of Binary Classifiers, CNBC. This topology incorporates active learning to support human users with the analysis and interpretation of PolSAR data focusing on collections of images, where changes or updates to the existing classifier might be required frequently due to surface, terrain, and object changes as well as certain variations in capturing time and position. Evaluations demonstrated the capabilities of CNBC over an extensive set of experimental results regarding the adaptation and data-driven classification of single as well as collections of PolSAR images. The experimental results verified that the evolutionary classification topology, CNBC, did provide an efficient solution for the problems of scalability and dynamic adaptability allowing both feature space dimensions and the number of terrain classes in PolSAR image collections to vary dynamically. Third, most PolSAR classification problems are undertaken by supervised machine learn-ing, which require manually labeled ground truth data available. To reduce the manual labeling efforts, supervised and unsupervised learning approaches are combined into semi-supervised learning to utilize the huge amount of unlabeled data. The application of semi-supervised learning in this thesis is motivated by ill-posed classification tasks related to the small training size problem. Therefore, this thesis investigates how much ground truth is actually necessary for certain classification problems to achieve satisfactory results in a supervised and semi-supervised learning scenario. To address this, two semi-supervised approaches are proposed by unsupervised extension of the training data and ensemble-based self-training. The evaluations showed that significant speed-ups and improvements in classification performance are achieved. In particular, for a remote sensing application such as PolSAR image classification, it is advantageous to exploit the location-based information from the labeled training data. Each of the developed techniques provides its stand-alone contribution from different viewpoints to improve land use and land cover classification. The introduction of a new fea-ture for better discrimination is independent of the underlying classification algorithms used. The application of the CNBC topology is applicable to various classification problems no matter how the underlying data have been acquired, for example in case of remote sensing data. Moreover, the semi-supervised learning approach tackles the challenge of utilizing the unlabeled data. By combining these techniques for superior feature description and advanced machine-learning techniques exploiting classifier topologies and data, further contributions to polarimetric SAR image classification are made. According to the performance evaluations conducted including visual and numerical assessments, the proposed and investigated tech-niques showed valuable improvements and are able to aid the analysis and interpretation of PolSAR image data. Due to the generic nature of the developed techniques, their applications to other remote sensing data will require only minor adjustments

Study of the speckle noise effects over the eigen decomposition of polarimetric SAR data: a review

This paper is focused on considering the effects of speckle noise on the eigen decomposition of the co- herency matrix. Based on a perturbation analysis of the matrix, it is possible to obtain an analytical expression for the mean value of the eigenvalues and the eigenvectors, as well as for the Entropy, the Anisotroopy and the dif- ferent a angles. The analytical expressions are compared against simulated polarimetric SAR data, demonstrating the correctness of the different expressions.Peer ReviewedPostprint (published version

Polarimetric Synthetic Aperture Radar

This open access book focuses on the practical application of electromagnetic polarimetry principles in Earth remote sensing with an educational purpose. In the last decade, the operations from fully polarimetric synthetic aperture radar such as the Japanese ALOS/PalSAR, the Canadian Radarsat-2 and the German TerraSAR-X and their easy data access for scientific use have developed further the research and data applications at L,C and X band. As a consequence, the wider distribution of polarimetric data sets across the remote sensing community boosted activity and development in polarimetric SAR applications, also in view of future missions. Numerous experiments with real data from spaceborne platforms are shown, with the aim of giving an up-to-date and complete treatment of the unique benefits of fully polarimetric synthetic aperture radar data in five different domains: forest, agriculture, cryosphere, urban and oceans

Advanced machine learning algorithms for Canadian wetland mapping using polarimetric synthetic aperture radar (PolSAR) and optical imagery

Wetlands are complex land cover ecosystems that represent a wide range of biophysical conditions. They are one of the most productive ecosystems and provide several important environmental functionalities. As such, wetland mapping and monitoring using cost- and time-efficient approaches are of great interest for sustainable management and resource assessment. In this regard, satellite remote sensing data are greatly beneficial, as they capture a synoptic and multi-temporal view of landscapes. The ability to extract useful information from satellite imagery greatly affects the accuracy and reliability of the final products. This is of particular concern for mapping complex land cover ecosystems, such as wetlands, where complex, heterogeneous, and fragmented landscape results in similar backscatter/spectral signatures of land cover classes in satellite images. Accordingly, the overarching purpose of this thesis is to contribute to existing methodologies of wetland classification by proposing and developing several new techniques based on advanced remote sensing tools and optical and Synthetic Aperture Radar (SAR) imagery. Specifically, the importance of employing an efficient speckle reduction method for polarimetric SAR (PolSAR) image processing is discussed and a new speckle reduction technique is proposed. Two novel techniques are also introduced for improving the accuracy of wetland classification. In particular, a new hierarchical classification algorithm using multi-frequency SAR data is proposed that discriminates wetland classes in three steps depending on their complexity and similarity. The experimental results reveal that the proposed method is advantageous for mapping complex land cover ecosystems compared to single stream classification approaches, which have been extensively used in the literature. Furthermore, a new feature weighting approach is proposed based on the statistical and physical characteristics of PolSAR data to improve the discrimination capability of input features prior to incorporating them into the classification scheme. This study also demonstrates the transferability of existing classification algorithms, which have been developed based on RADARSAT-2 imagery, to compact polarimetry SAR data that will be collected by the upcoming RADARSAT Constellation Mission (RCM). The capability of several well-known deep Convolutional Neural Network (CNN) architectures currently employed in computer vision is first introduced in this thesis for classification of wetland complexes using multispectral remote sensing data. Finally, this research results in the first provincial-scale wetland inventory maps of Newfoundland and Labrador using the Google Earth Engine (GEE) cloud computing resources and open access Earth Observation (EO) collected by the Copernicus Sentinel missions. Overall, the methodologies proposed in this thesis address fundamental limitations/challenges of wetland mapping using remote sensing data, which have been ignored in the literature. These challenges include the backscattering/spectrally similar signature of wetland classes, insufficient classification accuracy of wetland classes, and limitations of wetland mapping on large scales. In addition to the capabilities of the proposed methods for mapping wetland complexes, the use of these developed techniques for classifying other complex land cover types beyond wetlands, such as sea ice and crop ecosystems, offers a potential avenue for further research

Method for landslides detection with semi-automatic procedures: The case in the zone center-east of Cauca department, Colombia

Landslides are a common natural hazard that causes human casualties, but also infrastructure damage and land-use degradation. Therefore, a quantitative assessment of their presence is required by means of detecting and recognizing the potentially unstable areas. This research aims to develop a method supported on semiautomatic methods to detect potential mass movements at a regional scale. Five techniques were studied: Morphometry, SAR interferometry (InSAR), Persistent Scatterer InSAR (PS-InSAR), SAR polarimetry (PolSAR) and NDVI composites of Landsat 5, Landsat 7, and Landsat 8. The case study was chosen within the mid-eastern area of the Cauca state, which is characterised by its mountainous terrain and the presence of slope instabilities, officially registered in the CGS-SIMMA landslide inventory. This inventory revealed that the type `slide' occurred with 77.4% from the entire registries, `fall' with 16.5%, followed by `creeps' with 3%, flows with 2.6%, and `lateral spread' with 0.43%. As a result, we obtained the morphometric variables: slope, CONVI, TWI, landform, which were highly associated with landslides. The effect of a DEM in the processing flow of the InSAR method was similar for the InSAR coherence variable using the DEMs ASTER, PALSAR RTC, Topo-map, and SRTM. Then, a multiInSAR analysis gave displacement velocities in the LOS direction between -10 and 10 mm/year. With the dual-PolSAR analysis (Sentinel-1), VH and VV C-band polarised radar energy emitted median values of backscatters, for landslides, about of -14.5 dB for VH polarisation and -8.5 dB for VV polarisation. Also, L-band fully polarimetric NASA-UAVSAR data allowed to nd the mechanism of dispersion of CGS landslide inventory: 39% for surface scattering, 46.4% for volume dispersion, and 14.6% for double-bounce scattering. The optical remote sensing provided NDVI composites derived from Landsat series between 2012 and 2016, showing that NDVI values between 0.40 and 0.70 had a high correlation to landslides. In summary, we found the highest categories related to landslides by Weight of Evidence method (WofE) for each spaceborne technique applied. Finally, these results were merged to generate the landslide detection model by using the supervised machine learning method of Random Forest. By taking training and test samples, the precision of the detection model was of about 70% for the rotational and translational types.Los deslizamientos son una amenaza natural que causa pérdidas humanas, daños a la infraestructura y degradación del suelo. Una evaluación cuantitativa de su presencia se requiere mediante la detección y el reconocimiento de potenciales áreas inestables. Esta investigación tuvo como alcance desarrollar un método soportado en métodos semi-automáticos para detectar potenciales movimientos en masa a escala regional. Cinco técnicas fueron estudiadas: Morfometría, Interferometría radar, Interferometría con Persistent Scatterers, Polarimetría radar y composiciones del NDVI con los satélites Landsat 5, Landsat 7 y Landsat 8. El caso de estudio se seleccionó dentro de la región intermedia al este del departamento del Cauca, la cual se caracteriza por terreno montañoso y la presencia de inestabilidades de la pendiente oficialmente registrados en el servicio SIMMA del Servicio Geológico Colombiano. Este inventario reveló que el tipo de movimiento deslizamiento ocurrió con una frecuencia relativa de 77.4%, caidos con el 16.5% de los casos y reptaciones con 3%, flujos con 2.6% y propagación lateral con 0.43%. Como resultado, se obtuvo las variables morfométricas: pendiente, convergencia, índice topográfico de humedad y forma del terreno altamente asociados con los deslizamientos. El efecto de un DEM en el procesamiento del método InSAR fue similar para la variable coherencia usando los DEMs: ASTER, PAlSAR RTC, Topo-map y SRTM. Un análisis Multi-InSAR estimó velocidades de desplazamiento en dirección de vista del radar entre -10 y 10 mm/año. El análisis de polarimetría dual del Sentinel-1 arrojó valores de retrodispersión promedio de -14.5 dB en la banda VH y -8.5dB en la banda VV. Las cuatro polarimetrías del sensor aéreo UAVSAR permitió caracterizar el mecanismo de dispersión del Inventario de Deslizamiento así: 39% en el mecanismo de superficie, 46.4% en el mecanismo de volumen y 14.6% en el mecanismo de doble rebote. La información generada en el rango óptico permitió obtener composiciones de NDVI derivados de la plataforma Landsat entre los años 2012 y 2016, mostrando que el rango entre 0.4 y 0.7 tuvieron una alta asociación con los deslizamientos. En esta investigación se determinaron las categorías de las variables de Teledetección más altamente relacionadas con los movimientos en masa mediante el método de Pesos de Evidencias (WofE). Finalmente, estos resultados se fusionaron para generar el modelo de detección de deslizamientos usando el método supervisado de aprendizaje de máquina Random Forest. Tomando muestras aleatorias para entrenar y validar el modelo en una proporción 70:30, el modelo de detección, especialmente los movimientos de tipo rotacional y traslacional fueron clasificados con una tasa general de éxito del 70%.Ministerio de CienciasConvocatoria 647 de 2014Research line: Geotechnics and Geoenvironmental HazardDoctorad

Extraction d'informations de changement à partir des séries temporelles d'images radar à synthèse d'ouverture

A large number of successfully launched and operated Synthetic Aperture Radar (SAR) satellites has regularly provided multitemporal SAR and polarimetric SAR (PolSAR) images with high and very high spatial resolution over immense areas of the Earth surface. SAR system is appropriate for monitoring tasks thanks to the advantage of operating in all-time and all-weather conditions. With multitemporal data, both spatial and temporal information can simultaneously be exploited to improve the results of researche works. Change detection of specific features within a certain time interval has to deal with a complex processing of SAR data and the so-called speckle which affects the backscattered signal as multiplicative noise.The aim of this thesis is to provide a methodology for simplifying the analysis of multitemporal SAR data. Such methodology can benefit from the advantages of repetitive SAR acquisitions and be able to process different kinds of SAR data (i.e. single, multipolarization SAR, etc.) for various applications. In this thesis, we first propose a general framework based on a spatio-temporal information matrix called emph{Change Detection Matrix} (CDM). This matrix contains temporal neighborhoods which are adaptive to changed and unchanged areas thanks to similarity cross tests. Then, the proposed method is used to perform three different tasks:1) multitemporal change detection with different kinds of changes, which allows the combination of multitemporal pair-wise change maps to improve the performance of change detection result;2) analysis of change dynamics in the observed area, which allows the investigation of temporal evolution of objects of interest;3) nonlocal temporal mean filtering of SAR/PolSAR image time series, which allows us to avoid smoothing change information in the time series during the filtering process.In order to illustrate the relevancy of the proposed method, the experimental works of the thesis is performed on four datasets over two test-sites: Chamonix Mont-Blanc, France and Merapi volcano, Indonesia, with different types of changes (i.e., seasonal evolution, glaciers, volcanic eruption, etc.). Observations of these test-sites are performed on four SAR images time series from single polarization to full polarization, from medium to high, very high spatial resolution: Sentinel-1, ALOS-PALSAR, RADARSAT-2 and TerraSAR-X time series.La réussite du lancement d'un grand nombre des satellites Radar à Synthèse d'Ouverture (RSO - SAR) de nouvelle génération a fourni régulièrement des images SAR et SAR polarimétrique (PolSAR) multitemporelles à haute et très haute résolution spatiale sur de larges régions de la surface de la Terre. Le système SAR est approprié pour des tâches de surveillance continue ou il offre l'avantage d'être indépendant de l'éclairement solaire et de la couverture nuageuse. Avec des données multitemporelles, l'information spatiale et temporelle peut être exploitée simultanément pour rendre plus concise, l'extraction d'information à partir des données. La détection de changement de structures spécifiques dans un certain intervalle de temps nécessite un traitement complexe des données SAR et la présence du chatoiement (speckle) qui affecte la rétrodiffusion comme un bruit multiplicatif. Le but de cette thèse est de fournir une méthodologie pour simplifier l'analyse des données multitemporelles SAR. Cette méthodologie doit bénéficier des avantages d'acquisitions SAR répétitives et être capable de traiter différents types de données SAR (images SAR mono-, multi- composantes, etc.) pour diverses applications. Au cours de cette thèse, nous proposons tout d'abord une méthode générale basée sur une matrice d'information spatio-temporelle appelée Matrice de détection de changement (CDM). Cette matrice contient des informations de changements obtenus à partir de tests croisés de similarité sur des voisinages adaptatifs. La méthode proposée est ensuite exploitée pour réaliser trois tâches différentes: 1) la détection de changement multitemporel avec différents types de changements, ce qui permet la combinaison des cartes de changement entre des paires d'images pour améliorer la performance de résultat de détection de changement; 2) l'analyse de la dynamicité de changement de la zone observée, ce qui permet l'étude de l'évolution temporelle des objets d'intérêt; 3) le filtrage nonlocal temporel des séries temporelles d'images SAR/PolSAR, ce qui permet d'éviter le lissage des informations de changement dans des séries pendant le processus de filtrage.Afin d'illustrer la pertinence de la méthode proposée, la partie expérimentale de la thèse est effectuée sur deux sites d'étude: Chamonix Mont-Blanc, France et le volcan Merapi, Indonésie, avec différents types de changements (i.e. évolution saisonnière, glaciers, éruption volcanique, etc.). Les observations de ces sites d'étude sont acquises sur quatre séries temporelles d'images SAR monocomposantes et multicomposantes de moyenne à haute et très haute résolution: des séries temporelles d'images Sentinel-1, ALOS-PALSAR, RADARSAT-2 et TerraSAR-X

Polarimetric Synthetic Aperture Radar, Principles and Application

Demonstrates the benefits of the usage of fully polarimetric synthetic aperture radar data in applications of Earth remote sensing, with educational and development purposes. Includes numerous up-to-date examples with real data from spaceborne platforms and possibility to use a software to support lecture practicals. Reviews theoretical principles in an intuitive way for each application topic. Covers in depth five application domains (forests, agriculture, cryosphere, urban, and oceans), with reference also to hazard monitorin

Processing of optic and radar images.Application in satellite remote sensing of snow, ice and glaciers

Ce document présente une synthèse de mes activités de recherche depuis la soutenance de ma thèse en 1999. L'activité rapportée ici est celle d'un ingénieur de recherche, et donc s'est déroulée en parallèle d'une activité ``technique'' comprenant des taches d'instrumentation en laboratoire, d'instrumentation de plateformes en montagne, de raids scientifiques sur les calottes polaires, d'élaboration de projets scientifiques, d'organisation d'équipes ou d'ordre administratif. Je suis Ingénieur de recherche CNRS depuis 2004 affecté au laboratoire Gipsa-lab, une unité mixte de recherche du CNRS, de Grenoble-INP, de l'université Joseph Fourier et de l'université Stendhal. Ce laboratoire (d'environ 400 personnes), conventionné avec l'INRIA, l'Observatoire de Grenoble et l'université Pierre Mendès France, est pluridisciplinaire et développe des recherches fondamentales et finalisées sur les signaux et les systèmes complexes.}Lors de la préparation de ma thèse (mi-temps 1995-99) au LGGE, je me suis intéressé au traitement des images de microstructures de la neige, du névé et de la glace. C'est assez naturellement que j'ai rejoint le laboratoire LIS devenu Gipsa-lab pour y développer des activités de traitement des images Radar à Synthèse d'Ouverture (RSO) appliqué aux milieux naturels neige, glace et glaciers. Etant le premier à générer un interférogramme différentiel des glaciers des Alpes, j'ai continué à travailler sur la phase interférométrique pour extraire des informations de déplacement et valider ces méthodes sur le glacier d'Argentière (massif du Mont-Blanc) qui présente l'énorme avantage de se déplacer de quelques centimètres par jour. Ces activités m'ont amené à développer, en collaboration avec les laboratoires LISTIC, LTCI et IETR, des méthodes plus générales pour extraire des informations dans les images RSO.Ma formation initiale en électronique, puis de doctorat en physique m'ont amené à mettre à profit mes connaissances en traitement d'images et des signaux, en électromagnétisme, en calcul numérique, en informatique et en physique de la neige et de la glace pour étudier les problèmes de traitement des images RSO appliqués à la glace, aux glaciers et à la neige

Machine Learning and Pattern Recognition Methods for Remote Sensing Image Registration and Fusion

In the last decade, the remote sensing world has dramatically evolved. New types of sensor, each one collecting data with possibly different modalities, have been designed, developed, and deployed. Moreover, new missions have been planned and launched, aimed not only at collecting data of the Earth's surface, but also at acquiring planetary data in support of the study of the whole Solar system. Indeed, such a variety of technologies highlights the need for automatic methods able to effectively exploit all the available information. In the last years, lot of effort has been put in the design and development of advanced data fusion methods able to extract and make use of all the information available from as many complementary information sources as possible. Indeed, the goal of this thesis is to present novel machine learning and pattern recognition methodologies designed to support the exploitation of diverse sources of information, such as multisensor, multimodal, or multiresolution imagery. In this context, image registration plays a major role as is allows bringing two or more digital images into precise alignment for analysis and comparison. Here, image registration is tackled using both feature-based and area-based strategies. In the former case, the features of interest are extracted using a stochastic geometry model based on marked point processes, while, in the latter case, information theoretic functionals and the domain adaptation capabilities of generative adversarial networks are exploited. In addition, multisensor image registration is also applied in a large scale scenario by introducing a tiling-based strategy aimed at minimizing the computational burden, which is usually heavy in the multisensor case due to the need for information theoretic similarity measures. Moreover, automatic change detection with multiresolution and multimodality imagery is addressed via a novel Markovian framework based on a linear mixture model and on an ad-hoc multimodal energy function minimized using graph cuts or belied propagation methods. The statistics of the data at the various spatial scales is modelled through appropriate generalized Gaussian distributions and by iteratively estimating a set of virtual images, at the finest resolution, representing the data that would have been collected in case all the sensors worked at that resolution. All such methodologies have been experimentally evaluated with respect to different datasets, and with particular focus on the trade-off between the achievable performances and the demands in terms of computational resources. Moreover, such methods are also compared with state-of-the-art solutions, and are analyzed in terms of future developments, giving insights to possible future lines of research in this field

Metrics to evaluate compressions algorithms for RAW SAR data

Modern synthetic aperture radar (SAR) systems have size, weight, power and cost (SWAP-C) limitations since platforms are becoming smaller, while SAR operating modes are becoming more complex. Due to the computational complexity of the SAR processing required for modern SAR systems, performing the processing on board the platform is not a feasible option. Thus, SAR systems are producing an ever-increasing volume of data that needs to be transmitted to a ground station for processing. Compression algorithms are utilised to reduce the data volume of the raw data. However, these algorithms can cause degradation and losses that may degrade the effectiveness of the SAR mission. This study addresses the lack of standardised quantitative performance metrics to objectively quantify the performance of SAR data-compression algorithms. Therefore, metrics were established in two different domains, namely the data domain and the image domain. The data-domain metrics are used to determine the performance of the quantisation and the associated losses or errors it induces in the raw data samples. The image-domain metrics evaluate the quality of the SAR image after SAR processing has been performed. In this study three well-known SAR compression algorithms were implemented and applied to three real SAR data sets that were obtained from a prototype airborne SAR system. The performance of these algorithms were evaluated using the proposed metrics. Important metrics in the data domain were found to be the compression ratio, the entropy, statistical parameters like the skewness and kurtosis to measure the deviation from the original distributions of the uncompressed data, and the dynamic range. The data histograms are an important visual representation of the effects of the compression algorithm on the data. An important error measure in the data domain is the signal-to-quantisation-noise ratio (SQNR), and the phase error for applications where phase information is required to produce the output. Important metrics in the image domain include the dynamic range, the impulse response function, the image contrast, as well as the error measure, signal-to-distortion-noise ratio (SDNR). The metrics suggested that all three algorithms performed well and are thus well suited for the compression of raw SAR data. The fast Fourier transform block adaptive quantiser (FFT-BAQ) algorithm had the overall best performance, but the analysis of the computational complexity of its compression steps, indicated that it is has the highest level of complexity compared to the other two algorithms. Since different levels of degradation are acceptable for different SAR applications, a trade-off can be made between the data reduction and the degradation caused by the algorithm. Due to SWAP-C limitations, there also remains a trade-off between the performance and the computational complexity of the compression algorithm.Dissertation (MEng)--University of Pretoria, 2019.Electrical, Electronic and Computer EngineeringMEngUnrestricte