Advanced techniques for classification of polarimetric synthetic aperture radar data

With various remote sensing technologies to aid Earth Observation, radar-based imaging is one of them gaining major interests due to advances in its imaging techniques in form of syn-thetic aperture radar (SAR) and polarimetry. The majority of radar applications focus on mon-itoring, detecting, and classifying local or global areas of interests to support humans within their efforts of decision-making, analysis, and interpretation of Earth’s environment. This thesis focuses on improving the classification performance and process particularly concerning the application of land use and land cover over polarimetric SAR (PolSAR) data. To achieve this, three contributions are studied related to superior feature description and ad-vanced machine-learning techniques including classifiers, principles, and data exploitation. First, this thesis investigates the application of color features within PolSAR image classi-fication to provide additional discrimination on top of the conventional scattering information and texture features. The color features are extracted over the visual presentation of fully and partially polarimetric SAR data by generation of pseudo color images. Within the experiments, the obtained results demonstrated that with the addition of the considered color features, the achieved classification performances outperformed results with common PolSAR features alone as well as achieved higher classification accuracies compared to the traditional combination of PolSAR and texture features. Second, to address the large-scale learning challenge in PolSAR image classification with the utmost efficiency, this thesis introduces the application of an adaptive and data-driven supervised classification topology called Collective Network of Binary Classifiers, CNBC. This topology incorporates active learning to support human users with the analysis and interpretation of PolSAR data focusing on collections of images, where changes or updates to the existing classifier might be required frequently due to surface, terrain, and object changes as well as certain variations in capturing time and position. Evaluations demonstrated the capabilities of CNBC over an extensive set of experimental results regarding the adaptation and data-driven classification of single as well as collections of PolSAR images. The experimental results verified that the evolutionary classification topology, CNBC, did provide an efficient solution for the problems of scalability and dynamic adaptability allowing both feature space dimensions and the number of terrain classes in PolSAR image collections to vary dynamically. Third, most PolSAR classification problems are undertaken by supervised machine learn-ing, which require manually labeled ground truth data available. To reduce the manual labeling efforts, supervised and unsupervised learning approaches are combined into semi-supervised learning to utilize the huge amount of unlabeled data. The application of semi-supervised learning in this thesis is motivated by ill-posed classification tasks related to the small training size problem. Therefore, this thesis investigates how much ground truth is actually necessary for certain classification problems to achieve satisfactory results in a supervised and semi-supervised learning scenario. To address this, two semi-supervised approaches are proposed by unsupervised extension of the training data and ensemble-based self-training. The evaluations showed that significant speed-ups and improvements in classification performance are achieved. In particular, for a remote sensing application such as PolSAR image classification, it is advantageous to exploit the location-based information from the labeled training data. Each of the developed techniques provides its stand-alone contribution from different viewpoints to improve land use and land cover classification. The introduction of a new fea-ture for better discrimination is independent of the underlying classification algorithms used. The application of the CNBC topology is applicable to various classification problems no matter how the underlying data have been acquired, for example in case of remote sensing data. Moreover, the semi-supervised learning approach tackles the challenge of utilizing the unlabeled data. By combining these techniques for superior feature description and advanced machine-learning techniques exploiting classifier topologies and data, further contributions to polarimetric SAR image classification are made. According to the performance evaluations conducted including visual and numerical assessments, the proposed and investigated tech-niques showed valuable improvements and are able to aid the analysis and interpretation of PolSAR image data. Due to the generic nature of the developed techniques, their applications to other remote sensing data will require only minor adjustments

Advanced pixel selection and optimization algorithms for Persistent Scatterer Interferometry (PSI)

Tesi amb diferents seccions retallades per dret de l'editorPremi Extraordinari de Doctorat, promoció 2018-2019. Àmbit de les TICGround deformation measurements can provide valuable information for minimization of associated loss and damage caused by natural and environmental hazards. As a kind of remote sensing technique, Persistent Scatterer Interferometry (PSI) SAR is able to measure ground deformation with high spatial resolution, efficiently. Moreover, the ground deformation monitoring accuracy of PSI techniques can reach up to millimeter level. However, low coherence could hinderthe exploitation of SAR data, and high-accuracy deformation monitoring can only be achieved by PSI for high quality pixels. Therefore, pixel optimization and identification of coherent pixels are crucial for PSI techniques. In this thesis, advanced pixel selection and optimization algorithms have been investigated. Firstly, a full-resolution pixel selection method based on the Temporal Phase Coherence (TPC) has been proposed. This method first estimates noise phase term of each pixel at interferogram level. Then, for each pixel, its noise phase terms of all interferograms are used to assess this pixel’s temporal phase quality (i.e., TPC). In the next, based on the relationship between TPC and phase Standard Deviation (STD), a threshold can be posed on TPC to identify high phase quality pixels. This pixel selection method can work with both Deterministic Scatterers (PSs) and Distributed Scatterers (DSs). To valid the effectiveness of the developed method, it has been used to monitor the Canillo (Andorra) landslide. The results show that the TPC method can obtained highest density of valid pixels among the employed three approaches in this challenging area with X-band SAR data. Second, to balance the polarimetric DInSAR phase optimization effect and the computation cost, a new PolPSI algorithm is developed. This proposed PolPSI algorithm is based on the Coherency Matrix Decomposition result to determine the optimal scattering mechanism of each pixel, thus it is named as CMD-PolPSI. CMDPolPSI need not to search for solution within the full space of solution, it is therefore much computationally faster than the classical Equal Scattering Mechanism (ESM) method, but with lower optimization performance. On the other hand, its optimization performance outperforms the less computational costly BEST method. Third, an adaptive algorithm SMF-POLOPT has been proposed to adaptive filtering and optimizing PolSAR pixels for PolPSI applications. This proposed algorithm is based on PolSAR classification results to firstly identify Polarimetric Homogeneous Pixels (PHPs) for each pixel, and at the same time classify PS and DS pixels. After that, DS pixels are filtered by their associated PHPs, and then optimized based on the coherence stability phase quality metric; PS pixels are unfiltered and directly optimized based on the DA phase quality metric. SMF-POLOPT can simultaneously reduce speckle noise and retain structures’ details. Meanwhile, SMF-POLOPT is able to obtain much higher density of valid pixels for deformation monitoring than the ESM method. To conclude, one pixel selection method has been developed and tested, two PolPSI algorithms have been proposed in this thesis. This work make contributions to the research of “Advanced Pixel Selection and Optimization Algorithms for Persistent Scatterer InterferometryLes mesures de deformació del sòl poden proporcionar informació valuosa per minimitzar les pèrdues i els danys associats causats pels riscos naturals i ambientals. Com a tècnica de teledetecció, la interferometria de dispersors persistents (Persistent Scatter Interferometry, PSI) SAR és capaç de mesurar de forma eficient la deformació del terreny amb una alta resolució espacial. A més, la precisió de monitorització de la deformació del sòl de les tècniques PSI pot arribar a arribar a nivells del mil·límetre. No obstant això, una baixa coherència pot dificultar l’explotació de dades SAR i el control de deformació d’alta precisió només es pot aconseguir mitjançant PSI per a píxels d’alta qualitat. Per tant, l’optimització de píxels i la identificació de píxels coherents són crucials en les tècniques PSI. En aquesta tesi s¿han investigat algorismes avançats de selecció i optimització de píxels. En primer lloc, s'ha proposat un mètode de selecció de píxels de resolució completa basat en la coherència temporal de fase (Temporal Phase Coherence, TPC). Aquest mètode estima per primera vegada el terme de fase de soroll de cada píxel a nivell d’interferograma. A continuació, per a cada píxel, s'utilitzen els termes de la fase de soroll de tots els interferogrames per avaluar la qualitat de fase temporal d'aquest píxel (és a dir, TPC). A la següent, basant-se en la relació entre el TPC i la desviació estàndard de fase (STD), es pot plantejar un llindar de TPC per identificar píxels de qualitat de fase alta. Aquest mètode de selecció de píxels es capaç de detectar tant els dispersors deterministes (PS) com els distribuïts (DS). Per validar l’eficàcia del mètode desenvolupat, s’ha utilitzat per controlar l’esllavissada de Canillo (Andorra). Els resultats mostren que el mètode TPC pot obtenir la major densitat de píxels vàlids, comparat amb els mètodes clàssics de selecció, en aquesta àrea difícil amb dades de SAR de banda X. En segon lloc, per equilibrar l’efecte d’optimització de fase DInSAR polarimètrica i el cost de càlcul, es desenvolupa un nou algorisme de PolPSI. Aquest algorisme proposat de PolPSI es basa en el resultat de la descomposició de la matriu de coherència per determinar el mecanisme de dispersió òptim de cada píxel, de manera que es denomina CMD-PolPSI. CMDPolPSI no necessita buscar solucions dins de l’espai complet de la solució, per tant, és molt més eficient computacionalment que el mètode clàssic de mecanismes d’igualtat de dispersió (Equal Scattering Mechanism, ESM), però amb un efecte d’optimització no tant òptim. D'altra banda, el seu efecte d'optimització supera el mètode BEST, el que te un menor cost computacional. En tercer lloc, s'ha proposat un algoritme adaptatiu SMF-POLOPT per al filtratge adaptatiu i l'optimització de píxels PolSAR per a aplicacions PolPSI. Aquest algorisme proposat es basa en els resultats de classificació PolSAR per identificar primer els píxels homogenis polarimètrics (PHP) per a cada píxel i, alhora, classificar els píxels PS i DS. Després d'això, els píxels DS es filtren pels seus PHP associats i, a continuació, s'optimitzen en funció de la mètrica de qualitat de la fase d'estabilitat de coherència; els píxels classificats com PS no es filtren i s'optimitzen directament en funció de la mètrica de qualitat de la fase DA. SMF-POLOPT pot reduir simultàniament el soroll de la fase interferomètrica i conservar els detalls de les estructures. Mentrestant, SMF-POLOPT aconsegueix obtenir una densitat molt més alta de píxels vàlids per al seguiment de la deformació que el mètode ESM. Per concloure, en aquesta tesi s’ha desenvolupat i provat un mètode de selecció de píxels, i s’han proposat dos algoritmes PolPSI. Aquest treball contribueix a la recerca en "Advanced Pixel Selection and Optimization Algorithms for Persistent Scatterer Interferometry"Postprint (published version

Review on Active and Passive Remote Sensing Techniques for Road Extraction

Digital maps of road networks are a vital part of digital cities and intelligent transportation. In this paper, we provide a comprehensive review on road extraction based on various remote sensing data sources, including high-resolution images, hyperspectral images, synthetic aperture radar images, and light detection and ranging. This review is divided into three parts. Part 1 provides an overview of the existing data acquisition techniques for road extraction, including data acquisition methods, typical sensors, application status, and prospects. Part 2 underlines the main road extraction methods based on four data sources. In this section, road extraction methods based on different data sources are described and analysed in detail. Part 3 presents the combined application of multisource data for road extraction. Evidently, different data acquisition techniques have unique advantages, and the combination of multiple sources can improve the accuracy of road extraction. The main aim of this review is to provide a comprehensive reference for research on existing road extraction technologies.Peer reviewe

Ocean Remote Sensing with Synthetic Aperture Radar

The ocean covers approximately 71% of the Earth’s surface, 90% of the biosphere and contains 97% of Earth’s water. The Synthetic Aperture Radar (SAR) can image the ocean surface in all weather conditions and day or night. SAR remote sensing on ocean and coastal monitoring has become a research hotspot in geoscience and remote sensing. This book—Progress in SAR Oceanography—provides an update of the current state of the science on ocean remote sensing with SAR. Overall, the book presents a variety of marine applications, such as, oceanic surface and internal waves, wind, bathymetry, oil spill, coastline and intertidal zone classification, ship and other man-made objects’ detection, as well as remotely sensed data assimilation. The book is aimed at a wide audience, ranging from graduate students, university teachers and working scientists to policy makers and managers. Efforts have been made to highlight general principles as well as the state-of-the-art technologies in the field of SAR Oceanography

Kernel Feature Extraction Methods for Remote Sensing Data Analysis

Technological advances in the last decades have improved our capabilities of collecting and storing high data volumes. However, this makes that in some fields, such as remote sensing several problems are generated in the data processing due to the peculiar characteristics of their data. High data volume, high dimensionality, heterogeneity and their nonlinearity, make that the analysis and extraction of relevant information from these images could be a bottleneck for many real applications. The research applying image processing and machine learning techniques along with feature extraction, allows the reduction of the data dimensionality while keeps the maximum information. Therefore, developments and applications of feature extraction methodologies using these techniques have increased exponentially in remote sensing. This improves the data visualization and the knowledge discovery. Several feature extraction methods have been addressed in the literature depending on the data availability, which can be classified in supervised, semisupervised and unsupervised. In particular, feature extraction can use in combination with kernel methods (nonlinear). The process for obtaining a space that keeps greater information content is facilitated by this combination. One of the most important properties of the combination is that can be directly used for general tasks including classification, regression, clustering, ranking, compression, or data visualization. In this Thesis, we address the problems of different nonlinear feature extraction approaches based on kernel methods for remote sensing data analysis. Several improvements to the current feature extraction methods are proposed to transform the data in order to make high dimensional data tasks easier, such as classification or biophysical parameter estimation. This Thesis focus on three main objectives to reach these improvements in the current feature extraction methods: The first objective is to include invariances into supervised kernel feature extraction methods. Throughout these invariances it is possible to generate virtual samples that help to mitigate the problem of the reduced number of samples in supervised methods. The proposed algorithm is a simple method that essentially generates new (synthetic) training samples from available labeled samples. These samples along with original samples should be used in feature extraction methods obtaining more independent features between them that without virtual samples. The introduction of prior knowledge by means of the virtual samples could obtain classification and biophysical parameter estimation methods more robust than without them. The second objective is to use the generative kernels, i.e. probabilistic kernels, that directly learn by means of clustering techniques from original data by finding local-to-global similarities along the manifold. The proposed kernel is useful for general feature extraction purposes. Furthermore, the kernel attempts to improve the current methods because the kernel not only contains labeled data information but also uses the unlabeled information of the manifold. Moreover, the proposed kernel is parameter free in contrast with the parameterized functions such as, the radial basis function (RBF). Using probabilistic kernels is sought to obtain new unsupervised and semisupervised methods in order to reduce the number and cost of labeled data in remote sensing. Third objective is to develop new kernel feature extraction methods for improving the features obtained by the current methods. Optimizing the functional could obtain improvements in new algorithm. For instance, the Optimized Kernel Entropy Component Analysis (OKECA) method. The method is based on the Independent Component Analysis (ICA) framework resulting more efficient than the standard Kernel Entropy Component Analysis (KECA) method in terms of dimensionality reduction. In this Thesis, the methods are focused on remote sensing data analysis. Nevertheless, feature extraction methods are used to analyze data of several research fields whereas data are multidimensional. For these reasons, the results are illustrated into experimental sequence. First, the projections are analyzed by means of Toy examples. The algorithms are tested through standard databases with supervised information to proceed to the last step, the analysis of remote sensing images by the proposed methods

Sustainable Agriculture and Advances of Remote Sensing (Volume 1)

Agriculture, as the main source of alimentation and the most important economic activity globally, is being affected by the impacts of climate change. To maintain and increase our global food system production, to reduce biodiversity loss and preserve our natural ecosystem, new practices and technologies are required. This book focuses on the latest advances in remote sensing technology and agricultural engineering leading to the sustainable agriculture practices. Earth observation data, in situ and proxy-remote sensing data are the main source of information for monitoring and analyzing agriculture activities. Particular attention is given to earth observation satellites and the Internet of Things for data collection, to multispectral and hyperspectral data analysis using machine learning and deep learning, to WebGIS and the Internet of Things for sharing and publishing the results, among others

Unsupervised Image Regression for Heterogeneous Change Detection

Change detection (CD) in heterogeneous multitemporal satellite images is an emerging and challenging topic in remote sensing. In particular, one of the main challenges is to tackle the problem in an unsupervised manner. In this paper, we propose an unsupervised framework for bitemporal heterogeneous CD based on the comparison of affinity matrices and image regression. First, our method quantifies the similarity of affinity matrices computed from colocated image patches in the two images. This is done to automatically identify pixels that are likely to be unchanged. With the identified pixels as pseudotraining data, we learn a transformation to map the first image to the domain of the other image and vice versa. Four regression methods are selected to carry out the transformation: Gaussian process regression, support vector regression, random forest regression (RFR), and a recently proposed kernel regression method called homogeneous pixel transformation. To evaluate the potentials and limitations of our framework and also the benefits and disadvantages of each regression method, we perform experiments on two real data sets. The results indicate that the comparison of the affinity matrices can already be considered a CD method by itself. However, image regression is shown to improve the results obtained by the previous step alone and produces accurate CD maps despite of the heterogeneity of the multitemporal input data. Notably, the RFR approach excels by achieving similar accuracy as the other methods, but with a significantly lower computational cost and with fast and robust tuning of hyperparameters

Hyperspectral image representation and processing with binary partition trees

The optimal exploitation of the information provided by hyperspectral images requires the development of advanced image processing tools. Therefore, under the title Hyperspectral image representation and Processing with Binary Partition Trees, this PhD thesis proposes the construction and the processing of a new region-based hierarchical hyperspectral image representation: the Binary Partition Tree (BPT). This hierarchical region-based representation can be interpreted as a set of hierarchical regions stored in a tree structure. Hence, the Binary Partition Tree succeeds in presenting: (i) the decomposition of the image in terms of coherent regions and (ii) the inclusion relations of the regions in the scene. Based on region-merging techniques, the construction of BPT is investigated in this work by studying hyperspectral region models and the associated similarity metrics. As a matter of fact, the very high dimensionality and the complexity of the data require the definition of specific region models and similarity measures. Once the BPT is constructed, the fixed tree structure allows implementing efficient and advanced application-dependent techniques on it. The application-dependent processing of BPT is generally implemented through a specific pruning of the tree. Accordingly, some pruning techniques are proposed and discussed according to different applications. This Ph.D is focused in particular on segmentation, object detection and classification of hyperspectral imagery. Experimental results on various hyperspectral data sets demonstrate the interest and the good performances of the BPT representatio