Image fusion techniqes for remote sensing applications

Image fusion refers to the acquisition, processing and synergistic combination of information provided by various sensors or by the same sensor in many measuring contexts. The aim of this survey paper is to describe three typical applications of data fusion in remote sensing. The first study case considers the problem of the Synthetic Aperture Radar (SAR) Interferometry, where a pair of antennas are used to obtain an elevation map of the observed scene; the second one refers to the fusion of multisensor and multitemporal (Landsat Thematic Mapper and SAR) images of the same site acquired at different times, by using neural networks; the third one presents a processor to fuse multifrequency, multipolarization and mutiresolution SAR images, based on wavelet transform and multiscale Kalman filter. Each study case presents also results achieved by the proposed techniques applied to real data

Remote Sensing for Non‐Technical Survey

This chapter describes the research activities of the Royal Military Academy on remote sensing applied to mine action. Remote sensing can be used to detect specific features that could lead to the suspicion of the presence, or absence, of mines. Work on the automatic detection of trenches and craters is presented here. Land cover can be extracted and is quite useful to help mine action. We present here a classification method based on Gabor filters. The relief of a region helps analysts to understand where mines could have been laid. Methods to be a digital terrain model from a digital surface model are explained. The special case of multi‐spectral classification is also addressed in this chapter. Discussion about data fusion is also given. Hyper‐spectral data are also addressed with a change detection method. Synthetic aperture radar data and its fusion with optical data have been studied. Radar interferometry and polarimetry are also addressed

Support matrix machine: A review

Support vector machine (SVM) is one of the most studied paradigms in the realm of machine learning for classification and regression problems. It relies on vectorized input data. However, a significant portion of the real-world data exists in matrix format, which is given as input to SVM by reshaping the matrices into vectors. The process of reshaping disrupts the spatial correlations inherent in the matrix data. Also, converting matrices into vectors results in input data with a high dimensionality, which introduces significant computational complexity. To overcome these issues in classifying matrix input data, support matrix machine (SMM) is proposed. It represents one of the emerging methodologies tailored for handling matrix input data. The SMM method preserves the structural information of the matrix data by using the spectral elastic net property which is a combination of the nuclear norm and Frobenius norm. This article provides the first in-depth analysis of the development of the SMM model, which can be used as a thorough summary by both novices and experts. We discuss numerous SMM variants, such as robust, sparse, class imbalance, and multi-class classification models. We also analyze the applications of the SMM model and conclude the article by outlining potential future research avenues and possibilities that may motivate academics to advance the SMM algorithm

Deep learning in remote sensing: a review

Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin

A ship detector applying Principal Component Analysis to the polarimetric Notch Filter

Ship detection using polarimetric synthetic aperture radar (PolSAR) data has attracted a lot of attention in recent years. Polarimetry can provide information regarding the scattering mechanisms of targets, which helps discriminate between ships and sea clutter. This enhancement is particularly valuable when we aim at detecting smaller vessels in rough sea states. This work exploits a ship detector called the Geometrical Perturbation-Polarimetric Notch Filter (GP-PNF), and it is aimed at improving its performance especially when less polarimetric images are available (e.g., dual-polarimetric data). The idea is to design a new polarimetric feature vector containing more features that are renowned to allow separation between ships and sea clutter. Then, a Principal Component Analysis (PCA) is further used to reduce the dimensionality of the new feature space. Experiments on four real Sentinel-1 datasets are carried out to demonstrate the validity of the proposed method and compare it against other ship detectors. Analyses of the experimental results show that the proposed algorithm can not only reduce the false alarms significantly, but also enhance the target-to-clutter ratio (TCR) so that it can more effectively detect weaker ships

Extraction d'informations de changement à partir des séries temporelles d'images radar à synthèse d'ouverture

A large number of successfully launched and operated Synthetic Aperture Radar (SAR) satellites has regularly provided multitemporal SAR and polarimetric SAR (PolSAR) images with high and very high spatial resolution over immense areas of the Earth surface. SAR system is appropriate for monitoring tasks thanks to the advantage of operating in all-time and all-weather conditions. With multitemporal data, both spatial and temporal information can simultaneously be exploited to improve the results of researche works. Change detection of specific features within a certain time interval has to deal with a complex processing of SAR data and the so-called speckle which affects the backscattered signal as multiplicative noise.The aim of this thesis is to provide a methodology for simplifying the analysis of multitemporal SAR data. Such methodology can benefit from the advantages of repetitive SAR acquisitions and be able to process different kinds of SAR data (i.e. single, multipolarization SAR, etc.) for various applications. In this thesis, we first propose a general framework based on a spatio-temporal information matrix called emph{Change Detection Matrix} (CDM). This matrix contains temporal neighborhoods which are adaptive to changed and unchanged areas thanks to similarity cross tests. Then, the proposed method is used to perform three different tasks:1) multitemporal change detection with different kinds of changes, which allows the combination of multitemporal pair-wise change maps to improve the performance of change detection result;2) analysis of change dynamics in the observed area, which allows the investigation of temporal evolution of objects of interest;3) nonlocal temporal mean filtering of SAR/PolSAR image time series, which allows us to avoid smoothing change information in the time series during the filtering process.In order to illustrate the relevancy of the proposed method, the experimental works of the thesis is performed on four datasets over two test-sites: Chamonix Mont-Blanc, France and Merapi volcano, Indonesia, with different types of changes (i.e., seasonal evolution, glaciers, volcanic eruption, etc.). Observations of these test-sites are performed on four SAR images time series from single polarization to full polarization, from medium to high, very high spatial resolution: Sentinel-1, ALOS-PALSAR, RADARSAT-2 and TerraSAR-X time series.La réussite du lancement d'un grand nombre des satellites Radar à Synthèse d'Ouverture (RSO - SAR) de nouvelle génération a fourni régulièrement des images SAR et SAR polarimétrique (PolSAR) multitemporelles à haute et très haute résolution spatiale sur de larges régions de la surface de la Terre. Le système SAR est approprié pour des tâches de surveillance continue ou il offre l'avantage d'être indépendant de l'éclairement solaire et de la couverture nuageuse. Avec des données multitemporelles, l'information spatiale et temporelle peut être exploitée simultanément pour rendre plus concise, l'extraction d'information à partir des données. La détection de changement de structures spécifiques dans un certain intervalle de temps nécessite un traitement complexe des données SAR et la présence du chatoiement (speckle) qui affecte la rétrodiffusion comme un bruit multiplicatif. Le but de cette thèse est de fournir une méthodologie pour simplifier l'analyse des données multitemporelles SAR. Cette méthodologie doit bénéficier des avantages d'acquisitions SAR répétitives et être capable de traiter différents types de données SAR (images SAR mono-, multi- composantes, etc.) pour diverses applications. Au cours de cette thèse, nous proposons tout d'abord une méthode générale basée sur une matrice d'information spatio-temporelle appelée Matrice de détection de changement (CDM). Cette matrice contient des informations de changements obtenus à partir de tests croisés de similarité sur des voisinages adaptatifs. La méthode proposée est ensuite exploitée pour réaliser trois tâches différentes: 1) la détection de changement multitemporel avec différents types de changements, ce qui permet la combinaison des cartes de changement entre des paires d'images pour améliorer la performance de résultat de détection de changement; 2) l'analyse de la dynamicité de changement de la zone observée, ce qui permet l'étude de l'évolution temporelle des objets d'intérêt; 3) le filtrage nonlocal temporel des séries temporelles d'images SAR/PolSAR, ce qui permet d'éviter le lissage des informations de changement dans des séries pendant le processus de filtrage.Afin d'illustrer la pertinence de la méthode proposée, la partie expérimentale de la thèse est effectuée sur deux sites d'étude: Chamonix Mont-Blanc, France et le volcan Merapi, Indonésie, avec différents types de changements (i.e. évolution saisonnière, glaciers, éruption volcanique, etc.). Les observations de ces sites d'étude sont acquises sur quatre séries temporelles d'images SAR monocomposantes et multicomposantes de moyenne à haute et très haute résolution: des séries temporelles d'images Sentinel-1, ALOS-PALSAR, RADARSAT-2 et TerraSAR-X

On the use of the l(2)-norm for texture analysis of polarimetric SAR data

In this paper, the use of the l2-norm, or Span, of the scattering vectors is suggested for texture analysis of polarimetric synthetic aperture radar (SAR) data, with the benefits that we need neither an analysis of the polarimetric channels separately nor a filtering of the data to analyze the statistics. Based on the product model, the distribution of the l2-norm is studied. Closed expressions of the probability density functions under the assumptions of several texture distributions are provided. To utilize the statistical properties of the l2-norm, quantities including normalized moments and log-cumulants are derived, along with corresponding estimators and estimation variances. Results on both simulated and real SAR data show that the use of statistics based on the l2-norm brings advantages in several aspects with respect to the normalized intensity moments and matrix variate log-cumulants.Peer ReviewedPostprint (published version

Imaging time series for the classification of EMI discharge sources

In this work, we aim to classify a wider range of Electromagnetic Interference (EMI) discharge sources collected from new power plant sites across multiple assets. This engenders a more complex and challenging classification task. The study involves an investigation and development of new and improved feature extraction and data dimension reduction algorithms based on image processing techniques. The approach is to exploit the Gramian Angular Field technique to map the measured EMI time signals to an image, from which the significant information is extracted while removing redundancy. The image of each discharge type contains a unique fingerprint. Two feature reduction methods called the Local Binary Pattern (LBP) and the Local Phase Quantisation (LPQ) are then used within the mapped images. This provides feature vectors that can be implemented into a Random Forest (RF) classifier. The performance of a previous and the two new proposed methods, on the new database set, is compared in terms of classification accuracy, precision, recall, and F-measure. Results show that the new methods have a higher performance than the previous one, where LBP features achieve the best outcome

Metrics to evaluate compressions algorithms for RAW SAR data

Modern synthetic aperture radar (SAR) systems have size, weight, power and cost (SWAP-C) limitations since platforms are becoming smaller, while SAR operating modes are becoming more complex. Due to the computational complexity of the SAR processing required for modern SAR systems, performing the processing on board the platform is not a feasible option. Thus, SAR systems are producing an ever-increasing volume of data that needs to be transmitted to a ground station for processing. Compression algorithms are utilised to reduce the data volume of the raw data. However, these algorithms can cause degradation and losses that may degrade the effectiveness of the SAR mission. This study addresses the lack of standardised quantitative performance metrics to objectively quantify the performance of SAR data-compression algorithms. Therefore, metrics were established in two different domains, namely the data domain and the image domain. The data-domain metrics are used to determine the performance of the quantisation and the associated losses or errors it induces in the raw data samples. The image-domain metrics evaluate the quality of the SAR image after SAR processing has been performed. In this study three well-known SAR compression algorithms were implemented and applied to three real SAR data sets that were obtained from a prototype airborne SAR system. The performance of these algorithms were evaluated using the proposed metrics. Important metrics in the data domain were found to be the compression ratio, the entropy, statistical parameters like the skewness and kurtosis to measure the deviation from the original distributions of the uncompressed data, and the dynamic range. The data histograms are an important visual representation of the effects of the compression algorithm on the data. An important error measure in the data domain is the signal-to-quantisation-noise ratio (SQNR), and the phase error for applications where phase information is required to produce the output. Important metrics in the image domain include the dynamic range, the impulse response function, the image contrast, as well as the error measure, signal-to-distortion-noise ratio (SDNR). The metrics suggested that all three algorithms performed well and are thus well suited for the compression of raw SAR data. The fast Fourier transform block adaptive quantiser (FFT-BAQ) algorithm had the overall best performance, but the analysis of the computational complexity of its compression steps, indicated that it is has the highest level of complexity compared to the other two algorithms. Since different levels of degradation are acceptable for different SAR applications, a trade-off can be made between the data reduction and the degradation caused by the algorithm. Due to SWAP-C limitations, there also remains a trade-off between the performance and the computational complexity of the compression algorithm.Dissertation (MEng)--University of Pretoria, 2019.Electrical, Electronic and Computer EngineeringMEngUnrestricte