Image fusion techniqes for remote sensing applications

Image fusion refers to the acquisition, processing and synergistic combination of information provided by various sensors or by the same sensor in many measuring contexts. The aim of this survey paper is to describe three typical applications of data fusion in remote sensing. The first study case considers the problem of the Synthetic Aperture Radar (SAR) Interferometry, where a pair of antennas are used to obtain an elevation map of the observed scene; the second one refers to the fusion of multisensor and multitemporal (Landsat Thematic Mapper and SAR) images of the same site acquired at different times, by using neural networks; the third one presents a processor to fuse multifrequency, multipolarization and mutiresolution SAR images, based on wavelet transform and multiscale Kalman filter. Each study case presents also results achieved by the proposed techniques applied to real data

Pol-InSAR-Island - A benchmark dataset for multi-frequency Pol-InSAR data land cover classification

This paper presents Pol-InSAR-Island, the first publicly available multi-frequency Polarimetric Interferometric Synthetic Aperture Radar (Pol-InSAR) dataset labeled with detailed land cover classes, which serves as a challenging benchmark dataset for land cover classification. In recent years, machine learning has become a powerful tool for remote sensing image analysis. While there are numerous large-scale benchmark datasets for training and evaluating machine learning models for the analysis of optical data, the availability of labeled SAR or, more specifically, Pol-InSAR data is very limited. The lack of labeled data for training, as well as for testing and comparing different approaches, hinders the rapid development of machine learning algorithms for Pol-InSAR image analysis. The Pol-InSAR-Island benchmark dataset presented in this paper aims to fill this gap. The dataset consists of Pol-InSAR data acquired in S- and L-band by DLR\u27s airborne F-SAR system over the East Frisian island Baltrum. The interferometric image pairs are the result of a repeat-pass measurement with a time offset of several minutes. The image data are given as 6 × 6 coherency matrices in ground range on a 1 m × 1m grid. Pixel-accurate class labels, consisting of 12 different land cover classes, are generated in a semi-automatic process based on an existing biotope type map and visual interpretation of SAR and optical images. Fixed training and test subsets are defined to ensure the comparability of different approaches trained and tested prospectively on the Pol-InSAR-Island dataset. In addition to the dataset, results of supervised Wishart and Random Forest classifiers that achieve mean Intersection-over-Union scores between 24% and 67% are provided to serve as a baseline for future work. The dataset is provided via KITopenData: https://doi.org/10.35097/170

Improved POLSAR Image Classification by the Use of Multi-Feature Combination

Polarimetric SAR (POLSAR) provides a rich set of information about objects on land surfaces. However, not all information works on land surface classification. This study proposes a new, integrated algorithm for optimal urban classification using POLSAR data. Both polarimetric decomposition and time-frequency (TF) decomposition were used to mine the hidden information of objects in POLSAR data, which was then applied in the C5.0 decision tree algorithm for optimal feature selection and classification. Using a NASA/JPL AIRSAR POLSAR scene as an example, the overall accuracy and kappa coefficient of the proposed method reached 91.17% and 0.90 in the L-band, much higher than those achieved by the commonly applied Wishart supervised classification that were 45.65% and 0.41. Meantime, the overall accuracy of the proposed method performed well in both C- and P-bands. Polarimetric decomposition and TF decomposition all proved useful in the process. TF information played a great role in delineation between urban/built-up areas and vegetation. Three polarimetric features (entropy, Shannon entropy, T11 Coherency Matrix element) and one TF feature (HH intensity of coherence) were found most helpful in urban areas classification. This study indicates that the integrated use of polarimetric decomposition and TF decomposition of POLSAR data may provide improved feature extraction in heterogeneous urban areas

Incorporating interferometric coherence into lulc classification of airborne polsar-images using fully convolutional networks

Inspired by the application of state-of-the-art Fully Convolutional Networks (FCNs) for the semantic segmentation of high-resolution optical imagery, recent works transfer this methodology successfully to pixel-wise land use and land cover (LULC) classification of PolSAR data. So far, mainly single PolSAR images are included in the FCN-based classification processes. To further increase classification accuracy, this paper presents an approach for integrating interferometric coherence derived from co-registered image pairs into a FCN-based classification framework. A network based on an encoder-decoder structure with two separated encoder branches is presented for this task. It extracts features from polarimetric backscattering intensities on the one hand and interferometric coherence on the other hand. Based on a joint representation of the complementary features pixel-wise classification is performed. To overcome the scarcity of labelled SAR data for training and testing, annotations are generated automatically by fusing available LULC products. Experimental evaluation is performed on high-resolution airborne SAR data, captured over the German Wadden Sea. The results demonstrate that the proposed model produces smooth and accurate classification maps. A comparison with a single-branch FCN model indicates that the appropriate integration of interferometric coherence enables the improvement of classification performance

Pol-InSAR-Island - A benchmark dataset for multi-frequency Pol-InSAR data land cover classification

This paper presents Pol-InSAR-Island, the first publicly available multi-frequency Polarimetric Interferometric Synthetic Aperture Radar (Pol-InSAR) dataset labeled with detailed land cover classes, which serves as a challenging benchmark dataset for land cover classification. In recent years, machine learning has become a powerful tool for remote sensing image analysis. While there are numerous large-scale benchmark datasets for training and evaluating machine learning models for the analysis of optical data, the availability of labeled SAR or, more specifically, Pol-InSAR data is very limited. The lack of labeled data for training, as well as for testing and comparing different approaches, hinders the rapid development of machine learning algorithms for Pol-InSAR image analysis. The Pol-InSAR-Island benchmark dataset presented in this paper aims to fill this gap. The dataset consists of Pol-InSAR data acquired in S- and L-band by DLR's airborne F-SAR system over the East Frisian island Baltrum. The interferometric image pairs are the result of a repeat-pass measurement with a time offset of several minutes. The image data are given as 6 × 6 coherency matrices in ground range on a 1 m × 1m grid. Pixel-accurate class labels, consisting of 12 different land cover classes, are generated in a semi-automatic process based on an existing biotope type map and visual interpretation of SAR and optical images. Fixed training and test subsets are defined to ensure the comparability of different approaches trained and tested prospectively on the Pol-InSAR-Island dataset. In addition to the dataset, results of supervised Wishart and Random Forest classifiers that achieve mean Intersection-over-Union scores between 24% and 67% are provided to serve as a baseline for future work. The dataset is provided via KITopenData: https://doi.org/10.35097/1700

SCHATTEN MATRIX NORM BASED POLARIMETRIC SAR DATA REGULARIZATION. APPLICATION OVER CHAMONIX MONT-BLANC

International audienceThe paper addresses the filtering of Polarimetry Synthetic Aperture Radar (PolSAR) images. The filtering strategy is based on a regularizing cost function associated with matrix norms called the Schatten p-norms. These norms apply on matrix singular values. The proposed approach is illustrated upon scattering and coherency matrices on RADARSAT-2 PolSAR images over the Chamonix Mont-Blanc site. Several p values of Schatten p-norms are surveyed and their capabilities on filtering PolSAR images is provided in comparison with conventional strategies for filtering PolSAR data

Remote Sensing of Snow Cover Using Spaceborne SAR: A Review

The importance of snow cover extent (SCE) has been proven to strongly link with various natural phenomenon and human activities; consequently, monitoring snow cover is one the most critical topics in studying and understanding the cryosphere. As snow cover can vary significantly within short time spans and often extends over vast areas, spaceborne remote sensing constitutes an efficient observation technique to track it continuously. However, as optical imagery is limited by cloud cover and polar darkness, synthetic aperture radar (SAR) attracted more attention for its ability to sense day-and-night under any cloud and weather condition. In addition to widely applied backscattering-based method, thanks to the advancements of spaceborne SAR sensors and image processing techniques, many new approaches based on interferometric SAR (InSAR) and polarimetric SAR (PolSAR) have been developed since the launch of ERS-1 in 1991 to monitor snow cover under both dry and wet snow conditions. Critical auxiliary data including DEM, land cover information, and local meteorological data have also been explored to aid the snow cover analysis. This review presents an overview of existing studies and discusses the advantages, constraints, and trajectories of the current developments

Polarimetric SAR Change Detection with the Complex Hotelling-Lawley Trace Statistic

Accepted manuscript version. Published version at http://dx.doi.org/10.1109/TGRS.2016.2532320.In this paper, we propose a new test statistic for unsupervised change detection in polarimetric radar images. We work with multilook complex covariance matrix data, whose underlying model is assumed to be the scaled complex Wishart distribution. We use the complex-kind Hotelling-Lawley trace statistic for measuring the similarity of two covariance matrices. The distribution of the Hotelling-Lawley trace statistic is ap- proximated by a Fisher-Snedecor distribution, which is used to define the significance level of a false alarm rate regulated change detector. Experiments on simulated and real PolSAR data sets demonstrate that the proposed change detection method gives detections rates and error rates that are comparable with the generalized likelihood ratio test