Deep learning in remote sensing: a review

Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin

A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

In recent years, deep learning (DL), a re-branding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, natural language processing, etc. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV; e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should be aware of, if not at the leading edge of, of advancements like DL. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as it relates to (i) inadequate data sets, (ii) human-understandable solutions for modelling physical phenomena, (iii) Big Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote Sensin

Bayesian super-resolution with application to radar target recognition

This thesis is concerned with methods to facilitate automatic target recognition using images generated from a group of associated radar systems. Target recognition algorithms require access to a database of previously recorded or synthesized radar images for the targets of interest, or a database of features based on those images. However, the resolution of a new image acquired under non-ideal conditions may not be as good as that of the images used to generate the database. Therefore it is proposed to use super-resolution techniques to match the resolution of new images with the resolution of database images. A comprehensive review of the literature is given for super-resolution when used either on its own, or in conjunction with target recognition. A new superresolution algorithm is developed that is based on numerical Markov chain Monte Carlo Bayesian statistics. This algorithm allows uncertainty in the superresolved image to be taken into account in the target recognition process. It is shown that the Bayesian approach improves the probability of correct target classification over standard super-resolution techniques. The new super-resolution algorithm is demonstrated using a simple synthetically generated data set and is compared to other similar algorithms. A variety of effects that degrade super-resolution performance, such as defocus, are analyzed and techniques to compensate for these are presented. Performance of the super-resolution algorithm is then tested as part of a Bayesian target recognition framework using measured radar data

Information extraction and transmission techniques for spaceborne synthetic aperture radar images

Information extraction and transmission techniques for synthetic aperture radar (SAR) imagery were investigated. Four interrelated problems were addressed. An optimal tonal SAR image classification algorithm was developed and evaluated. A data compression technique was developed for SAR imagery which is simple and provides a 5:1 compression with acceptable image quality. An optimal textural edge detector was developed. Several SAR image enhancement algorithms have been proposed. The effectiveness of each algorithm was compared quantitatively

A Sensitivity Study of L-Band Synthetic Aperture Radar Measurements to the Internal Variations and Evolving Nature of Oil Slicks

This thesis focuses on the use of multi-polarization synthetic aperture radar (SAR) for characterization of marine oil spills. In particular, the potential of detecting internal zones within oil slicks in SAR scenes are investigated by a direct within-slick segmentation scheme, along with a sensitivity study of SAR measurements to the evolving nature of oil slicks. A simple, k-means clustering algorithm, along with a Gaussian Mixture Model are separately applied, giving rise to a comparative study of the internal class structures obtained by both strategies. As no optical imagery is available for verification, the within-slick segmentations are evaluated with respect to the behavior of a set of selected polarimetric features, the prevailing wind conditions and weathering processes. In addition, a fake zone detection scheme is established to help determine if the class structures obtained potentially reflect actual internal variations within the slicks. Further, the evolving nature of oil slicks is studied based on the temporal development of a set of selected geometric region descriptors. Two data sets are available for the investigation presented in this thesis, both captured by a full-polarization L-band airborne SAR system with high spatial- and temporal resolution. The results obtained with respect to the zone detection scheme developed supports the hypothesis of the existence of detectable zones within oil spills in SAR scenes. Additionally, the method established for studying the evolving nature of oil slicks is found convenient for accessing the general behavior of the slicks, and simplifies interpretation

A comparative study of operational vessel detectors for maritime surveillance using satellite-borne synthetic aperture radar

This paper presents a comparative study among four operational detectors that work by automatically post-processing synthetic aperture radar (SAR) images acquired from the satellite platforms RADARSAT-2 and COSMO-SkyMed. Challenging maritime scenarios have been chosen to assess the detectors' performance against features such as ambiguities, significant sea clutter, or irregular shorelines. The SAR images which form the test data are complemented with ground truth to define the reference detection configuration, which permits quantifying the probability of detection, the false alarm rate, and the accuracy of estimating ship dimensions. Although the results show that all the detectors perform well, there is no perfect detector, and a better detection system could be developed that combines the best elements from each of the single detectors. In addition to the comparison exercise, the study has facilitated the improvement of the detectors by highlighting weaknesses and providing means for fixing them.Peer ReviewedPostprint (published version