Deep learning in remote sensing: a review

Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin

A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

In recent years, deep learning (DL), a re-branding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, natural language processing, etc. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV; e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should be aware of, if not at the leading edge of, of advancements like DL. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as it relates to (i) inadequate data sets, (ii) human-understandable solutions for modelling physical phenomena, (iii) Big Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote Sensin

A Comparison of Fixed Threshold CFAR and CNN Ship Detection Methods for S-band NovaSAR Images

NovaSAR is a commercial S-band Synthetic Aperture Radar (SAR) small satellite, built and operated by SSTL in the UK. One of its primary mission objectives is to carry out maritime surveillance and monitoring for security and defence applications. An investigation was carried out into comparing and contrasting conventional and new methods to perform automated ship detection in NovaSAR images. The outcome of this investigation could show the potential effectiveness of ship detection using spaceborne S-band SAR for Maritime Domain Awareness (MDA). The conventional approach is to apply a suitable distribution model to characterise sea surface clutter, followed by the implementation of a fixed threshold, Constant False Alarm Rate (CFAR) detection algorithm. In comparison, a RetinaNet-based convolutional neural network (CNN)solution was developed and trained on an open-source C-band dataset in order to determine the validity of applying non-native training data to S-band imagery. The detection performance was then compared with the CFAR technique, finding that for two selected test acquisitions a CNN-based ship detection algorithm was able to outperform a fixed threshold, CFAR-based method in the absence of native training data. CNN ship detection performance was further improved by applying transfer learning to a native S-band NovaSAR image dataset

A False-alarm-controllable Modified AdaBoost Wake Detection Method Using SAR Images

A false-alarm-controllable modified AdaBoost-based method is proposed for detecting ship wake from sea clutter in synthetic aperture radar (SAR) images. It reformulates the wake detection problem as a binary classification task in the multifeature space. The update strategy of the sample weights in the original AdaBoost is modified for wake detection. First, a detection result confidence factor is designed to deal with class imbalance between sea clutter and ship wake; then, the AdaBoost is further modified as a false alarm rate (FAR) controllable detector by introducing penalty parameters to adjust weights update strategies for the sea clutter. Meanwhile, the multifeature space is spanned by a novel frequency peak height ratio (FPHA) feature and four salient features. FPHA is proposed to enhance the separation between the wake and sea clutter, which is computed from the amplitude spectrum peak of the image after the Fourier transform. Experimental results show that the proposed detector can tackle the imbalanced data problem and flexibly control FAR by adjusting penalty parameters. Moreover, improved detection probability is also achieved compared with existing methods

Artificial Neural Networks and Evolutionary Computation in Remote Sensing

Artificial neural networks (ANNs) and evolutionary computation methods have been successfully applied in remote sensing applications since they offer unique advantages for the analysis of remotely-sensed images. ANNs are effective in finding underlying relationships and structures within multidimensional datasets. Thanks to new sensors, we have images with more spectral bands at higher spatial resolutions, which clearly recall big data problems. For this purpose, evolutionary algorithms become the best solution for analysis. This book includes eleven high-quality papers, selected after a careful reviewing process, addressing current remote sensing problems. In the chapters of the book, superstructural optimization was suggested for the optimal design of feedforward neural networks, CNN networks were deployed for a nanosatellite payload to select images eligible for transmission to ground, a new weight feature value convolutional neural network (WFCNN) was applied for fine remote sensing image segmentation and extracting improved land-use information, mask regional-convolutional neural networks (Mask R-CNN) was employed for extracting valley fill faces, state-of-the-art convolutional neural network (CNN)-based object detection models were applied to automatically detect airplanes and ships in VHR satellite images, a coarse-to-fine detection strategy was employed to detect ships at different sizes, and a deep quadruplet network (DQN) was proposed for hyperspectral image classification