Deep learning in remote sensing: a review

Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin

A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

In recent years, deep learning (DL), a re-branding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, natural language processing, etc. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV; e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should be aware of, if not at the leading edge of, of advancements like DL. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as it relates to (i) inadequate data sets, (ii) human-understandable solutions for modelling physical phenomena, (iii) Big Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote Sensin

Robust unsupervised small area change detection from SAR imagery using deep learning

Small area change detection using synthetic aperture radar (SAR) imagery is a highly challenging task, due to speckle noise and imbalance between classes (changed and unchanged). In this paper, a robust unsupervised approach is proposed for small area change detection using deep learning techniques. First, a multi-scale superpixel reconstruction method is developed to generate a difference image (DI), which can suppress the speckle noise effectively and enhance edges by exploiting local, spatially homogeneous information. Second, a two-stage centre-constrained fuzzy c-means clustering algorithm is proposed to divide the pixels of the DI into changed, unchanged and intermediate classes with a parallel clustering strategy. Image patches belonging to the first two classes are then constructed as pseudo-label training samples, and image patches of the intermediate class are treated as testing samples. Finally, a convolutional wavelet neural network (CWNN) is designed and trained to classify testing samples into changed or unchanged classes, coupled with a deep convolutional generative adversarial network (DCGAN) to increase the number of changed class within the pseudo-label training samples. Numerical experiments on four real SAR datasets demonstrate the validity and robustness of the proposed approach, achieving up to 99.61% accuracy for small area change detection

Computationally efficient vessel classification using shallow neural networks on SAR data

O radar de abertura sintética (SAR) ´e um radar ativo montado em uma plataforma em movimento, que simula um comprimento de antena maior do que o comprimento real da antena física. De forma semelhante ao radar convencional, ondas eletromagnéticas são transmitidas sequencialmente e os ecos são coletados pelo radar. Com o devido processamento de sinal, este tipo de sistema ´e capaz de fornecer imagens de micro-ondas de alta resolução de uma área-alvo desejada, em praticamente todas as condições meteorológicas. Atualmente, os sistemas SAR tem sido amplamente utilizados para a deteção remota possuindo várias aplicações, como observação da superfície terrestre, cartografia e aplicações militares. Dado que ´e independente do clima e pode operar tanto de dia quanto de noite, o SAR pode ser uma fonte mais confiável quando comparado com imagens ´óticas [1]. A deteção e reconhecimento de navios em imagens SAR tornou-se um tópico importante de pesquisa nos últimos anos. Esta tese apresenta um algoritmo computacionalmente eficiente para a classificação de embarcações em imagens de SAR usando Redes Neuronais com um número reduzido de camadas, também conhecidas como shallow neural networks. A utilização de shallow networks para a classificação de embarcações será dividida em duas etapas: extração de características e classificação. A extração de características tem como objetivo reduzir a carga computacional que as deep neural networks causam nos recursos computacionais, extraindo antecipadamente características-chave da imagem SAR. Os baixos requisitos computacionais tornam esta implementação compatível com sistemas a bordo de navios e aplicações em tempo real. A classificação ´e realizada usando uma rede neural com um número reduzido de camadas, que utiliza parâmetros obtidos a partir de algoritmos de extração de características para classificar a embarcação presente na imagem de radar. O processo de extração de características processa dados do conjunto de dados Open SAR ship [2] para obter várias características da embarcação, como comprimento, largura, média, desvio padrão e o número de pontos de dispersão presentes na embarcação.Synthetic aperture radar (SAR) is an active radar that is mounted on a moving platform, simulating a longer antenna length than the physical antenna real length. Similar to a conventional radar, electromagnetic waves are sequentially transmitted and the backscattered echoes are collected by the radar. With the proper signal processing, this kind of system is able to provide high resolution microwave images of a desired target area by synthesising a larger antenna aperture, in virtually all-weather conditions. Nowadays SAR systems have been extensively used for remote sensing. It has various applications such as Earth surface monitoring, charting and militar applications. Since it is weather independent and is able to operate whether it is day or night, SAR can be a more reliable source when compared with optical imagery [1]. Ship detection and recognition in SAR images has become an importante topic in research in recent years. This thesis presents a computationally eficiente algorithm for the classification of vessels in SAR images using Neural Networks (NN) with a reduced number of hidden layers, also called Shallow Neural Networks (SNN). Herein the use of SNN for vessel classification will be divided into two main steps: feature extraction and classification. Feature extraction aims to lessen the burden deep neural networks cause on computational resources by extracting key features beforehand from the SAR image. The low computational requirements make this implementation compatible with onboard vessel systems and real time applications. The classification is implemented using a SNN that uses parameters obtained from feature extraction algorithms to classify the vessel present in the radar image. In this thesis feature extraction processes data from the Open SAR Ship dataset [2] in order to obtain the vessel’s various features, such as ship length, width, mean, standard deviation and the number of scatter points present on the vessel.N/

Deep learning-based change detection in remote sensing images:a review

Images gathered from different satellites are vastly available these days due to the fast development of remote sensing (RS) technology. These images significantly enhance the data sources of change detection (CD). CD is a technique of recognizing the dissimilarities in the images acquired at distinct intervals and are used for numerous applications, such as urban area development, disaster management, land cover object identification, etc. In recent years, deep learning (DL) techniques have been used tremendously in change detection processes, where it has achieved great success because of their practical applications. Some researchers have even claimed that DL approaches outperform traditional approaches and enhance change detection accuracy. Therefore, this review focuses on deep learning techniques, such as supervised, unsupervised, and semi-supervised for different change detection datasets, such as SAR, multispectral, hyperspectral, VHR, and heterogeneous images, and their advantages and disadvantages will be highlighted. In the end, some significant challenges are discussed to understand the context of improvements in change detection datasets and deep learning models. Overall, this review will be beneficial for the future development of CD methods