A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

In recent years, deep learning (DL), a re-branding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, natural language processing, etc. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV; e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should be aware of, if not at the leading edge of, of advancements like DL. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as it relates to (i) inadequate data sets, (ii) human-understandable solutions for modelling physical phenomena, (iii) Big Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote Sensin

Deep learning in remote sensing: a review

Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin

Exploiting Sentinel-1 amplitude data for glacier surface velocity field measurements. Feasibility demonstration on baltoro glacier

The leading idea of this work is to continuously retrieve glaciers surface velocity through SAR imagery, in particular using the amplitude data from the new ESA satellite sensor Sentinel-1 imagery. These imagery key aspects are the free access policy, the very short revisit time (down to 6 days with the launch of the Sentinel-1B satellite) and the high amplitude resolution (up to 5 m). In order to verify the reliability of the proposed approach, a first experiment has been performed using Sentinel-1 imagery acquired over the Karakoram mountain range (North Pakistan) and Baltoro and other three glaciers have been investigated. During this study, a stack of 11 images acquired in the period from October 2014 to September 2015 has been used in order to investigate the potentialities of the Sentinel-1 SAR sensor to retrieve the glacier surface velocity every month. The aim of this test was to measure the glacier surface velocity between each subsequent pair, in order to produce a time series of the surface velocity fields along the investigated period. The necessary co-registration procedure between the images has been performed and subsequently the glaciers areas have been sampled using a regular grid with a 250 × 250 meters posting. Finally the surface velocity field has been estimated, for each image pair, using a template matching procedure, and an outlier filtering procedure based on the signal to noise ratio values has been applied, in order to exclude from the analysis unreliable points. The achieved velocity values range from 10 to 25 meters/month and they are coherent to those obtained in previous studies carried out on the same glaciers and the results highlight that it is possible to have a continuous update of the glacier surface velocity field through free Sentinel-1 imagery, that could be very useful to investigate the seasonal effects on the glaciers fluid-dynamics

Minimizing the residual topography effect on interferograms to improve DInSAR results: estimating land subsidence in Port-Said City, Egypt

The accurate detection of land subsidence rates in urban areas is important to identify damage-prone areas and provide decision-makers with useful information. Meanwhile, no precise measurements of land subsidence have been undertaken within the coastal Port-Said City in Egypt to evaluate its hazard in relationship to sea-level rise. In order to address this shortcoming, this work introduces and evaluates a methodology that substantially improves small subsidence rate estimations in an urban setting. Eight ALOS/PALSAR-1 scenes were used to estimate the land subsidence rates in Port-Said City, using the Small BAse line Subset (SBAS) DInSAR technique. A stereo pair of ALOS/PRISM was used to generate an accurate DEM to minimize the residual topography effect on the generated interferograms. A total of 347 well distributed ground control points (GCP) were collected in Port-Said City using the leveling instrument to calibrate the generated DEM. Moreover, the eight PALSAR scenes were co-registered using 50 well-distributed GCPs and used to generate 22 interferogram pairs. These PALSAR interferograms were subsequently filtered and used together with the coherence data to calculate the phase unwrapping. The phase-unwrapped interferogram-pairs were then evaluated to discard four interferograms that were affected by phase jumps and phase ramps. Results confirmed that using an accurate DEM (ALOS/PRISM) was essential for accurately detecting small deformations. The vertical displacement rate during the investigated period (2007–2010) was estimated to be −28 mm. The results further indicate that the northern area of Port-Said City has been subjected to higher land subsidence rates compared to the southern area. Such land subsidence rates might induce significant environmental changes with respect to sea-level rise

Deep learning-based change detection in remote sensing images:a review

Images gathered from different satellites are vastly available these days due to the fast development of remote sensing (RS) technology. These images significantly enhance the data sources of change detection (CD). CD is a technique of recognizing the dissimilarities in the images acquired at distinct intervals and are used for numerous applications, such as urban area development, disaster management, land cover object identification, etc. In recent years, deep learning (DL) techniques have been used tremendously in change detection processes, where it has achieved great success because of their practical applications. Some researchers have even claimed that DL approaches outperform traditional approaches and enhance change detection accuracy. Therefore, this review focuses on deep learning techniques, such as supervised, unsupervised, and semi-supervised for different change detection datasets, such as SAR, multispectral, hyperspectral, VHR, and heterogeneous images, and their advantages and disadvantages will be highlighted. In the end, some significant challenges are discussed to understand the context of improvements in change detection datasets and deep learning models. Overall, this review will be beneficial for the future development of CD methods

Review on Active and Passive Remote Sensing Techniques for Road Extraction

Digital maps of road networks are a vital part of digital cities and intelligent transportation. In this paper, we provide a comprehensive review on road extraction based on various remote sensing data sources, including high-resolution images, hyperspectral images, synthetic aperture radar images, and light detection and ranging. This review is divided into three parts. Part 1 provides an overview of the existing data acquisition techniques for road extraction, including data acquisition methods, typical sensors, application status, and prospects. Part 2 underlines the main road extraction methods based on four data sources. In this section, road extraction methods based on different data sources are described and analysed in detail. Part 3 presents the combined application of multisource data for road extraction. Evidently, different data acquisition techniques have unique advantages, and the combination of multiple sources can improve the accuracy of road extraction. The main aim of this review is to provide a comprehensive reference for research on existing road extraction technologies.Peer reviewe