Deep learning in remote sensing: a review

Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin

A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

In recent years, deep learning (DL), a re-branding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, natural language processing, etc. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV; e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should be aware of, if not at the leading edge of, of advancements like DL. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as it relates to (i) inadequate data sets, (ii) human-understandable solutions for modelling physical phenomena, (iii) Big Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote Sensin

Key Issues in the Analysis of Remote Sensing Data: A report on the workshop

The procedures of a workshop assessing the state of the art of machine analysis of remotely sensed data are summarized. Areas discussed were: data bases, image registration, image preprocessing operations, map oriented considerations, advanced digital systems, artificial intelligence methods, image classification, and improved classifier training. Recommendations of areas for further research are presented

Evaluation of Landsat-8 and Sentinel-2A Aerosol Optical Depth Retrievals Across Chinese Cities and Implications for Medium Spatial Resolution Urban Aerosol Monitoring

In urban environments, aerosol distributions may change rapidly due to building and transport infrastructure and human population density variations. The recent availability of medium resolution Landsat-8 and Sentinel-2 satellite data provide the opportunity for aerosol optical depth (AOD) estimation at higher spatial resolution than provided by other satellites. AOD retrieved from 30 m Landsat-8 and 10 m Sentinel-2A data using the Land Surface Reflectance Code (LaSRC) were compared with coincident ground-based Aerosol Robotic Network (AERONET) Version 3 AOD data for 20 Chinese cities in 2016. Stringent selection criteria were used to select contemporaneous data; only satellite and AERONET data acquired within 10 min were considered. The average satellite retrieved AOD over a 1470 m1470 m window centered on each AERONET site was derived to capture fine scale urban AOD variations. AERONET Level 1.5 (cloud-screened) and Level 2.0 (cloud-screened and also quality assured) data were considered. For the 20 urban AERONET sites in 2016 there were 106 (Level 1.5) and 67 (Level 2.0) Landsat-8 AERONET AOD contemporaneous data pairs, and 118 (Level 1.5) and 89 (Level 2.0) Sentinel-2A AOD data pairs. The greatest AOD values (>1.5) occurred in Beijing, suggesting that the Chinese capital was one of the most polluted cities in China in 2016. The LaSRC Landsat-8 and Sentinel-2A AOD retrievals agreed well with the AERONET AOD data (linear regression slopes > 0.96; coefficient of determination r(exp 2) > 0.90; root mean square deviation < 0.175) and demonstrate that the LaSRC is an effective and applicable medium resolution AOD retrieval algorithm over urban environments. The Sentinel-2A AOD retrievals had better accuracy than the Landsat-8 AOD retrievals, which is consistent with previously published research.The implications of the research and the potential for urban aerosol monitoring by combining the freely available Landsat-8 and Sentinel-2 satellite data are discussed