Deep learning in remote sensing: a review

Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin

Selection of the key earth observation sensors and platforms focusing on applications for Polar Regions in the scope of Copernicus system 2020-2030

An optimal payload selection conducted in the frame of the H2020 ONION project (id 687490) is presented based on the ability to cover the observation needs of the Copernicus system in the time period 2020–2030. Payload selection is constrained by the variables that can be measured, the power consumption, and weight of the instrument, and the required accuracy and spatial resolution (horizontal or vertical). It involved 20 measurements with observation gaps according to the user requirements that were detected in the top 10 use cases in the scope of Copernicus space infrastructure, 9 potential applied technologies, and 39 available commercial platforms. Additional Earth Observation (EO) infrastructures are proposed to reduce measurements gaps, based on a weighting system that assigned high relevance for measurements associated to Marine for Weather Forecast over Polar Regions. This study concludes with a rank and mapping of the potential technologies and the suitable commercial platforms to cover most of the requirements of the top ten use cases, analyzing the Marine for Weather Forecast, Sea Ice Monitoring, Fishing Pressure, and Agriculture and Forestry: Hydric stress as the priority use cases.Peer ReviewedPostprint (published version

A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

In recent years, deep learning (DL), a re-branding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, natural language processing, etc. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV; e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should be aware of, if not at the leading edge of, of advancements like DL. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as it relates to (i) inadequate data sets, (ii) human-understandable solutions for modelling physical phenomena, (iii) Big Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote Sensin

Linking goniometer measurements to hyperspectral and multi-sensor imagery for retrieval of beach properties and coastal characterization

In June 2011, a multi-sensor airborne remote sensing campaign was flown at the Virginia Coast Reserve Long Term Ecological Research site with coordinated ground and water calibration and validation (cal/val) measurements. Remote sensing imagery acquired during the ten day exercise included hyperspectral imagery (CASI-1500), topographic LiDAR, and thermal infra-red imagery, all simultaneously from the same aircraft. Airborne synthetic aperture radar (SAR) data acquisition for a smaller subset of sites occurred in September 2011 (VCR\u2711). Focus areas for VCR\u2711 were properties of beaches and tidal flats and barrier island vegetation and, in the water column, shallow water bathymetry. On land, cal/val emphasized tidal flat and beach grain size distributions, density, moisture content, and other geotechnical properties such as shear and bearing strength (dynamic deflection modulus), which were related to hyperspectral BRDF measurements taken with the new NRL Goniometer for Outdoor Portable Hyperspectral Earth Reflectance (GOPHER). This builds on our earlier work at this site in 2007 related to beach properties and shallow water bathymetry. A priority for VCR\u2711 was to collect and model relationships between hyperspectral imagery, acquired from the aircraft at a variety of different phase angles, and geotechnical properties of beaches and tidal flats. One aspect of this effort was a demonstration that sand density differences are observable and consistent in reflectance spectra from GOPHER data, in CASI hyperspectral imagery, as well as in hyperspectral goniometer measurements conducted in our laboratory after VCR\u2711

Learning a Dilated Residual Network for SAR Image Despeckling

In this paper, to break the limit of the traditional linear models for synthetic aperture radar (SAR) image despeckling, we propose a novel deep learning approach by learning a non-linear end-to-end mapping between the noisy and clean SAR images with a dilated residual network (SAR-DRN). SAR-DRN is based on dilated convolutions, which can both enlarge the receptive field and maintain the filter size and layer depth with a lightweight structure. In addition, skip connections and residual learning strategy are added to the despeckling model to maintain the image details and reduce the vanishing gradient problem. Compared with the traditional despeckling methods, the proposed method shows superior performance over the state-of-the-art methods on both quantitative and visual assessments, especially for strong speckle noise.Comment: 18 pages, 13 figures, 7 table

Integrating remote sensing datasets into ecological modelling: a Bayesian approach

Process-based models have been used to simulate 3-dimensional complexities of forest ecosystems and their temporal changes, but their extensive data requirement and complex parameterisation have often limited their use for practical management applications. Increasingly, information retrieved using remote sensing techniques can help in model parameterisation and data collection by providing spatially and temporally resolved forest information. In this paper, we illustrate the potential of Bayesian calibration for integrating such data sources to simulate forest production. As an example, we use the 3-PG model combined with hyperspectral, LiDAR, SAR and field-based data to simulate the growth of UK Corsican pine stands. Hyperspectral, LiDAR and SAR data are used to estimate LAI dynamics, tree height and above ground biomass, respectively, while the Bayesian calibration provides estimates of uncertainties to model parameters and outputs. The Bayesian calibration contrasts with goodness-of-fit approaches, which do not provide uncertainties to parameters and model outputs. Parameters and the data used in the calibration process are presented in the form of probability distributions, reflecting our degree of certainty about them. After the calibration, the distributions are updated. To approximate posterior distributions (of outputs and parameters), a Markov Chain Monte Carlo sampling approach is used (25 000 steps). A sensitivity analysis is also conducted between parameters and outputs. Overall, the results illustrate the potential of a Bayesian framework for truly integrative work, both in the consideration of field-based and remotely sensed datasets available and in estimating parameter and model output uncertainties