A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

In recent years, deep learning (DL), a re-branding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, natural language processing, etc. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV; e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should be aware of, if not at the leading edge of, of advancements like DL. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as it relates to (i) inadequate data sets, (ii) human-understandable solutions for modelling physical phenomena, (iii) Big Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote Sensin

Application Of Polarimetric SAR For Surface Parameter Inversion And Land Cover Mapping Over Agricultural Areas

In this thesis, novel methodology is developed to extract surface parameters under vegetation cover and to map crop types, from the polarimetric Synthetic Aperture Radar (PolSAR) images over agricultural areas. The extracted surface parameters provide crucial information for monitoring crop growth, nutrient release efficiency, water capacity, and crop production. To estimate surface parameters, it is essential to remove the volume scattering caused by the crop canopy, which makes developing an efficient volume scattering model very critical. In this thesis, a simplified adaptive volume scattering model (SAVSM) is developed to describe the vegetation scattering as crop changes over time through considering the probability density function of the crop orientation. The SAVSM achieved the best performance in fields of wheat, soybean and corn at various growth stages being in convert with the crop phenological development compared with current models that are mostly suitable for forest canopy. To remove the volume scattering component, in this thesis, an adaptive two-component model-based decomposition (ATCD) was developed, in which the surface scattering is a X-Bragg scattering, whereas the volume scattering is the SAVSM. The volumetric soil moisture derived from the ATCD is more consistent with the verifiable ground conditions compared with other model-based decomposition methods with its RMSE improved significantly decreasing from 19 [vol.%] to 7 [vol.%]. However, the estimation by the ATCD is biased when the measured soil moisture is greater than 30 [vol.%]. To overcome this issue, in this thesis, an integrated surface parameter inversion scheme (ISPIS) is proposed, in which a calibrated Integral Equation Model together with the SAVSM is employed. The derived soil moisture and surface roughness are more consistent with verifiable observations with the overall RMSE of 6.12 [vol.%] and 0.48, respectively

A preliminary approach to intelligent x-ray imaging for baggage inspection at airports

Identifying explosives in baggage at airports relies on being able to characterize the materials that make up an X-ray image. If a suspicion is generated during the imaging process (step 1), the image data could be enhanced by adapting the scanning parameters (step 2). This paper addresses the first part of this problem and uses textural signatures to recognize and characterize materials and hence enabling system control. Directional Gabor-type filtering was applied to a series of different X-ray images. Images were processed in such a way as to simulate a line scanning geometry. Based on our experiments with images of industrial standards and our own samples it was found that different materials could be characterized in terms of the frequency range and orientation of the filters. It was also found that the signal strength generated by the filters could be used as an indicator of visibility and optimum imaging conditions predicted

Deep learning in remote sensing: a review

Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin

Pseudo-Zernike Moments Based Sparse Representations for SAR Image Classification

We propose radar image classification via pseudo-Zernike moments based sparse representations. We exploit invariance properties of pseudo-Zernike moments to augment redundancy in the sparsity representative dictionary by introducing auxiliary atoms. We employ complex radar signatures. We prove the validity of our proposed methods on the publicly available MSTAR dataset

Investigating SAR algorithm for spaceborne interferometric oil spill detection

The environmental damages and recovery of terrestrial ecosystems from oil spills can last decades. Oil spills have been responsible for loss of aquamarine lives, organisms, trees, vegetation, birds and wildlife. Although there are several methods through which oil spills can be detected, it can be argued that remote sensing via the use of spaceborne platforms provides enormous benefits. This paper will provide more efficient means and methods that can assist in improving oil spill responses. The objective of this research is to develop a signal processing algorithm that can be used for detecting oil spills using spaceborne SAR interferometry (InSAR) data. To this end, a pendulum formation of multistatic smallSAR carrying platforms in a near equatorial orbit is described. The characteristic parameters such as the effects of incidence angles on radar backscatter, which support the detection of oil spills, will be the main drivers for determining the relative positions of the small satellites in formation. The orbit design and baseline distances between each spaceborne SAR platform will also be discussed. Furthermore, results from previous analysis on coverage assessment and revisit time shall be highlighted. Finally, an evaluation of automatic algorithm techniques for oil spill detection in SAR images will be conducted and results presented. The framework for the automatic algorithm considered consists of three major steps. The segmentation stage, where techniques that suggest the use of thresholding for dark spot segmentation within the captured InSAR image scene is conducted. The feature extraction stage involves the geometry and shape of the segmented region where elongation of the oil slick is considered an important feature and a function of the width and the length of the oil slick. For the classification stage, where the major objective is to distinguish oil spills from look-alikes, a Mahalanobis classifier will be used to estimate the probability of the extracted features being oil spills. The validation process of the algorithm will be conducted by using NASA’s UAVSAR data obtained over the Gulf of coast oil spill and RADARSAT-1 dat

RIP CURRENTS SIGNATURES ZONE DETECTION ON ALOS PALSAR IMAGE AT PARANGTRITIS BEACH, INDONESIA

Having bay and gulf morphology as cresentic beach, Parangtritis coast has been known potentiallythreat by rip currents hazard. This study aims to identify and detect breaking wavesregion and surf zone on ALOS PALSAR images, and identify and extract the cove shapeshoreline morphology of Parangtritis beach. ALOS PALSAR Fine Beam Single (FBS) HH polarizationacquired on 2nd May 2007 and 17th June 2007, off nadir angle 34.3º, and in descendingmode level 1.0 were utilized to derive amplitude information using Sigmasar. Shorelinemorphology detection showed that the cusps system has not changed much during May toJune 2007 when PALSAR images acquired, but might have shifted individually. The use ofoptical sensor with the same spatial resolution, ALOS AVNIR-2, supports to distinguish theboundary and determine the shoreline morphology of Parangtritis beach