A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

In recent years, deep learning (DL), a re-branding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, natural language processing, etc. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV; e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should be aware of, if not at the leading edge of, of advancements like DL. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as it relates to (i) inadequate data sets, (ii) human-understandable solutions for modelling physical phenomena, (iii) Big Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote Sensin

Deep learning in remote sensing: a review

Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin

Incident and Traffic-Bottleneck Detection Algorithm in High-Resolution Remote Sensing Imagery

One  of  the  most  important  methods  to  solve  traffic  congestion  is  to detect the incident state of a roadway. This paper describes the development of a method  for  road  traffic  monitoring  aimed  at  the  acquisition  and  analysis  of remote  sensing  imagery.  We  propose  a  strategy  for  road  extraction,  vehicle detection  and incident detection  from remote sensing imagery using techniques based on neural networks, Radon transform  for angle detection and traffic-flow measurements.  Traffic-bottleneck  detection  is  another  method  that  is  proposed for recognizing incidents in both offline and real-time mode. Traffic flows and incidents are extracted from aerial images of bottleneck zones. The results show that the proposed approach has a reasonable detection performance compared to other methods. The best performance of the learning system was a detection rate of 87% and a false alarm rate of less than 18% on 45 aerial images of roadways. The performance of the traffic-bottleneck detection  method had a detection rate of 87.5%

Performance Measures to Assess Resiliency and Efficiency of Transit Systems

Transit agencies are interested in assessing the short-, mid-, and long-term performance of infrastructure with the objective of enhancing resiliency and efficiency. This report addresses three distinct aspects of New Jersey’s Transit System: 1) resiliency of bridge infrastructure, 2) resiliency of public transit systems, and 3) efficiency of transit systems with an emphasis on paratransit service. This project proposed a conceptual framework to assess the performance and resiliency for bridge structures in a transit network before and after disasters utilizing structural health monitoring (SHM), finite element (FE) modeling and remote sensing using Interferometric Synthetic Aperture Radar (InSAR). The public transit systems in NY/NJ were analyzed based on their vulnerability, resiliency, and efficiency in recovery following a major natural disaster