A phase field model incorporating generic and specific prior knowledge applied to road network extraction from VHR satellite images.

We address the problem of updating road maps in dense urban areas by extracting the main road network from a very high resolution (VHR) satellite image. Our model of the region occupied by the road network in the image is innovative. It incorporates three different types of prior geometric knowledge: generic boundary smoothness constraints, equivalent to a standard active contour prior; knowledge of the geometric properties of road networks (i.e. that they occupy regions composed of long, low-curvature segments joined at junctions), equivalent to a higher-order active contour prior; and knowledge of the road network at an earlier date derived from GIS data, similar to other ‘shape priors’ in the literature. In addition, we represent the road network region as a ‘phase field’, which offers a number of important advantages over other region modelling frameworks. All three types of prior knowledge prove important for overcoming the complexity of geometric ‘noise’ in VHR images. Promising results and a comparison with several other techniques demonstrate the effectiveness of our approach

A Phase Field Model Incorporating Generic and Specific Prior Knowledge Applied to Road Network Extraction from VHR Satellite Images

We address the problem of updating road maps in dense urban areas by extracting the main road network from a very high resolution (VHR) satellite image. Our model of the region occupied by the road network in the image is innovative. It incorporates three different types of prior geometric knowledge: generic boundary smoothness constraints, equivalent to a standard active contour prior; knowledge of the geometric properties of road networks (i.e. that they occupy regions composed of long, low-curvature segments joined at junctions), equivalent to a higher-order active contour prior; and knowledge of the road network at an earlier date derived from GIS data, similar to other ‘shape priors’ in the literature. In addition, we represent the road network region as a ‘phase field’, which offers a number of important advantages over other region modelling frameworks. All three types of prior knowledge prove important for overcoming the complexity of geometric ‘noise’ in VHR images. Promising results and a comparison with several other techniques demonstrate the effectiveness of our approach

Extraction of main and secondary roads in VHR images using a higher-order phase field model.

This paper addresses the issue of extracting main and secondary road networks in dense urban areas from very high resolution (VHR, ~0.61m) satellite images. The difficulty with secondary roads lies in the low discriminative power of the grey-level distributions of road regions and the background, and the greater effect of occlusions and other noise on narrower roads. To tackle this problem, we use a previously developed higher-order active contour (HOAC) phase field model and augment it with an additional non-linear non-local term. The additional term allows separate control of road width and road curvature; thus more precise prior knowledge can be incorporated, and better road prolongation can be achieved for the same width. Promising results on QuickBird panchromatic images at reduced resolutions and comparisons with other models demonstrate the role and the efficiency of our new model

Combining Multiple Algorithms for Road Network Tracking from Multiple Source Remotely Sensed Imagery: a Practical System and Performance Evaluation

In light of the increasing availability of commercial high-resolution imaging sensors, automatic interpretation tools are needed to extract road features. Currently, many approaches for road extraction are available, but it is acknowledged that there is no single method that would be successful in extracting all types of roads from any remotely sensed imagery. In this paper, a novel classification of roads is proposed, based on both the roads' geometrical, radiometric properties and the characteristics of the sensors. Subsequently, a general road tracking framework is proposed, and one or more suitable road trackers are designed or combined for each type of roads. Extensive experiments are performed to extract roads from aerial/satellite imagery, and the results show that a combination strategy can automatically extract more than 60% of the total roads from very high resolution imagery such as QuickBird and DMC images, with a time-saving of approximately 20%, and acceptable spatial accuracy. It is proven that a combination of multiple algorithms is more reliable, more efficient and more robust for extracting road networks from multiple-source remotely sensed imagery than the individual algorithms

Remote Sensing Object Detection Meets Deep Learning: A Meta-review of Challenges and Advances

Remote sensing object detection (RSOD), one of the most fundamental and challenging tasks in the remote sensing field, has received longstanding attention. In recent years, deep learning techniques have demonstrated robust feature representation capabilities and led to a big leap in the development of RSOD techniques. In this era of rapid technical evolution, this review aims to present a comprehensive review of the recent achievements in deep learning based RSOD methods. More than 300 papers are covered in this review. We identify five main challenges in RSOD, including multi-scale object detection, rotated object detection, weak object detection, tiny object detection, and object detection with limited supervision, and systematically review the corresponding methods developed in a hierarchical division manner. We also review the widely used benchmark datasets and evaluation metrics within the field of RSOD, as well as the application scenarios for RSOD. Future research directions are provided for further promoting the research in RSOD.Comment: Accepted with IEEE Geoscience and Remote Sensing Magazine. More than 300 papers relevant to the RSOD filed were reviewed in this surve

A review of technical factors to consider when designing neural networks for semantic segmentation of Earth Observation imagery

Semantic segmentation (classification) of Earth Observation imagery is a crucial task in remote sensing. This paper presents a comprehensive review of technical factors to consider when designing neural networks for this purpose. The review focuses on Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), Generative Adversarial Networks (GANs), and transformer models, discussing prominent design patterns for these ANN families and their implications for semantic segmentation. Common pre-processing techniques for ensuring optimal data preparation are also covered. These include methods for image normalization and chipping, as well as strategies for addressing data imbalance in training samples, and techniques for overcoming limited data, including augmentation techniques, transfer learning, and domain adaptation. By encompassing both the technical aspects of neural network design and the data-related considerations, this review provides researchers and practitioners with a comprehensive and up-to-date understanding of the factors involved in designing effective neural networks for semantic segmentation of Earth Observation imagery.Comment: 145 pages with 32 figure

Robust Modular Feature-Based Terrain-Aided Visual Navigation and Mapping

The visual feature-based Terrain-Aided Navigation (TAN) system presented in this thesis addresses the problem of constraining inertial drift introduced into the location estimate of Unmanned Aerial Vehicles (UAVs) in GPS-denied environment. The presented TAN system utilises salient visual features representing semantic or human-interpretable objects (roads, forest and water boundaries) from onboard aerial imagery and associates them to a database of reference features created a-priori, through application of the same feature detection algorithms to satellite imagery. Correlation of the detected features with the reference features via a series of the robust data association steps allows a localisation solution to be achieved with a finite absolute bound precision defined by the certainty of the reference dataset. The feature-based Visual Navigation System (VNS) presented in this thesis was originally developed for a navigation application using simulated multi-year satellite image datasets. The extension of the system application into the mapping domain, in turn, has been based on the real (not simulated) flight data and imagery. In the mapping study the full potential of the system, being a versatile tool for enhancing the accuracy of the information derived from the aerial imagery has been demonstrated. Not only have the visual features, such as road networks, shorelines and water bodies, been used to obtain a position ’fix’, they have also been used in reverse for accurate mapping of vehicles detected on the roads into an inertial space with improved precision. Combined correction of the geo-coding errors and improved aircraft localisation formed a robust solution to the defense mapping application. A system of the proposed design will provide a complete independent navigation solution to an autonomous UAV and additionally give it object tracking capability

A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

In recent years, deep learning (DL), a re-branding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, natural language processing, etc. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV; e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should be aware of, if not at the leading edge of, of advancements like DL. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as it relates to (i) inadequate data sets, (ii) human-understandable solutions for modelling physical phenomena, (iii) Big Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote Sensin