Review on Active and Passive Remote Sensing Techniques for Road Extraction

Digital maps of road networks are a vital part of digital cities and intelligent transportation. In this paper, we provide a comprehensive review on road extraction based on various remote sensing data sources, including high-resolution images, hyperspectral images, synthetic aperture radar images, and light detection and ranging. This review is divided into three parts. Part 1 provides an overview of the existing data acquisition techniques for road extraction, including data acquisition methods, typical sensors, application status, and prospects. Part 2 underlines the main road extraction methods based on four data sources. In this section, road extraction methods based on different data sources are described and analysed in detail. Part 3 presents the combined application of multisource data for road extraction. Evidently, different data acquisition techniques have unique advantages, and the combination of multiple sources can improve the accuracy of road extraction. The main aim of this review is to provide a comprehensive reference for research on existing road extraction technologies.Peer reviewe

Mapping three-dimensional geological features from remotely-sensed images and digital elevation models.

Accurate mapping of geological structures is important in numerous applications, ranging from mineral exploration through to hydrogeological modelling. Remotely sensed data can provide synoptic views of study areas enabling mapping of geological units within the area. Structural information may be derived from such data using standard manual photo-geologic interpretation techniques, although these are often inaccurate and incomplete. The aim of this thesis is, therefore, to compile a suite of automated and interactive computer-based analysis routines, designed to help a the user map geological structure. These are examined and integrated in the context of an expert system. The data used in this study include Digital Elevation Model (DEM) and Airborne Thematic Mapper images, both with a spatial resolution of 5m, for a 5 x 5 km area surrounding Llyn Cow lyd, Snowdonia, North Wales. The geology of this area comprises folded and faulted Ordo vician sediments intruded throughout by dolerite sills, providing a stringent test for the automated and semi-automated procedures. The DEM is used to highlight geomorphological features which may represent surface expressions of the sub-surface geology. The DEM is created from digitized contours, for which kriging is found to provide the best interpolation routine, based on a number of quantitative measures. Lambertian shading and the creation of slope and change of slope datasets are shown to provide the most successful enhancement of DEMs, in terms of highlighting a range of key geomorphological features. The digital image data are used to identify rock outcrops as well as lithologically controlled features in the land cover. To this end, a series of standard spectral enhancements of the images is examined. In this respect, the least correlated 3 band composite and a principal component composite are shown to give the best visual discrimination of geological and vegetation cover types. Automatic edge detection (followed by line thinning and extraction) and manual interpretation techniques are used to identify a set of 'geological primitives' (linear or arc features representing lithological boundaries) within these data. Inclusion of the DEM data provides the three-dimensional co-ordinates of these primitives enabling a least-squares fit to be employed to calculate dip and strike values, based, initially, on the assumption of a simple, linearly dipping structural model. A very large number of scene 'primitives' is identified using these procedures, only some of which have geological significance. Knowledge-based rules are therefore used to identify the relevant. For example, rules are developed to identify lake edges, forest boundaries, forest tracks, rock-vegetation boundaries, and areas of geomorphological interest. Confidence in the geological significance of some of the geological primitives is increased where they are found independently in both the DEM and remotely sensed data. The dip and strike values derived in this way are compared to information taken from the published geological map for this area, as well as measurements taken in the field. Many results are shown to correspond closely to those taken from the map and in the field, with an error of < 1°. These data and rules are incorporated into an expert system which, initially, produces a simple model of the geological structure. The system also provides a graphical user interface for manual control and interpretation, where necessary. Although the system currently only allows a relatively simple structural model (linearly dipping with faulting), in the future it will be possible to extend the system to model more complex features, such as anticlines, synclines, thrusts, nappes, and igneous intrusions

Hyperspectral Image Analysis through Unsupervised Deep Learning

Hyperspectral image (HSI) analysis has become an active research area in computer vision field with a wide range of applications. However, in order to yield better recognition and analysis results, we need to address two challenging issues of HSI, i.e., the existence of mixed pixels and its significantly low spatial resolution (LR). In this dissertation, spectral unmixing (SU) and hyperspectral image super-resolution (HSI-SR) approaches are developed to address these two issues with advanced deep learning models in an unsupervised fashion. A specific application, anomaly detection, is also studied, to show the importance of SU.Although deep learning has achieved the state-of-the-art performance on supervised problems, its practice on unsupervised problems has not been fully developed. To address the problem of SU, an untied denoising autoencoder is proposed to decompose the HSI into endmembers and abundances with non-negative and abundance sum-to-one constraints. The denoising capacity is incorporated into the network with a sparsity constraint to boost the performance of endmember extraction and abundance estimation.Moreover, the first attempt is made to solve the problem of HSI-SR using an unsupervised encoder-decoder architecture by fusing the LR HSI with the high-resolution multispectral image (MSI). The architecture is composed of two encoder-decoder networks, coupled through a shared decoder, to preserve the rich spectral information from the HSI network. It encourages the representations from both modalities to follow a sparse Dirichlet distribution which naturally incorporates the two physical constraints of HSI and MSI. And the angular difference between representations are minimized to reduce the spectral distortion.Finally, a novel detection algorithm is proposed through spectral unmixing and dictionary based low-rank decomposition, where the dictionary is constructed with mean-shift clustering and the coefficients of the dictionary is encouraged to be low-rank. Experimental evaluations show significant improvement on the performance of anomaly detection conducted on the abundances (through SU).The effectiveness of the proposed approaches has been evaluated thoroughly by extensive experiments, to achieve the state-of-the-art results

SMART ADDITIVE MANUFACTURING: IN-PROCESS SENSING AND DATA ANALYTICS FOR ONLINE DEFECT DETECTION IN METAL ADDITIVE MANUFACTURING PROCESSES

The goal of this dissertation is to detect the incipient flaws in metal parts made using additive manufacturing processes (3D printing). The key idea is to embed sensors inside a 3D printing machine and conclude whether there are defects in the part as it is being built by analyzing the sensor data using artificial intelligence (machine learning). This is an important area of research, because, despite their revolutionary potential, additive manufacturing processes are yet to find wider acceptance in safety-critical industries, such as aerospace and biomedical, given their propensity to form defects. The presence of defects, such as porosity, can afflict as much as 20% of additive manufactured parts. This poor process consistency necessitates an approach wherein flaws are not only detected but also promptly corrected inside the machine. This dissertation takes the critical step in addressing the first of the above, i.e., detection of flaws using in-process sensor signatures. Accordingly, the objective of this work is to develop and apply a new class of machine learning algorithms motivated from the domain of spectral graph theory to analyze the in-process sensor data, and subsequently, detect the formation of part defects. Defects in additive manufacturing originate due to four main reasons, namely, material, process parameters, part design, and machine kinematics. In this work, the efficacy of the graph theoretic approach is determined to detect defects that occur in all the above four contexts. As an example, in Chapter 4, flaws such as lack-of-fusion porosity due to poor choice of process parameters in additive manufacturing are identified with statistical accuracy exceeding 80%. As a comparison, the accuracy of existing conventional statistical methods is less than 65%. Advisor: Prahalada Ra

SMART ADDITIVE MANUFACTURING: IN-PROCESS SENSING AND DATA ANALYTICS FOR ONLINE DEFECT DETECTION IN METAL ADDITIVE MANUFACTURING PROCESSES

The goal of this dissertation is to detect the incipient flaws in metal parts made using additive manufacturing processes (3D printing). The key idea is to embed sensors inside a 3D printing machine and conclude whether there are defects in the part as it is being built by analyzing the sensor data using artificial intelligence (machine learning). This is an important area of research, because, despite their revolutionary potential, additive manufacturing processes are yet to find wider acceptance in safety-critical industries, such as aerospace and biomedical, given their propensity to form defects. The presence of defects, such as porosity, can afflict as much as 20% of additive manufactured parts. This poor process consistency necessitates an approach wherein flaws are not only detected but also promptly corrected inside the machine. This dissertation takes the critical step in addressing the first of the above, i.e., detection of flaws using in-process sensor signatures. Accordingly, the objective of this work is to develop and apply a new class of machine learning algorithms motivated from the domain of spectral graph theory to analyze the in-process sensor data, and subsequently, detect the formation of part defects. Defects in additive manufacturing originate due to four main reasons, namely, material, process parameters, part design, and machine kinematics. In this work, the efficacy of the graph theoretic approach is determined to detect defects that occur in all the above four contexts. As an example, in Chapter 4, flaws such as lack-of-fusion porosity due to poor choice of process parameters in additive manufacturing are identified with statistical accuracy exceeding 80%. As a comparison, the accuracy of existing conventional statistical methods is less than 65%. Advisor: Prahalada Ra

Fine Art Pattern Extraction and Recognition

This is a reprint of articles from the Special Issue published online in the open access journal Journal of Imaging (ISSN 2313-433X) (available at: https://www.mdpi.com/journal/jimaging/special issues/faper2020)

Information Extraction and Modeling from Remote Sensing Images: Application to the Enhancement of Digital Elevation Models

To deal with high complexity data such as remote sensing images presenting metric resolution over large areas, an innovative, fast and robust image processing system is presented. The modeling of increasing level of information is used to extract, represent and link image features to semantic content. The potential of the proposed techniques is demonstrated with an application to enhance and regularize digital elevation models based on information collected from RS images

LIDAR based semi-automatic pattern recognition within an archaeological landscape

LIDAR-Daten bieten einen neuartigen Ansatz zur Lokalisierung und Überwachung des kulturellen Erbes in der Landschaft, insbesondere in schwierig zu erreichenden Gebieten, wie im Wald, im unwegsamen Gelände oder in sehr abgelegenen Gebieten. Die manuelle Lokalisation und Kartierung von archäologischen Informationen einer Kulturlandschaft ist in der herkömmlichen Herangehensweise eine sehr zeitaufwändige Aufgabe des Fundstellenmanagements (Cultural Heritage Management). Um die Möglichkeiten in der Erkennung und bei der Verwaltung des kulturellem Erbes zu verbessern und zu ergänzen, können computergestützte Verfahren einige neue Lösungsansätze bieten, die darüber hinaus sogar die Identifizierung von für das menschliche Auge bei visueller Sichtung nicht erkennbaren Details ermöglichen. Aus archäologischer Sicht ist die vorliegende Dissertation dadurch motiviert, dass sie LIDAR-Geländemodelle mit archäologischen Befunden durch automatisierte und semiautomatisierte Methoden zur Identifizierung weiterer archäologischer Muster zu Bodendenkmalen als digitale „LIDAR-Landschaft“ bewertet. Dabei wird auf möglichst einfache und freie verfügbare algorithmische Ansätze (Open Source) aus der Bildmustererkennung und Computer Vision zur Segmentierung und Klassifizierung der LIDAR-Landschaften zur großflächigen Erkennung archäologischer Denkmäler zurückgegriffen. Die Dissertation gibt dabei einen umfassenden Überblick über die archäologische Nutzung und das Potential von LIDAR-Daten und definiert anhand qualitativer und quantitativer Ansätze den Entwicklungsstand der semiautomatisierten Erkennung archäologischer Strukturen im Rahmen archäologischer Prospektion und Fernerkundungen. Darüber hinaus erläutert sie Best Practice-Beispiele und den einhergehenden aktuellen Forschungsstand. Und sie veranschaulicht die Qualität der Erkennung von Bodendenkmälern durch die semiautomatisierte Segmentierung und Klassifizierung visualisierter LIDAR-Daten. Letztlich identifiziert sie das Feld für weitere Anwendungen, wobei durch eigene, algorithmische Template Matching-Verfahren großflächige Untersuchungen zum kulturellen Erbe ermöglicht werden. Resümierend vergleicht sie die analoge und computergestützte Bildmustererkennung zu Bodendenkmalen, und diskutiert abschließend das weitere Potential LIDAR-basierter Mustererkennung in archäologischen Kulturlandschaften