Clearing the Clouds: Extracting 3D information from amongst the noise

Advancements permitting the rapid extraction of 3D point clouds from a variety of imaging modalities across the global landscape have provided a vast collection of high fidelity digital surface models. This has created a situation with unprecedented overabundance of 3D observations which greatly outstrips our current capacity to manage and infer actionable information. While years of research have removed some of the manual analysis burden for many tasks, human analysis is still a cornerstone of 3D scene exploitation. This is especially true for complex tasks which necessitate comprehension of scale, texture and contextual learning. In order to ameliorate the interpretation burden and enable scientific discovery from this volume of data, new processing paradigms are necessary to keep pace. With this context, this dissertation advances fundamental and applied research in 3D point cloud data pre-processing and deep learning from a variety of platforms. We show that the representation of 3D point data is often not ideal and sacrifices fidelity, context or scalability. First ground scanning terrestrial LIght Detection And Ranging (LiDAR) models are shown to have an inherent statistical bias, and present a state of the art method for correcting this, while preserving data fidelity and maintaining semantic structure. This technique is assessed in the dense canopy of Micronesia, with our technique being the best at retaining high levels of detail under extreme down-sampling (\u3c 1%). Airborne systems are then explored with a method which is presented to pre-process data to preserve a global contrast and semantic content in deep learners. This approach is validated with a building footprint detection task from airborne imagery captured in Eastern TN from the 3D Elevation Program (3DEP), our approach was found to achieve significant accuracy improvements over traditional techniques. Finally, topography data spanning the globe is used to assess past and previous global land cover change. Utilizing Shuttle Radar Topography Mission (SRTM) and Moderate Resolution Imaging Spectroradiometer (MODIS) data, paired with the airborne preprocessing technique described previously, a model for predicting land-cover change from topography observations is described. The culmination of these efforts have the potential to enhance the capabilities of automated 3D geospatial processing, substantially lightening the burden of analysts, with implications improving our responses to global security, disaster response, climate change, structural design and extraplanetary exploration

Image Registration Workshop Proceedings

Automatic image registration has often been considered as a preliminary step for higher-level processing, such as object recognition or data fusion. But with the unprecedented amounts of data which are being and will continue to be generated by newly developed sensors, the very topic of automatic image registration has become and important research topic. This workshop presents a collection of very high quality work which has been grouped in four main areas: (1) theoretical aspects of image registration; (2) applications to satellite imagery; (3) applications to medical imagery; and (4) image registration for computer vision research

Visual Techniques for Geological Fieldwork Using Mobile Devices

Visual techniques in general and 3D visualisation in particular have seen considerable adoption within the last 30 years in the geosciences and geology. Techniques such as volume visualisation, for analysing subsurface processes, and photo-coloured LiDAR point-based rendering, to digitally explore rock exposures at the earth’s surface, were applied within geology as one of the first adopting branches of science. A large amount of digital, geological surface- and volume data is nowadays available to desktop-based workflows for geological applications such as hydrocarbon reservoir exploration, groundwater modelling, CO2 sequestration and, in the future, geothermal energy planning. On the other hand, the analysis and data collection during fieldwork has yet to embrace this ”digital revolution”: sedimentary logs, geological maps and stratigraphic sketches are still captured in each geologist’s individual fieldbook, and physical rocks samples are still transported to the lab for subsequent analysis. Is this still necessary, or are there extended digital means of data collection and exploration in the field ? Are modern digital interpretation techniques accurate and intuitive enough to relevantly support fieldwork in geology and other geoscience disciplines ? This dissertation aims to address these questions and, by doing so, close the technological gap between geological fieldwork and office workflows in geology. The emergence of mobile devices and their vast array of physical sensors, combined with touch-based user interfaces, high-resolution screens and digital cameras provide a possible digital platform that can be used by field geologists. Their ubiquitous availability increases the chances to adopt digital workflows in the field without additional, expensive equipment. The use of 3D data on mobile devices in the field is furthered by the availability of 3D digital outcrop models and the increasing ease of their acquisition. This dissertation assesses the prospects of adopting 3D visual techniques and mobile devices within field geology. The research of this dissertation uses previously acquired and processed digital outcrop models in the form of textured surfaces from optical remote sensing and photogrammetry. The scientific papers in this thesis present visual techniques and algorithms to map outcrop photographs in the field directly onto the surface models. Automatic mapping allows the projection of photo interpretations of stratigraphy and sedimentary facies on the 3D textured surface while providing the domain expert with simple-touse, intuitive tools for the photo interpretation itself. The developed visual approach, combining insight from all across the computer sciences dealing with visual information, merits into the mobile device Geological Registration and Interpretation Toolset (GRIT) app, which is assessed on an outcrop analogue study of the Saltwick Formation exposed at Whitby, North Yorkshire, UK. Although being applicable to a diversity of study scenarios within petroleum geology and the geosciences, the particular target application of the visual techniques is to easily provide field-based outcrop interpretations for subsequent construction of training images for multiple point statistics reservoir modelling, as envisaged within the VOM2MPS project. Despite the success and applicability of the visual approach, numerous drawbacks and probable future extensions are discussed in the thesis based on the conducted studies. Apart from elaborating on more obvious limitations originating from the use of mobile devices and their limited computing capabilities and sensor accuracies, a major contribution of this thesis is the careful analysis of conceptual drawbacks of established procedures in modelling, representing, constructing and disseminating the available surface geometry. A more mathematically-accurate geometric description of the underlying algebraic surfaces yields improvements and future applications unaddressed within the literature of geology and the computational geosciences to this date. Also, future extensions to the visual techniques proposed in this thesis allow for expanded analysis, 3D exploration and improved geological subsurface modelling in general.publishedVersio

Application of Multi-Sensor Fusion Technology in Target Detection and Recognition

Application of multi-sensor fusion technology has drawn a lot of industrial and academic interest in recent years. The multi-sensor fusion methods are widely used in many applications, such as autonomous systems, remote sensing, video surveillance, and the military. These methods can obtain the complementary properties of targets by considering multiple sensors. On the other hand, they can achieve a detailed environment description and accurate detection of interest targets based on the information from different sensors.This book collects novel developments in the field of multi-sensor, multi-source, and multi-process information fusion. Articles are expected to emphasize one or more of the three facets: architectures, algorithms, and applications. Published papers dealing with fundamental theoretical analyses, as well as those demonstrating their application to real-world problems

Analyzing spatial patterns and dynamics of landscapes and ecosystem services – Exploring fine-scale data and indicators

In den vergangenen Jahrzehnten hat der Einfluss des Menschen auf Ökosysteme stark zugenommen. Tendenzen der Landnutzungsänderung, darunter die Ausdehnung von Städten und die Intensivierung der Landwirtschaft als Folge des Bevölkerungsanstiegs und damit des Nahrungsmittel- und Energiebedarfs, führen zu Umweltproblemen wie dem Verlust von Lebensraum und biologischer Vielfalt. Die zunehmende Verfügbarkeit von Daten mit feiner räumlicher Auflösung kann die Analyse von Merkmalen und Prozessen in Landschaften mit Hilfe von räumlichen Metriken unterstützen. Das Ziel dieser Arbeit ist es, feinskalige Daten und räumliche Metriken zu integrieren, um Indikatoren zur Messung und Bewertung von Landnutzung, Ökosystemdienstleistungen und deren räumlichen Mustern zu entwickeln und folgende Fragen zu beantworten: Wie können Landnutzungsänderungen und Ökosystemleistungen einer Landschaft beschrieben und analysiert werden? Und, wie kann die Landschaftsperspektive zu unserem Verständnis von Landsystemen beitragen? In zwei verschiedenen Weltregionen werden Landschaften mit Hilfe von Hexagonen als räumliche Einheiten untersucht. Diese dienen zur Analyse von räumlichen Mustern und Beziehungen zwischen verschiedenen Indikatoren (z. B. Ökosystemdienstleistungen) und die Konzeptualisierung von Prozessen auf Landschaftsebene. Obwohl sich einige Phänomene auf feinen räumlichen Skalen manifestieren, ist es für die Operationalisierung und Überwachung dieser Prozesse notwendig, ‚herauszuzoomen‘. Der Landschaftsansatz im Zusammenhang mit Ökosystemleistungen bietet wichtige Perspektiven im Hinblick auf Umweltauswirkungen, die durch Landnutzungsänderungen verursacht werden. Dabei können Indikatoren, die die ökologische, ökonomische und soziale Dimension verknüpfen, dazu beitragen, regionalspezifisches Wissen über Landschaftsdynamiken zu erlangen und dieses Wissen an Entscheidungsträger weiterzugeben, um gezielte Maßnahmen für ein nachhaltiges Landmanagement zu entwickeln.Over the last decades, anthropogenic pressures on ecosystems have been increasing. Trends of land use change including urban expansion and agricultural intensification driven by population increase, and hence food and energy demand, cause environmental challenges including habitat and biodiversity loss. Analyzing major trends of land use change requires additional metrics to capture local processes on a landscape spatial scale. Increasing fine-scale data availability can support analyses of characteristics and processes of landscapes with the help of spatial metrics, e.g. distance or density measures. The aims of this thesis are to incorporate fine-scale data and spatial metrics to develop indicators to measure and assess land-use, ecosystem services (ESS) and their spatial patterns to answer the following questions: How can land use change and ecosystem services of landscapes be described and analyzed? And how can the landscape perspective contribute to our understanding of land systems? The thesis includes three case studies in two different world regions: 1) characteristics of land use within a peri-urban gradient in Dar es Salaam, Tanzania, 2) characteristics of agricultural landscapes in Brandenburg, Germany, and 3) ecosystem service relationships at different spatial units and scales. In both regions, landscapes are investigated with hexagons as spatial units for the analysis of spatial patterns and relationships among different indicators (i.e., ESS) and conceptualize processes on a landscape level. The landscape approach in context with ecosystem services offers important perspectives regarding environmental impacts caused by land use change. Thereby, metrics integrating the ecological, economic, and social dimensions can support obtaining region-specific knowledge on landscape dynamics and transferring this knowledge to decision-makers to design targeted measures towards sustainable land management

The data concept behind the data: From metadata models and labelling schemes towards a generic spectral library

Spectral libraries play a major role in imaging spectroscopy. They are commonly used to store end-member and spectrally pure material spectra, which are primarily used for mapping or unmixing purposes. However, the development of spectral libraries is time consuming and usually sensor and site dependent. Spectral libraries are therefore often developed, used and tailored only for a specific case study and only for one sensor. Multi-sensor and multi-site use of spectral libraries is difficult and requires technical effort for adaptation, transformation, and data harmonization steps. Especially the huge amount of urban material specifications and its spectral variations hamper the setup of a complete spectral library consisting of all available urban material spectra. By a combined use of different urban spectral libraries, besides the improvement of spectral inter- and intra-class variability, missing material spectra could be considered with respect to a multi-sensor/ -site use. Publicly available spectral libraries mostly lack the metadata information that is essential for describing spectra acquisition and sampling background, and can serve to some extent as a measure of quality and reliability of the spectra and the entire library itself. In the GenLib project, a concept for a generic, multi-site and multi-sensor usable spectral library for image spectra on the urban focus was developed. This presentation will introduce a 1) unified, easy-to-understand hierarchical labeling scheme combined with 2) a comprehensive metadata concept that is 3) implemented in the SPECCHIO spectral information system to promote the setup and usability of a generic urban spectral library (GUSL). The labelling scheme was developed to ensure the translation of individual spectral libraries with their own labelling schemes and their usually varying level of details into the GUSL framework. It is based on a modified version of the EAGLE classification concept by combining land use, land cover, land characteristics and spectral characteristics. The metadata concept consists of 59 mandatory and optional attributes that are intended to specify the spatial context, spectral library information, references, accessibility, calibration, preprocessing steps, and spectra specific information describing library spectra implemented in the GUSL. It was developed on the basis of existing metadata concepts and was subject of an expert survey. The metadata concept and the labelling scheme are implemented in the spectral information system SPECCHIO, which is used for sharing and holding GUSL spectra. It allows easy implementation of spectra as well as their specification with the proposed metadata information to extend the GUSL. Therefore, the proposed data model represents a first fundamental step towards a generic usable and continuously expandable spectral library for urban areas. The metadata concept and the labelling scheme also build the basis for the necessary adaptation and transformation steps of the GUSL in order to use it entirely or in excerpts for further multi-site and multi-sensor applications

Data bases and data base systems related to NASA's Aerospace Program: A bibliography with indexes

This bibliography lists 641 reports, articles, and other documents introduced into the NASA scientific and technical information system during the period January 1, 1981 through June 30, 1982. The directory was compiled to assist in the location of numerical and factual data bases and data base handling and management systems

Remote Sensing of Plant Biodiversity

This Open Access volume aims to methodologically improve our understanding of biodiversity by linking disciplines that incorporate remote sensing, and uniting data and perspectives in the fields of biology, landscape ecology, and geography. The book provides a framework for how biodiversity can be detected and evaluated—focusing particularly on plants—using proximal and remotely sensed hyperspectral data and other tools such as LiDAR. The volume, whose chapters bring together a large cross-section of the biodiversity community engaged in these methods, attempts to establish a common language across disciplines for understanding and implementing remote sensing of biodiversity across scales. The first part of the book offers a potential basis for remote detection of biodiversity. An overview of the nature of biodiversity is described, along with ways for determining traits of plant biodiversity through spectral analyses across spatial scales and linking spectral data to the tree of life. The second part details what can be detected spectrally and remotely. Specific instrumentation and technologies are described, as well as the technical challenges of detection and data synthesis, collection and processing. The third part discusses spatial resolution and integration across scales and ends with a vision for developing a global biodiversity monitoring system. Topics include spectral and functional variation across habitats and biomes, biodiversity variables for global scale assessment, and the prospects and pitfalls in remote sensing of biodiversity at the global scale

A Novel Multimodal Image Fusion Method Using Hybrid Wavelet-based Contourlet Transform

Various image fusion techniques have been studied to meet the requirements of different applications such as concealed weapon detection, remote sensing, urban mapping, surveillance and medical imaging. Combining two or more images of the same scene or object produces a better application-wise visible image. The conventional wavelet transform (WT) has been widely used in the field of image fusion due to its advantages, including multi-scale framework and capability of isolating discontinuities at object edges. However, the contourlet transform (CT) has been recently adopted and applied to the image fusion process to overcome the drawbacks of WT with its own advantages. Based on the experimental studies in this dissertation, it is proven that the contourlet transform is more suitable than the conventional wavelet transform in performing the image fusion. However, it is important to know that the contourlet transform also has major drawbacks. First, the contourlet transform framework does not provide shift-invariance and structural information of the source images that are necessary to enhance the fusion performance. Second, unwanted artifacts are produced during the image decomposition process via contourlet transform framework, which are caused by setting some transform coefficients to zero for nonlinear approximation. In this dissertation, a novel fusion method using hybrid wavelet-based contourlet transform (HWCT) is proposed to overcome the drawbacks of both conventional wavelet and contourlet transforms, and enhance the fusion performance. In the proposed method, Daubechies Complex Wavelet Transform (DCxWT) is employed to provide both shift-invariance and structural information, and Hybrid Directional Filter Bank (HDFB) is used to achieve less artifacts and more directional information. DCxWT provides shift-invariance which is desired during the fusion process to avoid mis-registration problem. Without the shift-invariance, source images are mis-registered and non-aligned to each other; therefore, the fusion results are significantly degraded. DCxWT also provides structural information through its imaginary part of wavelet coefficients; hence, it is possible to preserve more relevant information during the fusion process and this gives better representation of the fused image. Moreover, HDFB is applied to the fusion framework where the source images are decomposed to provide abundant directional information, less complexity, and reduced artifacts. The proposed method is applied to five different categories of the multimodal image fusion, and experimental study is conducted to evaluate the performance of the proposed method in each multimodal fusion category using suitable quality metrics. Various datasets, fusion algorithms, pre-processing techniques and quality metrics are used for each fusion category. From every experimental study and analysis in each fusion category, the proposed method produced better fusion results than the conventional wavelet and contourlet transforms; therefore, its usefulness as a fusion method has been validated and its high performance has been verified