Sedimentological characterization of Antarctic moraines using UAVs and Structure-from-Motion photogrammetry

In glacial environments particle-size analysis of moraines provides insights into clast origin, transport history, depositional mechanism and processes of reworking. Traditional methods for grain-size classification are labour-intensive, physically intrusive and are limited to patch-scale (1m2) observation. We develop emerging, high-resolution ground- and unmanned aerial vehicle-based ‘Structure-from-Motion’ (UAV-SfM) photogrammetry to recover grain-size information across an moraine surface in the Heritage Range, Antarctica. SfM data products were benchmarked against equivalent datasets acquired using terrestrial laser scanning, and were found to be accurate to within 1.7 and 50mm for patch- and site-scale modelling, respectively. Grain-size distributions were obtained through digital grain classification, or ‘photo-sieving’, of patch-scale SfM orthoimagery. Photo-sieved distributions were accurate to <2mm compared to control distributions derived from dry sieving. A relationship between patch-scale median grain size and the standard deviation of local surface elevations was applied to a site-scale UAV-SfM model to facilitate upscaling and the production of a spatially continuous map of the median grain size across a 0.3 km2 area of moraine. This highly automated workflow for site scale sedimentological characterization eliminates much of the subjectivity associated with traditional methods and forms a sound basis for subsequent glaciological process interpretation and analysis

Multi-Scale Remote Sensing of Tornado Effects

To achieve risk-based engineered structural designs that provide safety for life and property from tornadoes, sufficient knowledge of tornado wind speeds and wind flow characteristics is needed. Currently, sufficient understanding of the magnitude, frequency, and velocity structure of tornado winds remain elusive. Direct measurements of tornado winds are rare and nearly impossible to acquire, and the pursuit of in situ wind measurements can be precarious, dangerous, and even necessitating the development of safer and more reliable means to understand tornado actions. Remote-sensing technologies including satellite, aerial, lidar, and photogrammetric platforms, have demonstrated an ever-increasing efficiency for collecting, storing, organizing, and communicating tornado hazards information at a multitude of geospatial scales. Current remote-sensing technologies enable wind-engineering researchers to examine tornado effects on the built environment at various spatial scales ranging from the overall path to the neighborhood, building, and ultimately member and/or connection level. Each spatial resolution contains a unique set of challenges for efficiency, ease, and cost of data acquisition and dissemination, as well as contributions to the body of knowledge that help engineers and atmospheric scientists better understand tornado wind speeds. This paper examines the use of remote sensing technologies at four scales in recent tornado investigations, demonstrating the challenges of data collection and processing at each level as well as the utility of the information gleaned from each level in advancing the understanding of tornado effects

Automatic Registration of Optical Aerial Imagery to a LiDAR Point Cloud for Generation of City Models

This paper presents a framework for automatic registration of both the optical and 3D structural information extracted from oblique aerial imagery to a Light Detection and Ranging (LiDAR) point cloud without prior knowledge of an initial alignment. The framework employs a coarse to fine strategy in the estimation of the registration parameters. First, a dense 3D point cloud and the associated relative camera parameters are extracted from the optical aerial imagery using a state-of-the-art 3D reconstruction algorithm. Next, a digital surface model (DSM) is generated from both the LiDAR and the optical imagery-derived point clouds. Coarse registration parameters are then computed from salient features extracted from the LiDAR and optical imagery-derived DSMs. The registration parameters are further refined using the iterative closest point (ICP) algorithm to minimize global error between the registered point clouds. The novelty of the proposed approach is in the computation of salient features from the DSMs, and the selection of matching salient features using geometric invariants coupled with Normalized Cross Correlation (NCC) match validation. The feature extraction and matching process enables the automatic estimation of the coarse registration parameters required for initializing the fine registration process. The registration framework is tested on a simulated scene and aerial datasets acquired in real urban environments. Results demonstrates the robustness of the framework for registering optical and 3D structural information extracted from aerial imagery to a LiDAR point cloud, when co-existing initial registration parameters are unavailable

Unmanned Aircraft System Assessments of Landslide Safety for Transportation Corridors

An assessment of unmanned aircraft systems (UAS) concluded that current, off-the-shelf UAS aircraft and cameras can be effective for creating the digital surface models used to evaluate rock-slope stability and landslide risk along transportation corridors. The imagery collected with UAS can be processed using a photogrammetry technique called Structure-from-Motion (SfM) which generates a point cloud and surface model, similar to terrestrial laser scanning (TLS). We treated the TLS data as our control, or “truth,” because it is a mature and well-proven technology. The comparisons of the TLS surfaces and the SFM surfaces were impressive – if not comparable is many cases. Thus, the SfM surface models would be suitable for deriving slope morphology to generate rockfall activity indices (RAI) for landslide assessment provided the slopes. This research also revealed that UAS are a safer alternative to the deployment and operation of TLS operating on a road shoulder because UAS can be launched and recovered from a remote location and capable of imaging without flying directly over the road. However both the UAS and TLS approaches still require traditional survey control and photo targets to accurately geo-reference their respective DSM.List of Figures ...................................................................................................... vi List of Abbreviations ......................................................................................... vii Acknowledgments ................................................................................................ x Executive Summary ............................................................................................. xi CHAPTER 1 INTRODUCTION .......................................................................... 1 CHAPTER 2 LITERATURE REVIEW ................................................................ 4 2.1 Landslide Hazards .................................................................................... 4 2.2 Unmanned Aircraft Systems Remote Sensing.......................................... 6 2.3 Structure From Motion (SfM) .................................................................. 7 2.4 Lidar terrain mapping ............................................................................... 8 CHAPTER 3 STUDY SITE/DATA .................................................................. 11 CHAPTER 4 METHODS ................................................................................ 13 4.1 Data Collection ............................................................................................. 13 4.1.1 Survey Control ..................................................................................... 14 4.1.2 TLS Surveys ........................................................................................ 16 4.1.3 UAS Imagery ....................................................................................... 17 4.1.4 Terrestrial Imagery Acquisition ........................................................... 19 4.2 Data Processing ............................................................................................ 20 4.2.1 Survey Control ..................................................................................... 20 4.2.2 TLS Processing .................................................................................... 20 4.2.3 SfM Processing .................................................................................... 21 4.2.4 Surface Generation .............................................................................. 22 4.3 Quality Evaluation ........................................................................................ 23 4.3.1 Completeness ....................................................................................... 23 4.3.2 Data Density/Resolution ...................................................................... 23 4.3.3 Accuracy Assessment .......................................................................... 23 4.3.2 Surface Morphology Analysis ............................................................. 24 4.2.6 Data Visualization ............................................................................... 25 CHAPTER 5 RESULTS ................................................................................. 27 v 5.1 UTIC DSM evaluation.................................................................................. 27 5.1.1 Completeness evaluation ..................................................................... 28 5.1.2 Data Density Evaluation ...................................................................... 29 5.1.3 Accuracy Evaluation............................................................................ 30 5.2 Geomorphological Evaluation ...................................................................... 32 CHAPTER 6 DISCUSSION ............................................................................ 35 6.1 Evaluation of UAS efficiencies .................................................................... 35 6.2 DSM quality and completeness .................................................................... 37 6.3 Safety and operational considerations .......................................................... 37 CHAPTER 7 CONCLUSIONS AND RECOMMENDATIONS ................................ 40 7.1 Technology Transfer..................................................................................... 41 7.1.1 Publications ......................................................................................... 41 7.1.2 Presentations ........................................................................................ 42 7.1.3 Multi-media outreach .......................................................................... 43 6.4 Integration of UAS and TLS data ................................................................. 44 REFERENCES .............................................................................................. 4

Automated Building Information Extraction and Evaluation from High-resolution Remotely Sensed Data

The two-dimensional (2D) footprints and three-dimensional (3D) structures of buildings are of great importance to city planning, natural disaster management, and virtual environmental simulation. As traditional manual methodologies for collecting 2D and 3D building information are often both time consuming and costly, automated methods are required for efficient large area mapping. It is challenging to extract building information from remotely sensed data, considering the complex nature of urban environments and their associated intricate building structures. Most 2D evaluation methods are focused on classification accuracy, while other dimensions of extraction accuracy are ignored. To assess 2D building extraction methods, a multi-criteria evaluation system has been designed. The proposed system consists of matched rate, shape similarity, and positional accuracy. Experimentation with four methods demonstrates that the proposed multi-criteria system is more comprehensive and effective, in comparison with traditional accuracy assessment metrics. Building height is critical for building 3D structure extraction. As data sources for height estimation, digital surface models (DSMs) that are derived from stereo images using existing software typically provide low accuracy results in terms of rooftop elevations. Therefore, a new image matching method is proposed by adding building footprint maps as constraints. Validation demonstrates that the proposed matching method can estimate building rooftop elevation with one third of the error encountered when using current commercial software. With an ideal input DSM, building height can be estimated by the elevation contrast inside and outside a building footprint. However, occlusions and shadows cause indistinct building edges in the DSMs generated from stereo images. Therefore, a “building-ground elevation difference model” (EDM) has been designed, which describes the trend of the elevation difference between a building and its neighbours, in order to find elevation values at bare ground. Experiments using this novel approach report that estimated building height with 1.5m residual, which out-performs conventional filtering methods. Finally, 3D buildings are digitally reconstructed and evaluated. Current 3D evaluation methods did not present the difference between 2D and 3D evaluation methods well; traditionally, wall accuracy is ignored. To address these problems, this thesis designs an evaluation system with three components: volume, surface, and point. As such, the resultant multi-criteria system provides an improved evaluation method for building reconstruction

Robust Localization in 3D Prior Maps for Autonomous Driving.

In order to navigate autonomously, many self-driving vehicles require precise localization within an a priori known map that is annotated with exact lane locations, traffic signs, and additional metadata that govern the rules of the road. This approach transforms the extremely difficult and unpredictable task of online perception into a more structured localization problem—where exact localization in these maps provides the autonomous agent a wealth of knowledge for safe navigation. This thesis presents several novel localization algorithms that leverage a high-fidelity three-dimensional (3D) prior map that together provide a robust and reliable framework for vehicle localization. First, we present a generic probabilistic method for localizing an autonomous vehicle equipped with a 3D light detection and ranging (LIDAR) scanner. This proposed algorithm models the world as a mixture of several Gaussians, characterizing the z-height and reflectivity distribution of the environment—which we rasterize to facilitate fast and exact multiresolution inference. Second, we propose a visual localization strategy that replaces the expensive 3D LIDAR scanners with significantly cheaper, commodity cameras. In doing so, we exploit a graphics processing unit to generate synthetic views of our belief environment, resulting in a localization solution that achieves a similar order of magnitude error rate with a sensor that is several orders of magnitude cheaper. Finally, we propose a visual obstacle detection algorithm that leverages knowledge of our high-fidelity prior maps in its obstacle prediction model. This not only provides obstacle awareness at high rates for vehicle navigation, but also improves our visual localization quality as we are cognizant of static and non-static regions of the environment. All of these proposed algorithms are demonstrated to be real-time solutions for our self-driving car.PhDComputer Science and EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/133410/1/rwolcott_1.pd

Heritage Recording and 3D Modeling with Photogrammetry and 3D Scanning

The importance of landscape and heritage recording and documentation with optical remote sensing sensors is well recognized at international level. The continuous development of new sensors, data capture methodologies and multi-resolution 3D representations, contributes significantly to the digital 3D documentation, mapping, conservation and representation of landscapes and heritages and to the growth of research in this field. This article reviews the actual optical 3D measurement sensors and 3D modeling techniques, with their limitations and potentialities, requirements and specifications. Examples of 3D surveying and modeling of heritage sites and objects are also shown throughout the paper

Object-Based Integration of Photogrammetric and LiDAR Data for Automated Generation of Complex Polyhedral Building Models

This research is concerned with a methodology for automated generation of polyhedral building models for complex structures, whose rooftops are bounded by straight lines. The process starts by utilizing LiDAR data for building hypothesis generation and derivation of individual planar patches constituting building rooftops. Initial boundaries of these patches are then refined through the integration of LiDAR and photogrammetric data and hierarchical processing of the planar patches. Building models for complex structures are finally produced using the refined boundaries. The performance of the developed methodology is evaluated through qualitative and quantitative analysis of the generated building models from real data

Histopathological image analysis : a review

Over the past decade, dramatic increases in computational power and improvement in image analysis algorithms have allowed the development of powerful computer-assisted analytical approaches to radiological data. With the recent advent of whole slide digital scanners, tissue histopathology slides can now be digitized and stored in digital image form. Consequently, digitized tissue histopathology has now become amenable to the application of computerized image analysis and machine learning techniques. Analogous to the role of computer-assisted diagnosis (CAD) algorithms in medical imaging to complement the opinion of a radiologist, CAD algorithms have begun to be developed for disease detection, diagnosis, and prognosis prediction to complement the opinion of the pathologist. In this paper, we review the recent state of the art CAD technology for digitized histopathology. This paper also briefly describes the development and application of novel image analysis technology for a few specific histopathology related problems being pursued in the United States and Europe

Vision Science and Technology at NASA: Results of a Workshop

A broad review is given of vision science and technology within NASA. The subject is defined and its applications in both NASA and the nation at large are noted. A survey of current NASA efforts is given, noting strengths and weaknesses of the NASA program