Uses and Challenges of Collecting LiDAR Data from a Growing Autonomous Vehicle Fleet: Implications for Infrastructure Planning and Inspection Practices

Autonomous vehicles (AVs) that utilize LiDAR (Light Detection and Ranging) and other sensing technologies are becoming an inevitable part of transportation industry. Concurrently, transportation agencies are increasingly challenged with the management and tracking of large-scale highway asset inventory. LiDAR has become popular among transportation agencies for highway asset management given its advantage over traditional surveying methods. The affordability of LiDAR technology is increasing day by day. Given this, there will be substantial challenges and opportunities for the utilization of big data resulting from the growth of AVs with LiDAR. A proper understanding of the data size generated from this technology will help agencies in making decisions regarding storage, management, and transmission of the data. The original raw data generated from the sensor shrinks a lot after filtering and processing following the Cache county Road Manual and storing into ASPRS recommended (.las) file format. In this pilot study, it is found that while considering the road centerline as the vehicle trajectory larger portion of the data fall into the right of way section compared to the actual vehicle trajectory in Cache County, UT. And there is a positive relation between the data size and vehicle speed in terms of the travel lanes section given the nature of the selected highway environment

Classification and Change Detection in Mobile Mapping LiDAR Point Clouds

Creating 3D models of the static environment is an important task for the advancement of driver assistance systems and autonomous driving. In this work, a static reference map is created from a Mobile Mapping “light detection and ranging” (LiDAR) dataset. The data was obtained in 14 measurement runs from March to October 2017 in Hannover and consists in total of about 15 billion points. The point cloud data are first segmented by region growing and then processed by a random forest classification, which divides the segments into the five static classes (“facade”, “pole”, “fence”, “traffic sign”, and “vegetation”) and three dynamic classes (“vehicle”, “bicycle”, “person”) with an overall accuracy of 94%. All static objects are entered into a voxel grid, to compare different measurement epochs directly. In the next step, the classified voxels are combined with the result of a visibility analysis. Therefore, we use a ray tracing algorithm to detect traversed voxels and differentiate between empty space and occlusion. Each voxel is classified as suitable for the static reference map or not by its object class and its occupation state during different epochs. Thereby, we avoid to eliminate static voxels which were occluded in some of the measurement runs (e.g. parts of a building occluded by a tree). However, segments that are only temporarily present and connected to static objects, such as scaffolds or awnings on buildings, are not included in the reference map. Overall, the combination of the classification with the subsequent entry of the classes into a voxel grid provides good and useful results that can be updated by including new measurement data

Automatic segmentation and reconstruction of traffic accident scenarios from mobile laser scanning data

Virtual reconstruction of historic sites, planning of restorations and attachments of new building parts, as well as forest inventory are few examples of fields that benefit from the application of 3D surveying data. Originally using 2D photo based documentation and manual distance measurements, the 3D information obtained from multi camera and laser scanning systems realizes a noticeable improvement regarding the surveying times and the amount of generated 3D information. The 3D data allows a detailed post processing and better visualization of all relevant spatial information. Yet, for the extraction of the required information from the raw scan data and for the generation of useable visual output, time-consuming, complex user-based data processing is still required, using the commercially available 3D software tools. In this context, the automatic object recognition from 3D point cloud and depth data has been discussed in many different works. The developed tools and methods however, usually only focus on a certain kind of object or the detection of learned invariant surface shapes. Although the resulting methods are applicable for certain practices of data segmentation, they are not necessarily suitable for arbitrary tasks due to the varying requirements of the different fields of research. This thesis presents a more widespread solution for automatic scene reconstruction from 3D point clouds, targeting street scenarios, specifically for the task of traffic accident scene analysis and documentation. The data, obtained by sampling the scene using a mobile scanning system is evaluated, segmented, and finally used to generate detailed 3D information of the scanned environment. To realize this aim, this work adapts and validates various existing approaches on laser scan segmentation regarding the application on accident relevant scene information, including road surfaces and markings, vehicles, walls, trees and other salient objects. The approaches are therefore evaluated regarding their suitability and limitations for the given tasks, as well as for possibilities concerning the combined application together with other procedures. The obtained knowledge is used for the development of new algorithms and procedures to allow a satisfying segmentation and reconstruction of the scene, corresponding to the available sampling densities and precisions. Besides the segmentation of the point cloud data, this thesis presents different visualization and reconstruction methods to achieve a wider range of possible applications of the developed system for data export and utilization in different third party software tools

Detection, segmentation and classification of 3D urban objects using mathematical morphology and supervised learning

International audienceWe propose an automatic and robust approach to detect, segment and classify urban objects from 3D point clouds. Processing is carried out using elevation images and the result is reprojected onto the 3D point cloud. First, the ground is segmented and objects are detected as discontinuities on the ground. Then, connected objects are segmented using a watershed approach. Finally, objects are classified using SVM with geometrical and contextual features. Our methodology is evaluated on databases from Ohio (USA) and Paris (France). In the former, our method detects 98% of the objects, 78% of them are correctly segmented and 82% of the well-segmented objects are correctly classified. In the latter, our method leads to an improvement of about 15% on the classification step with respect to previous works. Quantitative results prove that our method not only provides a good performance but is also faster than other works reported in the literature

A Comprehensive Assessment of Highway Inventory Data Collection Methods

The implementation of the Highway Safety Manual (HSM) at the state level has the potential to allow transportation agencies to proactively address safety concerns. However, the widespread utilization of HSM faces significant barriers as many state departments of transportations (DOTs) do not have sufficient HSM-required highway inventory data. Many techniques have been utilized by state DOTs and local agencies to collect highway inventory data for other purposes. Nevertheless, it is unknown which of these methods or any combination of them is capable of efficiently collecting the required dataset while minimizing cost and safety concerns. The focus of this study is to characterize the capability of existing methods for collecting highway inventory data vital to the implementation of the recently published HSM. More specifically, this study evaluated existing highway inventory methods through a nationwide survey and a field trial of identified promising highway inventory data collection (HIDC) methods on various types of highway segments. A comparative analysis was conducted to present an example on how to incorporate weights provided by state DOT stakeholders to select the most suitable HIDC method for the specific purpose

Robust statistical approaches for feature extraction in laser scanning 3D point cloud data

Three dimensional point cloud data acquired from mobile laser scanning system commonly contain outliers and/or noise. The presence of outliers and noise means most of the frequently used methods for feature extraction produce inaccurate and non-robust results. We investigate the problems of outliers and how to accommodate them for automatic robust feature extraction. This thesis develops algorithms for outlier detection, point cloud denoising, robust feature extraction, segmentation and ground surface extraction

Desenvolvemento de modelos de información de infraestructuras segundo estándares abertos e parametrización automática a partir de datos xeomáticos.

It seeks to develop procedures that allow generating information models of these structures, created from the relevant information of the point clouds obtained with these systems. For this purpose, the BIM standards for civil engineering structures, both currently available and those that will be published for the duration of the thesis, will be exploited and adopted. Information modeling techniques will be used in these standards, with the aim of obtaining a system that allows modeling the structures automatically. The models will also be made compatible with other methodologies designed for BIM, whose purpose is to take full advantage of the information available for management and maintenance tasks. Meeting these objectives, an automatic modeling system will be developed according to the BIM standards for transport infrastructures, suitable for automatic feeding from geomatic data and remote sensing, which is in turn integrable into management and maintenance systems for these types of structures of civil engineering.Esta tesis busca el desarrollo de metodologías para la exportación de la información geomática de infraestructuras de transporte, particularmente estructuras ferroviarias y carreteras, obtenida mediante tecnologías de mapeado móvil. Se busca desarrollar procedimientos que permitan generar modelos de información de estas estructuras, creados a partir de la información relevante de las nubes de puntos obtenidas con estos sistemas. Con este propósito, se explotarán y adoptarán los estándares BIM para estructuras de ingeniería civil, tanto los actualmente disponibles como aquellos que serán publicados durante la duración de la tesis. Se utilizarán técnicas de modelado de información en estos estándares, con objetivo de obtener un sistema que permita realizar un modelado de las estructuras de manera automática. Se llevará a cabo también la compatibilización los modelos con otras metodologías diseñadas para BIM, cuyo propósito es el aprovechamiento total de la información disponible para tareas de gestión y mantenimiento. Cumpliendo estos objetivos se desarrollará un sistema automático de modelado según los estándares BIM para infraestructuras de transporte, apto para su alimentación automática a partir de datos geomáticos y teledetección, el cual es a su vez integrable en sistemas de gestión y mantenimiento para este tipo de estructuras de ingeniería civil.Esta tese busca o desenvolvemento de metodoloxías para a exportación da información xeomática de infraestruturas de transporte, particularmente estruturas ferroviarias e estradas, obtida mediante tecnoloxías de mapeado móbil. A tese busca o desenvolvemento de procedementos que permitan xerar modelos de información destas estruturas, creados a partir da información relevante das nubes de puntos obtidas con estes sistemas. Con este propósito, se explotarán e adoptarán os estándares BIM para estruturas de enxeñería civil, tanto os actualmente dispoñibles como aqueles que serán publicados durante a duración da tese. Utilizaranse técnicas de modelado de información nestes estándares, con obxectivo de obter un sistema que permita realizar un modelado das estruturas de maneira automática. Levarase a cabo tamén a compatibilización dos modelos con outras metodoloxías diseñadas para BIM, cuxo propósito é o aproveitamento total da información dispoñible para tarefas de xestión e mantemento. Cumplindo estes obxectivos se desenvolverá un sistema automático de modelado segundo os estándares BIM para infraestruturas de transporte, apto para a súa alimentación automática a partir de datos xeomáticos e teledetección, o cal é a súa vez integrable en sistemas de xestión e mantemento para este tipo de estruturas de enxeñería civil

Vehicle localization by lidar point correlation improved by change detection

LiDAR sensors are proven sensors for accurate vehicle localization. Instead of detecting and matching features in the LiDAR data, we want to use the entire information provided by the scanners. As dynamic objects, like cars, pedestrians or even construction sites could lead to wrong localization results, we use a change detection algorithm to detect these objects in the reference data. If an object occurs in a certain number of measurements at the same position, we mark it and every containing point as static. In the next step, we merge the data of the single measurement epochs to one reference dataset, whereby we only use static points. Further, we also use a classification algorithm to detect trees. For the online localization of the vehicle, we use simulated data of a vertical aligned automotive LiDAR sensor. As we only want to use static objects in this case as well, we use a random forest classifier to detect dynamic scan points online. Since the automotive data is derived from the LiDAR Mobile Mapping System, we are able to use the labelled objects from the reference data generation step to create the training data and further to detect dynamic objects online. The localization then can be done by a point to image correlation method using only static objects. We achieved a localization standard deviation of about 5 cm (position) and 0.06° (heading), and were able to successfully localize the vehicle in about 93 % of the cases along a trajectory of 13 km in Hannover, Germany