Urban Roadside Tree Inventory Using a Mobile Laser Scanning System

the road environment. Thus, effective methods are needed for the MLS data processing. The main goal of this thesis is to establish a feasible workflow by testing a series of methods to extract geometrical information of roadside trees from the MLS-acquired point clouds. The workflow developed in this study consists of three parts. The first part deals with ground point removal. As such, only off-ground points are used to extract trees. The second part handles tree detection by comparing four segmentation and clustering methods: the Euclidian distance clustering algorithm, the region growing segmentation method, the normalized cut (Ncut) method, and the supervoxel-based tree detection method. The third part focuses on automated extraction of tree geometric parameters such as tree height, DBH, crown spread, and horizontal slices features. Finally, classification of tree species was conducted using the k-Nearest Neighbour (k-NN) and the random forests (RF) algorithm. A total of four MLS datasets (three in Xiamen, China and one in Kingston, Ontario) acquired in iv 2013 and 2015, respectively, were used to test the developed method. The ground truthing data of DBH estimation were obtained through manual measurement of selected roadside trees after the two MLS missions in Xiamen in the fall 2015. The field surveyed DBH values of the 163 roadside trees were used to estimate the accuracy of the proposed tree extraction method. The 200 manually labeled trees with 8 different species were selected to examine accuracy of the proposed classification method. The results show that over 90% of the roadside trees were correctly detected, with an average error of about 5% in DBH estimation when compared to the field survey, and an overall accuracy of 78% for the classification of tree species

Semi-automated Generation of Road Transition Lines Using Mobile Laser Scanning Data

Recent advances in autonomous vehicles (AVs) are exponential. Prominent car manufacturers, academic institutions, and corresponding governmental departments around the world are taking active roles in the AV industry. Although the attempts to integrate AV technology into smart roads and smart cities have been in the works for more than half a century, the High Definition Road Maps (HDRMs) that assists full self-driving autonomous vehicles did not yet exist. Mobile Laser Scanning (MLS) has enormous potential in the construction of HDRMs due to its flexibility in collecting wide coverage of street scenes and 3D information on scanned targets. However, without proper and efficient execution, it is difficult to generate HDRMs from MLS point clouds. This study recognizes the research gaps and difficulties in generating transition lines (the paths that pass through a road intersection) in road intersections from MLS point clouds. The proposed method contains three modules: road surface detection, lane marking extraction, and transition line generation. Firstly, the points covering road surface are extracted using the voxel- based upward-growing and the improved region growing. Then, lane markings are extracted and identified according to the multi-thresholding and the geometric filtering. Finally, transition lines are generated through a combination of the lane node structure generation algorithm and the cubic Catmull-Rom spline algorithm. The experimental results demonstrate that transition lines can be successfully generated for both T- and cross-intersections with promising accuracy. In the validation of lane marking extraction using the manually interpreted lane marking points, the method can achieve 90.80% precision, 92.07% recall, and 91.43% F1-score, respectively. The success rate of transition line generation is 96.5%. Furthermore, the Buffer-overlay-statistics (BOS) method validates that the proposed method can generate lane centerlines and transition lines within 20 cm-level localization accuracy from MLS point clouds. In addition, a comparative study is conducted to indicate the better performance of the proposed road marking extraction method than that of three other existing methods. In conclusion, this study makes a considerable contribution to the research on generating transition lines for HDRMs, which further contributes to the research of AVs

Fotogrametría de rango cercano aplicada a la Ingeniería Agroforestal

Tesis por compendio de publicaciones[EN]Since the late twentieth century, Geotechnologies are being applied in different research lines in Agroforestry Engineering aimed at advancing in the modeling of biophysical parameters in order to improve the productivity. In this study, low-cost and close range photogrammetry has been used in different agroforestry scenarios to solve identified gaps in the results and improve procedures and technology hitherto practiced in this field. Photogrammetry offers the advantage of being a non-destructive and non-invasive technique, never changing physical properties of the studied element, providing rigor and completeness to the captured information. In this PhD dissertation, the following contributions are presented divided into three research papers: • A methodological proposal to acquire georeferenced multispectral data of high spatial resolution using a low-cost manned aerial platform, to monitor and sustainably manage extensive áreas of crops. The vicarious calibration is exposed as radiometric calibration method of the multispectral sensor embarked on a paraglider. Low-cost surfaces are performed as control coverages. • The development of a method able to determine crop productivity under field conditions, from the combination of close range photogrammetry and computer vision, providing a constant operational improvement and a proactive management in the crop monitoring. An innovate methodology in the sector is proposed, ensuring flexibility and simplicity in the data collection by non-invasive technologies, automation in processing and quality results with low associated cost. • A low cost, efficient and accurate methodology to obtain Digital Height Models of vegatal cover intended for forestry inventories by integrating public data from LiDAR into photogrammetric point clouds coming from low cost flights. This methodology includes the potentiality of LiDAR to register ground points in areas with high density of vegetation and the better spatial, radiometric and temporal resolution from photogrammetry for the top of vegetal covers.[ES]Desde finales del siglo XX se están aplicando Geotecnologías en diferentes líneas de investigación en Ingeniería Agroforestal orientadas a avanzar en la modelización de parámetros biofísicos con el propósito de mejorar la productividad. En este estudio se ha empleado fotogrametría de bajo coste y rango cercano en distintos escenarios agroforestales para solventar carencias detectadas en los resultados obtenidos y mejorar los procedimientos y la tecnología hasta ahora usados en este campo. La fotogrametría ofrece como ventaja el ser una técnica no invasiva y no destructiva, por lo que no altera en ningún momento las propiedades físicas del elemento estudiado, dotando de rigor y exhaustividad a la información capturada. En esta Tesis Doctoral se presentan las siguientes contribuciones, divididas en tres artículos de investigación: • Una propuesta metodológica de adquisición de datos multiespectrales georreferenciados de alta resolución espacial mediante una plataforma aérea tripulada de bajo coste, para monitorizar y gestionar sosteniblemente amplias extensiones de cultivos. Se expone la calibración vicaria como método de calibración radiométrico del sensor multiespectral embarcado en un paramotor empleando como coberturas de control superficies de bajo coste. • El desarrollo de un método capaz de determinar la productividad del cultivo en condiciones de campo, a partir de la combinación de fotogrametría de rango cercano y visión computacional, facilitando una mejora operativa constante así como una gestión proactiva en la monitorización del cultivo. Se propone una metodología totalmente novedosa en el sector, garantizando flexibilidad y sencillez en la toma de datos mediante tecnologías no invasivas, automatismo en el procesado, calidad en los resultados y un bajo coste asociado. • Una metodología de bajo coste, eficiente y precisa para la obtención de Modelos Digitales de Altura de Cubierta Vegetal destinados al inventario forestal mediante la integración de datos públicos procedentes del LiDAR en las nubes de puntos fotogramétricas obtenidas con un vuelo de bajo coste. Esta metodología engloba la potencialidad del LiDAR para registrar el terreno en zonas con alta densidad de vegetación y una mejor resolución espacial, radiométrica y temporal procedente de la fotogrametría para la parte superior de las cubiertas vegetales

Road Information Extraction from Mobile LiDAR Point Clouds using Deep Neural Networks

Urban roads, as one of the essential transportation infrastructures, provide considerable motivations for rapid urban sprawl and bring notable economic and social benefits. Accurate and efficient extraction of road information plays a significant role in the development of autonomous vehicles (AVs) and high-definition (HD) maps. Mobile laser scanning (MLS) systems have been widely used for many transportation-related studies and applications in road inventory, including road object detection, pavement inspection, road marking segmentation and classification, and road boundary extraction, benefiting from their large-scale data coverage, high surveying flexibility, high measurement accuracy, and reduced weather sensitivity. Road information from MLS point clouds is significant for road infrastructure planning and maintenance, and have an important impact on transportation-related policymaking, driving behaviour regulation, and traffic efficiency enhancement. Compared to the existing threshold-based and rule-based road information extraction methods, deep learning methods have demonstrated superior performance in 3D road object segmentation and classification tasks. However, three main challenges remain that impede deep learning methods for precisely and robustly extracting road information from MLS point clouds. (1) Point clouds obtained from MLS systems are always in large-volume and irregular formats, which has presented significant challenges for managing and processing such massive unstructured points. (2) Variations in point density and intensity are inevitable because of the profiling scanning mechanism of MLS systems. (3) Due to occlusions and the limited scanning range of onboard sensors, some road objects are incomplete, which considerably degrades the performance of threshold-based methods to extract road information. To deal with these challenges, this doctoral thesis proposes several deep neural networks that encode inherent point cloud features and extract road information. These novel deep learning models have been tested by several datasets to deliver robust and accurate road information extraction results compared to state-of-the-art deep learning methods in complex urban environments. First, an end-to-end feature extraction framework for 3D point cloud segmentation is proposed using dynamic point-wise convolutional operations at multiple scales. This framework is less sensitive to data distribution and computational power. Second, a capsule-based deep learning framework to extract and classify road markings is developed to update road information and support HD maps. It demonstrates the practical application of combining capsule networks with hierarchical feature encodings of georeferenced feature images. Third, a novel deep learning framework for road boundary completion is developed using MLS point clouds and satellite imagery, based on the U-shaped network and the conditional deep convolutional generative adversarial network (c-DCGAN). Empirical evidence obtained from experiments compared with state-of-the-art methods demonstrates the superior performance of the proposed models in road object semantic segmentation, road marking extraction and classification, and road boundary completion tasks

Automatic Generation of Urban Road 3D Models for Pedestrian Studies From LiDAR Data

[Abstract] The point clouds acquired with a mobile LiDAR scanner (MLS) have high density and accuracy, which allows one to identify different elements of the road in them, as can be found in many scientific references, especially in the last decade. This study presents a methodology to characterize the urban space available for walking, by segmenting point clouds from data acquired with MLS and automatically generating impedance surfaces to be used in pedestrian accessibility studies. Common problems in the automatic segmentation of the LiDAR point cloud were corrected, achieving a very accurate segmentation of the points belonging to the ground. In addition, problems caused by occlusions caused mainly by parked vehicles and that prevent the availability of LiDAR points in spaces normally intended for pedestrian circulation, such as sidewalks, were solved in the proposed methodology. The innovation of this method lies, therefore, in the high definition of the generated 3D model of the pedestrian space to model pedestrian mobility, which allowed us to apply it in the search for shorter and safer pedestrian paths between the homes and schools of students in urban areas within the Big-Geomove project. Both the developed algorithms and the LiDAR data used are freely licensed for their use in further research.This research study was funded by the Directorate-General for Traffic of Spain, grant number SPIP2017-0234

Measurement and Evaluation of Roadway Geometry for Safety Analyses and Pavement Material Volume Estimation for Resurfacing and Rehabilitation Using Mobile LiDAR and Imagery-based Point Clouds

Roadway safety is a multifaceted issue affected by several variables including geometric design features of the roadway, weather conditions, sight distance issues, user behavior, and pavement surface condition. In recent years, transportation agencies have demonstrated a growing interest in utilizing Light Detecting and Ranging (LiDAR) and other remote sensing technologies to enhance data collection productivity, safety, and facilitate the development of strategies to maintain and improve existing roadway infrastructure. Studies have shown that three-dimensional (3D) point clouds acquired using mobile LiDAR systems are highly accurate, dense, and have numerous applications in transportation. Point cloud data applications include extraction of roadway geometry features, asset management, as-built documentation, and maintenance operations. Another source of highly accurate 3D data in the form of point clouds is close-range aerial photogrammetry using unmanned aerial vehicle (UAV) systems. One of the main advantages of these systems over conventional surveying methods is the ability to obtain accurate continuous data in a timely manner. Traditional surveying techniques allow for the collection of road surface data only at specified intervals. Point clouds from LiDAR and imagery-based data can be imported into modeling and design software to create a virtual representation of constructed roadways using 3D models. From a roadway safety assessment standpoint, mobile LiDAR scanning (MLS) systems and UAV close-range photogrammetry (UAV-CRP) can be used as effective methods to produce accurate digital representations of existing roadways for various safety evaluations. This research used LiDAR data collected by five vendors and UAV imagery data collected by the research team to achieve the following objectives: a) evaluate the accuracy of point clouds from MLS and UAV imagery data for collection roadway cross slopes for system-wide cross slope verification; b) evaluate the accuracy of as-built geometry features extracted from MLS and UAV imagery-based point clouds for estimating design speeds on horizontal and vertical curves of existing roadways; c) Determine whether MLS and UAV imagery-based point clouds can be used to produce accurate road surface models for material volume estimation purposes. Ground truth data collected using manual field survey measurements were used to validate the results of this research. Cross slope measurements were extracted from ten randomly selected stations along a 4-lane roadway. This resulted in a total of 42 cross slope measurements per data set including measurements from left turn lanes. The roadway is an urban parkway classified as an urban principal arterial located in Anderson, South Carolina. A comparison of measurements from point clouds and measurements from field survey data using t-test statical analysis showed that deviations between field survey data and MLS and UAV imagery-based point clouds were within the acceptable range of ±0.2% specified by SHRP2 and the South Carolina Department of Transportation (SCDOT). A surface-to-surface method was used to compute and compare material volumes between terrain models from MLS and UAV imagery-based point clouds and a terrain model from field survey data. The field survey data consisted of 424 points collected manually at sixty-nine 100-ft stations over the 1.3-mile study area. The average difference in height for all MLS data was less than 1 inch except for one of the vendors which appeared to be due to a systematic error. The average height difference for the UAV imagery-based data was approximately 1.02 inches. The relatively small errors indicated that these data sets can be used to obtain reliable material volume estimates. Lastly, MLS and UAV imagery-based point clouds were used to obtain horizontal curve radii and superelevation data to estimate design speeds on horizontal curves. Results from paired t-test statistical analyses using a 95% confidence level showed that geometry data extracted from point clouds can be used to obtain realistic estimates of design speeds on horizontal curves. Similarly, road grade and sight distance were obtained from point clouds for design speed estimation on crest and sag vertical curves. A similar approach using a paired t-test statistical analysis at a 95% confidence level showed that point clouds can be used to obtain reliable design speed information on crest and sag vertical curves. The proposed approach offers advantages over extracting information from design drawings which may provide an inaccurate representation of the as-built roadway

Insights into tree morphology and canopy space occupation under the influence of local neighbourhood interactions in mature temperate forests using laser scanning technology

Mounting evidence suggests that tree species richness promotes ecosystem functioning in forests. However, the mechanisms driving positive biodiversity ecosystem functioning relationships remain largely unclear. This also holds for the previously proposed key mechanisms of resource partitioning in canopy space. Until recently, surveying and hence the study of crown space was very time-consuming and the images low resolution. The application of high-resolution laser scanning, however, now enables a fast and precise recording of entire forests. This thesis presents how the abandonment of management strongly alters the individual tree structure from the wood distribution along the trunk to the crown, a tree species-rich neighbourhood can increase the wood volume and crown dimension of individual trees as well as the productivity of large-sized trees, mobile laser scanning in forests is suitable for the acquisition of high-quality point clouds and determination of relevant management parameters, and the direction and strength of the relationship between tree species richness and canopy occupation depends on the definition of both canopy and species richness. These results reinforce the influence of species richness on ecosystem functions in oldgrowth forests and underline the importance of laser scanning for forest ecology research. The findings of the comparative analyses further highlight the importance of underlying definitions for the results obtained