LiDAR aided simulation pipeline for wireless communication in vehicular traffic scenarios

Abstract. Integrated Sensing and Communication (ISAC) is a modern technology under development for Sixth Generation (6G) systems. This thesis focuses on creating a simulation pipeline for dynamic vehicular traffic scenarios and a novel approach to reducing wireless communication overhead with a Light Detection and Ranging (LiDAR) based system. The simulation pipeline can be used to generate data sets for numerous problems. Additionally, the developed error model for vehicle detection algorithms can be used to identify LiDAR performance with respect to different parameters like LiDAR height, range, and laser point density. LiDAR behavior on traffic environment is provided as part of the results in this study. A periodic beam index map is developed by capturing antenna azimuth and elevation angles, which denote maximum Reference Signal Receive Power (RSRP) for a simulated receiver grid on the road and classifying areas using Support Vector Machine (SVM) algorithm to reduce the number of Synchronization Signal Blocks (SSBs) that are needed to be sent in Vehicle to Infrastructure (V2I) communication. This approach effectively reduces the wireless communication overhead in V2I communication

3D-SeqMOS: A Novel Sequential 3D Moving Object Segmentation in Autonomous Driving

For the SLAM system in robotics and autonomous driving, the accuracy of front-end odometry and back-end loop-closure detection determine the whole intelligent system performance. But the LiDAR-SLAM could be disturbed by current scene moving objects, resulting in drift errors and even loop-closure failure. Thus, the ability to detect and segment moving objects is essential for high-precision positioning and building a consistent map. In this paper, we address the problem of moving object segmentation from 3D LiDAR scans to improve the odometry and loop-closure accuracy of SLAM. We propose a novel 3D Sequential Moving-Object-Segmentation (3D-SeqMOS) method that can accurately segment the scene into moving and static objects, such as moving and static cars. Different from the existing projected-image method, we process the raw 3D point cloud and build a 3D convolution neural network for MOS task. In addition, to make full use of the spatio-temporal information of point cloud, we propose a point cloud residual mechanism using the spatial features of current scan and the temporal features of previous residual scans. Besides, we build a complete SLAM framework to verify the effectiveness and accuracy of 3D-SeqMOS. Experiments on SemanticKITTI dataset show that our proposed 3D-SeqMOS method can effectively detect moving objects and improve the accuracy of LiDAR odometry and loop-closure detection. The test results show our 3D-SeqMOS outperforms the state-of-the-art method by 12.4%. We extend the proposed method to the SemanticKITTI: Moving Object Segmentation competition and achieve the 2nd in the leaderboard, showing its effectiveness

Measurement and Evaluation of Roadway Geometry for Safety Analyses and Pavement Material Volume Estimation for Resurfacing and Rehabilitation Using Mobile LiDAR and Imagery-based Point Clouds

Roadway safety is a multifaceted issue affected by several variables including geometric design features of the roadway, weather conditions, sight distance issues, user behavior, and pavement surface condition. In recent years, transportation agencies have demonstrated a growing interest in utilizing Light Detecting and Ranging (LiDAR) and other remote sensing technologies to enhance data collection productivity, safety, and facilitate the development of strategies to maintain and improve existing roadway infrastructure. Studies have shown that three-dimensional (3D) point clouds acquired using mobile LiDAR systems are highly accurate, dense, and have numerous applications in transportation. Point cloud data applications include extraction of roadway geometry features, asset management, as-built documentation, and maintenance operations. Another source of highly accurate 3D data in the form of point clouds is close-range aerial photogrammetry using unmanned aerial vehicle (UAV) systems. One of the main advantages of these systems over conventional surveying methods is the ability to obtain accurate continuous data in a timely manner. Traditional surveying techniques allow for the collection of road surface data only at specified intervals. Point clouds from LiDAR and imagery-based data can be imported into modeling and design software to create a virtual representation of constructed roadways using 3D models. From a roadway safety assessment standpoint, mobile LiDAR scanning (MLS) systems and UAV close-range photogrammetry (UAV-CRP) can be used as effective methods to produce accurate digital representations of existing roadways for various safety evaluations. This research used LiDAR data collected by five vendors and UAV imagery data collected by the research team to achieve the following objectives: a) evaluate the accuracy of point clouds from MLS and UAV imagery data for collection roadway cross slopes for system-wide cross slope verification; b) evaluate the accuracy of as-built geometry features extracted from MLS and UAV imagery-based point clouds for estimating design speeds on horizontal and vertical curves of existing roadways; c) Determine whether MLS and UAV imagery-based point clouds can be used to produce accurate road surface models for material volume estimation purposes. Ground truth data collected using manual field survey measurements were used to validate the results of this research. Cross slope measurements were extracted from ten randomly selected stations along a 4-lane roadway. This resulted in a total of 42 cross slope measurements per data set including measurements from left turn lanes. The roadway is an urban parkway classified as an urban principal arterial located in Anderson, South Carolina. A comparison of measurements from point clouds and measurements from field survey data using t-test statical analysis showed that deviations between field survey data and MLS and UAV imagery-based point clouds were within the acceptable range of ±0.2% specified by SHRP2 and the South Carolina Department of Transportation (SCDOT). A surface-to-surface method was used to compute and compare material volumes between terrain models from MLS and UAV imagery-based point clouds and a terrain model from field survey data. The field survey data consisted of 424 points collected manually at sixty-nine 100-ft stations over the 1.3-mile study area. The average difference in height for all MLS data was less than 1 inch except for one of the vendors which appeared to be due to a systematic error. The average height difference for the UAV imagery-based data was approximately 1.02 inches. The relatively small errors indicated that these data sets can be used to obtain reliable material volume estimates. Lastly, MLS and UAV imagery-based point clouds were used to obtain horizontal curve radii and superelevation data to estimate design speeds on horizontal curves. Results from paired t-test statistical analyses using a 95% confidence level showed that geometry data extracted from point clouds can be used to obtain realistic estimates of design speeds on horizontal curves. Similarly, road grade and sight distance were obtained from point clouds for design speed estimation on crest and sag vertical curves. A similar approach using a paired t-test statistical analysis at a 95% confidence level showed that point clouds can be used to obtain reliable design speed information on crest and sag vertical curves. The proposed approach offers advantages over extracting information from design drawings which may provide an inaccurate representation of the as-built roadway

Efficient Semantic Segmentation on Edge Devices

Semantic segmentation works on the computer vision algorithm for assigning each pixel of an image into a class. The task of semantic segmentation should be performed with both accuracy and efficiency. Most of the existing deep FCNs yield to heavy computations and these networks are very power hungry, unsuitable for real-time applications on portable devices. This project analyzes current semantic segmentation models to explore the feasibility of applying these models for emergency response during catastrophic events. We compare the performance of real-time semantic segmentation models with non-real-time counterparts constrained by aerial images under oppositional settings. Furthermore, we train several models on the Flood-Net dataset, containing UAV images captured after Hurricane Harvey, and benchmark their execution on special classes such as flooded buildings vs. non-flooded buildings or flooded roads vs. non-flooded roads. In this project, we developed a real-time UNet based model and deployed that network on Jetson AGX Xavier module

A Real-Time local path planning method based on SVM for UGV

Path planning is one of essentials of unmanned ground vehicle (UGV). For the case of poor lighting and weather, traditional vision based methods can not extract effective route boundaries to generate reasonable path stably in unstructured road. By ta king advantage of distance-sensing technology (e.g. 64-beam LiDAR), th is paper proposes an efficient real-time path planning approach. In this approach, given grid map fro m 64-bea m LiDAR, obstacles on both sides of the road are regarded as two classes fed to Support Vector Machine (SVM) to generate an initial safe path. During driving, a time weight based least square fitting is adopted to refine path fro m mu ltiple safe paths which will be described by quartic polynomial, providing stable driving route. Co mbined with UGV's state, controls points from the refined path are adopted to generate the final path through Bezier curve fitting. Experiments on real UGV under different road scenario are conducted, showing that the proposed method can obtain stable and reasonable path with promising performance