Review of Automatic Processing of Topography and Surface Feature Identification LiDAR Data Using Machine Learning Techniques

Machine Learning (ML) applications on Light Detection And Ranging (LiDAR) data have provided promising results and thus this topic has been widely addressed in the literature during the last few years. This paper reviews the essential and the more recent completed studies in the topography and surface feature identification domain. Four areas, with respect to the suggested approaches, have been analyzed and discussed: the input data, the concepts of point cloud structure for applying ML, the ML techniques used, and the applications of ML on LiDAR data. Then, an overview is provided to underline the advantages and the disadvantages of this research axis. Despite the training data labelling problem, the calculation cost, and the undesirable shortcutting due to data downsampling, most of the proposed methods use supervised ML concepts to classify the downsampled LiDAR data. Furthermore, despite the occasional highly accurate results, in most cases the results still require filtering. In fact, a considerable number of adopted approaches use the same data structure concepts employed in image processing to profit from available informatics tools. Knowing that the LiDAR point clouds represent rich 3D data, more effort is needed to develop specialized processing tools

Random forest machine learning technique for automatic vegetation detection and modelling in LiDAR data

Machine learning techniques have gained a distinguished position in the automatic processing of Light Detection and Ranging (LiDAR) data area. They represent the actual research topic in the remote sensing domain. Indeed, this paper presents one method of supervised machine learning, which is called Random Forest. This algorithm is discussed, and their primary applications in automatic vegetation extraction and modelling in the LiDAR data area are presented here

3D LoD2 and LoD3 Modeling of Buildings with Ornamental Towers and Turrets Based on LiDAR Data

This paper presents an innovative approach to the automatic modeling of buildings composed of rotational surfaces, based exclusively on airborne LiDAR point clouds. The proposed approach starts by detecting the gravity center of the building's footprint. A thin point slice parallel to one coordinate axis around the gravity center was considered, and a vertical cross-section was rotated around a vertical axis passing through the gravity center, to generate the 3D building model. The constructed model was visualized with a matrix composed of three matrices, where the same dimensions represented the X, Y, and Z Euclidean coordinates. Five tower point clouds were used to evaluate the performance of the proposed algorithm. Then, to estimate the accuracy, the point cloud was superimposed onto the constructed model, and the deviation of points describing the building model was calculated, in addition to the standard deviation. The obtained standard deviation values, which express the accuracy, were determined in the range of 0.21 m to 1.41 m. These values indicate that the accuracy of the suggested method is consistent with approaches suggested previously in the literature. In the future, the obtained model could be enhanced with the use of points that have considerable deviations. The applied matrix not only facilitates the modeling of buildings with various levels of architectural complexity, but it also allows for local enhancement of the constructed models

Extension of an automatic building extraction technique to airborne laser scanner data containing damaged buildings

Airborne laser scanning systems generate 3-dimensional point clouds of high density and irregular spacing. These data consist of multiple returns coming from terrain, buildings, and vegetation. The major difficulty is the extraction of object categories, usually buildings. In the field of disaster management, the detection of building damages plays an important role. Therefore, the question arises, if damaged buildings can also be detected by a method developed for the automatic extraction of buildings. Another purpose of this study is to extend and test an automatic building detection method developed initially for first echo laser scanner data on data captured in first and last echo. In order to answer these two questions, two institutes share their data and knowledge: the Institute of Photogrammetry and Remote Sensing (IPF, Universität Karlsruhe (TH), Germany) and the MAP-PAGE team (INSA de Strasbourg, France). The used 3D LIDAR data was captured over an area containing undamaged and damaged buildings. The results achieved for every single processing step by applying the original and the extended algorithm to the data are presented, analysed and compared. It is pointed out which buildings can be extracted by which algorithm and why some buildings remain undetecte

Automatic Filtering of Lidar Building Point Cloud in Case of Trees Associated to Building Roof

This paper suggests a new algorithm for automatic building point cloud filtering based on the Z coordinate histogram. This operation aims to select the roof class points from the building point cloud, and the suggested algorithm considers the general case where high trees are associated with the building roof. The Z coordinate histogram is analyzed in order to divide the building point cloud into three zones: the surrounding terrain and low vegetation, the facades, and the tree crowns and/or the roof points. This operation allows the elimination of the first two classes which represent an obstacle toward distinguishing between the roof and the tree points. The analysis of the normal vectors, in addition to the change of curvature factor of the roof class leads to recognizing the high tree crown points. The suggested approach was tested on five datasets with different point densities and urban typology. Regarding the results’ accuracy quantification, the average values of the correctness, the completeness, and the quality indices are used. Their values are, respectively, equal to 97.9%, 97.6%, and 95.6%. These results confirm the high efficacy of the suggested approach

Potential of ILRIS3D Intensity Data for Planar Surfaces Segmentation

Intensity value based point cloud segmentation has received less attention because the intensity value of the terrestrial laser scanner is usually altered by receiving optics/hardware or the internal propriety software, which is unavailable to the end user. We offer a solution by assuming the terrestrial laser scanners are stable and the behavior of the intensity value can be characterized. Then, it is possible to use the intensity value for segmentation by observing its behavior, i.e., intensity value variation, pattern and presence of location of intensity values, etc. In this study, experiment results for characterizing the intensity data of planar surfaces collected by ILRIS3D, a terrestrial laser scanner, are reported. Two intensity formats, grey and raw, are employed by ILRIS3D. It is found from the experiment results that the grey intensity has less variation; hence it is preferable for point cloud segmentation. A warm-up time of approximate 1.5 hours is suggested for more stable intensity data. A segmentation method based on the visual cues of the intensity images sequence, which contains consecutive intensity images, is proposed in order to segment the 3D laser points of ILRIS3D. This method is unique to ILRIS3D data and does not require radiometric calibration

The Application of LiDAR to Assessment of Rooftop Solar Photovoltaic Deployment Potential in a Municipal District Unit

A methodology is provided for the application of Light Detection and Ranging (LiDAR) to automated solar photovoltaic (PV) deployment analysis on the regional scale. Challenges in urban information extraction and management for solar PV deployment assessment are determined and quantitative solutions are offered. This paper provides the following contributions: (i) a methodology that is consistent with recommendations from existing literature advocating the integration of cross-disciplinary competences in remote sensing (RS), GIS, computer vision and urban environmental studies; (ii) a robust methodology that can work with low-resolution, incomprehensive data and reconstruct vegetation and building separately, but concurrently; (iii) recommendations for future generation of software. A case study is presented as an example of the methodology. Experience from the case study such as the trade-off between time consumption and data quality are discussed to highlight a need for connectivity between demographic information, electrical engineering schemes and GIS and a typical factor of solar useful roofs extracted per method. Finally, conclusions are developed to provide a final methodology to extract the most useful information from the lowest resolution and least comprehensive data to provide solar electric assessments over large areas, which can be adapted anywhere in the world

Robot Perception of Static and Dynamic Objects with an Autonomous Floor Scrubber

This paper presents the perception system of a new professional cleaning robot for large public places. The proposed system is based on multiple sensors including 3D and 2D lidar, two RGB-D cameras and a stereo camera. The two lidars together with an RGB-D camera are used for dynamic object (human) detection and tracking, while the second RGB-D and stereo camera are used for detection of static objects (dirt and ground objects). A learning and reasoning module for spatial-temporal representation of the environment based on the perception pipeline is also introduced. Furthermore, a new dataset collected with the robot in several public places, including a supermarket, a warehouse and an airport, is released.Baseline results on this dataset for further research and comparison are provided. The proposed system has been fully implemented into the Robot Operating System (ROS) with high modularity, also publicly available to the community