A Pipeline of 3D Scene Reconstruction from Point Clouds

3D technologies are becoming increasingly popular as their applications in industrial, consumer, entertainment, healthcare, education, and governmental increase in number. According to market predictions, the total 3D modeling and mapping market is expected to grow from $1.1 billion in 2013 to$7.7 billion by 2018. Thus, 3D modeling techniques for different data sources are urgently needed. This thesis addresses techniques for automated point cloud classification and the reconstruction of 3D scenes (including terrain models, 3D buildings and 3D road networks). First, georeferenced binary image processing techniques were developed for various point cloud classifications. Second, robust methods for the pipeline from the original point cloud to 3D model construction were proposed. Third, the reconstruction for the levels of detail (LoDs) of 1-3 (CityGML website) of 3D models was demonstrated. Fourth, different data sources for 3D model reconstruction were studied. The strengths and weaknesses of using the different data sources were addressed. Mobile laser scanning (MLS), unmanned aerial vehicle (UAV) images, airborne laser scanning (ALS), and the Finnish National Land Survey’s open geospatial data sources e.g. a topographic database, were employed as test data. Among these data sources, MLS data from three different systems were explored, and three different densities of ALS point clouds (0.8, 8 and 50 points/m2) were studied. The results were compared with reference data such as an orthophoto with a ground sample distance of 20cm or measured reference points from existing software to evaluate their quality. The results showed that 74.6% of building roofs were reconstructed with the automated process. The resulting building models provided an average height deviation of 15 cm. A total of 6% of model points had a greater than one-pixel deviation from laser points. A total of 2.5% had a deviation of greater than two pixels. The pixel size was determined by the average distance of input laser points. The 3D roads were reconstructed with an average width deviation of 22 cm and an average height deviation of 14 cm. The results demonstrated that 93.4% of building roofs were correctly classified from sparse ALS and that 93.3% of power line points are detected from the six sets of dense ALS data located in forested areas. This study demonstrates the operability of 3D model construction for LoDs of 1-3 via the proposed methodologies and datasets. The study is beneficial to future applications, such as 3D-model-based navigation applications, the updating of 2D topographic databases into 3D maps and rapid, large-area 3D scene reconstruction. 3D-teknologiat ovat tulleet yhä suositummiksi niiden sovellusalojen lisääntyessä teollisuudessa, kuluttajatuotteissa, terveydenhuollossa, koulutuksessa ja hallinnossa. Ennusteiden mukaan 3D-mallinnus- ja -kartoitusmarkkinat kasvavat vuoden 2013 1,1 miljardista dollarista 7,7 miljardiin vuoteen 2018 mennessä. Erilaisia aineistoja käyttäviä 3D-mallinnustekniikoita tarvitaankin yhä enemmän. Tässä väitöskirjatutkimuksessa kehitettiin automaattisen pistepilviaineiston luokittelutekniikoita ja rekonstruoitiin 3D-ympäristöja (maanpintamalleja, rakennuksia ja tieverkkoja). Georeferoitujen binääristen kuvien prosessointitekniikoita kehitettiin useiden pilvipisteaineistojen luokitteluun. Työssä esitetään robusteja menetelmiä alkuperäisestä pistepilvestä 3D-malliin eri CityGML-standardin tarkkuustasoilla. Myös eri aineistolähteitä 3D-mallien rekonstruointiin tutkittiin. Eri aineistolähteiden käytön heikkoudet ja vahvuudet analysoitiin. Testiaineistona käytettiin liikkuvalla keilauksella (mobile laser scanning, MLS) ja ilmakeilauksella (airborne laser scanning, ALS) saatua laserkeilausaineistoja, miehittämättömillä lennokeilla (unmanned aerial vehicle, UAV) otettuja kuvia sekä Maanmittauslaitoksen avoimia aineistoja, kuten maastotietokantaa. Liikkuvalla laserkeilauksella kerätyn aineiston osalta tutkimuksessa käytettiin kolmella eri järjestelmällä saatua dataa, ja kolmen eri tarkkuustason (0,8, 8 ja 50 pistettä/m2) ilmalaserkeilausaineistoa. Tutkimuksessa saatuja tulosten laatua arvioitiin vertaamalla niitä referenssiaineistoon, jona käytettiin ortokuvia (GSD 20cm) ja nykyisissä ohjelmistoissa olevia mitattuja referenssipisteitä. 74,6 % rakennusten katoista saatiin rekonstruoitua automaattisella prosessilla. Rakennusmallien korkeuksien keskipoikkeama oli 15 cm. 6 %:lla mallin pisteistä oli yli yhden pikselin poikkeama laseraineiston pisteisiin verrattuna. 2,5 %:lla oli yli kahden pikselin poikkeama. Pikselikoko määriteltiin kahden laserpisteen välimatkan keskiarvona. Rekonstruoitujen teiden leveyden keskipoikkeama oli 22 cm ja korkeuden keskipoikkeama oli 14 cm. Tulokset osoittavat että 93,4 % rakennuksista saatiin luokiteltua oikein harvasta ilmalaserkeilausaineistosta ja 93,3 % sähköjohdoista saatiin havaittua kuudesta tiheästä metsäalueen ilmalaserkeilausaineistosta. Tutkimus demonstroi 3D-mallin konstruktion toimivuutta tarkkuustasoilla (LoD) 1-3 esitetyillä menetelmillä ja aineistoilla. Tulokset ovat hyödyllisiä kehitettäessä tulevaisuuden sovelluksia, kuten 3D-malleihin perustuvia navigointisovelluksia, topografisten 2D-karttojen ajantasaistamista 3D-kartoiksi, ja nopeaa suurten alueiden 3D-ympäristöjen rekonstruktiota

Weighted simplicial complex reconstruction from mobile laser scanning using sensor topology

We propose a new method for the reconstruction of simplicial complexes (combining points, edges and triangles) from 3D point clouds from Mobile Laser Scanning (MLS). Our method uses the inherent topology of the MLS sensor to define a spatial adjacency relationship between points. We then investigate each possible connexion between adjacent points, weighted according to its distance to the sensor, and filter them by searching collinear structures in the scene, or structures perpendicular to the laser beams. Next, we create and filter triangles for each triplet of self-connected edges and according to their local planarity. We compare our results to an unweighted simplicial complex reconstruction.Comment: 8 pages, 11 figures, CFPT 2018. arXiv admin note: substantial text overlap with arXiv:1802.0748

Automated 3D scene reconstruction from open geospatial data sources: airborne laser scanning and a 2D topographic database

Open geospatial data sources provide opportunities for low cost 3D scene reconstruction. In this study, based on a sparse airborne laser scanning (ALS) point cloud (0.8 points/m2) obtained from open source databases, a building reconstruction pipeline for CAD building models was developed. The pipeline includes voxel-based roof patch segmentation, extraction of the key-points representing the roof patch outline, step edge identification and adjustment, and CAD building model generation. The advantages of our method lie in generating CAD building models without the step of enforcing the edges to be parallel or building regularization. Furthermore, although it has been challenging to use sparse datasets for 3D building reconstruction, our result demonstrates the great potential in such applications. In this paper, we also investigated the applicability of open geospatial datasets for 3D road detection and reconstruction. Road central lines were acquired from an open source 2D topographic database. ALS data were utilized to obtain the height and width of the road. A constrained search method (CSM) was developed for road width detection. The CSM method was conducted by splitting a given road into patches according to height and direction criteria. The road edges were detected patch by patch. The road width was determined by the average distance from the edge points to the central line. As a result, 3D roads were reconstructed from ALS and a topographic database

Digital twinning of railway overhead line equipment from airborne lidar data

The automated generation of geometry-only digital twins of Overhead Line Equipment (OLE) system in existing railways from point clouds is an unsolved problem. Currently, this process is highly reliant upon manual inputs, needing 10 times more labour hours than scanning the physical asset. The resulting modelling cost counteracts the expected benefits of the digital twin. We tackle this challenge using a novel model-driven method that exploits the highly regulated and standardised nature of railways. It starts by restricting the search for OLE elements relative to point clusters of the railway masts. The resulting point clusters of the OLE elements are then converged with various parametric models of different catenary configurations to verify the presence of OLE elements and to find the best possible fit. The method outputs a geometry-only digital twin of the OLE system in Industry Foundation Classes (IFC) format. The method was tested on an 18 km railway point cloud and achieves overall detection rates of 93.2% F1 score for OLE cables and 98.1% F1 score for other OLE elements. The accuracy of the generated model is evaluated using distance-based metrics between the ground truth model and the automated model. The average modelling distance is 3.82 cm Root Mean Square Error (RMSE) for all 18 km dataCambridge Commonwealth, European & International Trust Bentley Systems UK Plc

Vision and advocacy of optoelectronic technology developments in the AECO sector

Purpose This research presents a literature review of laser scanning and 3D modelling devices, modes of delivery and applications within the architecture, engineering, construction and owner-operated (AECO) sector. Such devices are inextricably linked to modern digital built environment practices, particularly when used in conjunction with as-built building information modelling (BIM) development. The research also reports upon innovative technological advancements (such as machine vision) that coalesce with 3D scanning solutions. Design/methodology/approach A synthesis of literature is used to develop: a hierarchy of the modes of delivery for laser scan devices; a thematic analysis of 3D terrestrial laser scan technology applications; and a componential cross-comparative tabulation of laser scan technology and specifications. Findings Findings reveal that the costly and labour intensive attributes of laser scanning devices have stimulated the development of hybrid automated and intelligent technologies to improve performance. Such developments are set to satisfy the increasing demand for digitisation of both existing and new buildings into BIM. Future work proposed will seek to: review what coalescence of digital technologies will provide an optimal and cost effective solution to accurately reconstructing the digital built environment; conduct case studies that implement hybrid digital solutions in pragmatic facilities management scenarios to measure their performance and user satisfaction; and eliminate manual remodelling tasks (such as point cloud reconstruction) via the use of computational intelligence algorithms integral within cloud based BIM platforms. Originality/value Although laser scanning and 3D modelling have been widely covered en passant within the literature, scant research has conducted an holistic review of the technology, its applications and future developments. This review presents concise and lucid reference guidance that will intellectually challenge, and better inform, both practitioners and researchers

Intelligent open data 3D maps in a collaborative virtual world

Three-dimensional (3D) maps have many potential applications, such as navigation and urban planning. In this article, we present the use of a 3D virtual world platform Meshmoon to create intelligent open data 3D maps. A processing method is developed to enable the generation of 3D virtual environments from the open data of the National Land Survey of Finland. The article combines the elements needed in contemporary smart city concepts, such as the connection between attribute information and 3D objects, and the creation of collaborative virtual worlds from open data. By using our 3D virtual world platform, it is possible to create up-to-date, collaborative 3D virtual models, which are automatically updated on all viewers. In the scenes, all users are able to interact with the model, and with each other. With the developed processing methods, the creation of virtual world scenes was partially automated for collaboration activities.Peer reviewe

Conceptual issues regarding the development of underground railway laser scanning systems

Author name used in this publication: Bruce King2014-2015 > Academic research: refereed > Publication in refereed journalVersion of RecordPublishe

POINTNET++ TRANSFER LEARNING FOR TREE EXTRACTION FROM MOBILE LIDAR POINT CLOUDS

Trees are an essential part of the natural and urban environment due to providing crucial benefits such as increasing air quality and wildlife habitats. Therefore, various remote sensing and photogrammetry technologies, including Mobile Laser Scanner (MLS), have been recently introduced for precise 3D tree mapping and modeling. The MLS provides densely 3D LiDAR point clouds from the surrounding, which results in measuring applicable information of trees like stem diameter or elevation. In this paper, a transfer learning procedure on the PointNet++ has been proposed for tree extraction. Initially, two steps of converting the MLS point clouds into same-length smaller sections and eliminating ground points have been conducted to overcome the massive volume of MLS data. The algorithm was tested on four LiDAR datasets ranging from challengeable urban environments containing multiple objects like tall buildings to railway surroundings. F1-Score accuracy was gained at around 93% and 98%, which showed the feasibility and efficiency of the proposed algorithm. Noticeably, the algorithms also measured geometrical information of extracted trees such as 2D coordinate space, height, stem diameter, and 3D boundary tree locations