A Minimalist Approach to Type-Agnostic Detection of Quadrics in Point Clouds

This paper proposes a segmentation-free, automatic and efficient procedure to detect general geometric quadric forms in point clouds, where clutter and occlusions are inevitable. Our everyday world is dominated by man-made objects which are designed using 3D primitives (such as planes, cones, spheres, cylinders, etc.). These objects are also omnipresent in industrial environments. This gives rise to the possibility of abstracting 3D scenes through primitives, thereby positions these geometric forms as an integral part of perception and high level 3D scene understanding. As opposed to state-of-the-art, where a tailored algorithm treats each primitive type separately, we propose to encapsulate all types in a single robust detection procedure. At the center of our approach lies a closed form 3D quadric fit, operating in both primal & dual spaces and requiring as low as 4 oriented-points. Around this fit, we design a novel, local null-space voting strategy to reduce the 4-point case to 3. Voting is coupled with the famous RANSAC and makes our algorithm orders of magnitude faster than its conventional counterparts. This is the first method capable of performing a generic cross-type multi-object primitive detection in difficult scenes. Results on synthetic and real datasets support the validity of our method.Comment: Accepted for publication at CVPR 201

Estimating Damaged Volume of Historic Pagodas in Bagan after Earthquake using 3D Hough Transform

On 24th August 2016, the magnitude of a 6.8 earthquake struck in Bagan from the depth of 52 miles. This earthquake caused much damage in historic pagodas in Bagan, one of the archeological houses in Asia. Analyzing the affected areas is an essential task for the restoration and reconstruction of historic buildings after a disaster. Traditional methods of detecting damage to buildings focus on detecting 2D changes (i.e., only the appearance of the image), but the 2D information provided by the image is not sufficient when it involves detecting damage to buildings is often not precise. For finding out the solution, a method of 3D change detection is needed for estimating the volumes of damaged pagodas after the earthquake. The proposed system aims at producing a quick assessment of the damaged pagodas accurately and correctly. This system estimates the damaged volume of the pagoda based on the nature of the 3D point clouds. Post-earthquake photos are taken using an anonymous aircraft (UAV) and point cloud data is generated using VisualSFM software. The 3D Hough transform is used to find the intersection of the tower vertex and the 3D vertex at the line boundary. Besides, the proposed system can detect the reformed structure of the entire pagoda. The results show that the proposed approach facilitates the automated 3D detection of damaged pagodas and is a time-saving method for estimating the volume of damage caused to precious historic pagodas after a disaster

Extraction robuste de primitives géométriques 3D dans un nuage de points et alignement basé sur les primitives

Dans ce projet, nous étudions les problèmes de rétro-ingénierie et de contrôle de la qualité qui jouent un rôle important dans la fabrication industrielle. La rétro-ingénierie tente de reconstruire un modèle 3D à partir de nuages de points, qui s’apparente au problème de la reconstruction de la surface 3D. Le contrôle de la qualité est un processus dans lequel la qualité de tous les facteurs impliqués dans la production est abordée. En fait, les systèmes ci-dessus nécessitent beaucoup d’intervention de la part d’un utilisateur expérimenté, résultat souhaité est encore loin soit une automatisation complète du processus. Par conséquent, de nombreux défis doivent encore être abordés pour atteindre ce résultat hautement souhaitable en production automatisée. La première question abordée dans la thèse consiste à extraire les primitives géométriques 3D à partir de nuages de points. Un cadre complet pour extraire plusieurs types de primitives à partir de données 3D est proposé. En particulier, une nouvelle méthode de validation est proposée pour évaluer la qualité des primitives extraites. À la fin, toutes les primitives présentes dans le nuage de points sont extraites avec les points de données associés et leurs paramètres descriptifs. Ces résultats pourraient être utilisés dans diverses applications telles que la reconstruction de scènes on d’édifices, la géométrie constructive et etc. La seconde question traiée dans ce travail porte sur l’alignement de deux ensembles de données 3D à l’aide de primitives géométriques, qui sont considérées comme un nouveau descripteur robuste. L’idée d’utiliser les primitives pour l’alignement arrive à surmonter plusieurs défis rencontrés par les méthodes d’alignement existantes. Ce problème d’alignement est une étape essentielle dans la modélisation 3D, la mise en registre, la récupération de modèles. Enfin, nous proposons également une méthode automatique pour extraire les discontinutés à partir de données 3D d’objets manufacturés. En intégrant ces discontinutés au problème d’alignement, il est possible d’établir automatiquement les correspondances entre primitives en utilisant l’appariement de graphes relationnels avec attributs. Nous avons expérimenté tous les algorithmes proposés sur différents jeux de données synthétiques et réelles. Ces algorithmes ont non seulement réussi à accomplir leur tâches avec succès mais se sont aussi avérés supérieus aux méthodes proposées dans la literature. Les résultats présentés dans le thèse pourraient s’avérér utilises à plusieurs applications.In this research project, we address reverse engineering and quality control problems that play significant roles in industrial manufacturing. Reverse engineering attempts to rebuild a 3D model from the scanned data captured from a object, which is the problem similar to 3D surface reconstruction. Quality control is a process in which the quality of all factors involved in production is monitored and revised. In fact, the above systems currently require significant intervention from experienced users, and are thus still far from being fully automated. Therefore, many challenges still need to be addressed to achieve the desired performance for automated production. The first proposition of this thesis is to extract 3D geometric primitives from point clouds for reverse engineering and surface reconstruction. A complete framework to extract multiple types of primitives from 3D data is proposed. In particular, a novel validation method is also proposed to assess the quality of the extracted primitives. At the end, all primitives present in the point cloud are extracted with their associated data points and descriptive parameters. These results could be used in various applications such as scene and building reconstruction, constructive solid geometry, etc. The second proposition of the thesis is to align two 3D datasets using the extracted geometric primitives, which is introduced as a novel and robust descriptor. The idea of using primitives for alignment is addressed several challenges faced by existing registration methods. This alignment problem is an essential step in 3D modeling, registration and model retrieval. Finally, an automatic method to extract sharp features from 3D data of man-made objects is also proposed. By integrating the extracted sharp features into the alignment framework, it is possible implement automatic assignment of primitive correspondences using attribute relational graph matching. Each primitive is considered as a node of the graph and an attribute relational graph is created to provide a structural and relational description between primitives. We have experimented all the proposed algorithms on different synthetic and real scanned datasets. Our algorithms not only are successful in completing their tasks with good results but also outperform other methods. We believe that the contribution of them could be useful in many applications

Airborne laser scanning reveals large tree trunks on forest floor

Fallen trees decompose on the forest floor and create habitats for many species. Thus, mapping fallen trees allows identifying the most valuable areas regarding biodiversity, especially in boreal forests, enabling well-focused conservation and restoration actions. Airborne laser scanning (ALS) is capable of characterizing forests and the underlying topography. However, its potential for detecting and characterizing fallen trees under varying boreal forest conditions is not yet well understood. ALS-based fallen tree detection methods could improve our understanding regarding the spatiotemporal characteristics of dead wood over large landscapes. We developed and tested an automatic method for mapping individual fallen trees from an ALS point cloud with a point density of 15 points/m2. The presented method detects fallen trees using iterative Hough line detection and delineates the trees around the detected lines using region growing. Furthermore, we conducted a detailed evaluation of how the performance of ALS-based fallen tree detection is impacted by characteristics of fallen trees and the structure of vegetation around them. The results of this study showed that large fallen trees can be detected with a high accuracy in old-growth forests. In contrast, the detection of fallen trees in young managed stands proved challenging. The presented method was able to detect 78% of the largest fallen trees (diameter at breast height, DBH > 300 mm), whereas 30% of all trees with a DBH over 100 mm were detected. The performance of the detection method was positively correlated with both the size of fallen trees and the size of living trees surrounding them. In contrast, the performance was negatively correlated with the amount of undergrowth, ground vegetation, and the state of decay of fallen trees. Especially undergrowth and ground vegetation impacted the performance negatively, as they covered some of the fallen trees and lead to false fallen tree detections. Based on the results of this study, ALS-based collection of fallen tree information should be focused on old-growth forests and mature managed forests, at least with the current operative point densities.Peer reviewe

Digital twinning of railway overhead line equipment from airborne lidar data

The automated generation of geometry-only digital twins of Overhead Line Equipment (OLE) system in existing railways from point clouds is an unsolved problem. Currently, this process is highly reliant upon manual inputs, needing 10 times more labour hours than scanning the physical asset. The resulting modelling cost counteracts the expected benefits of the digital twin. We tackle this challenge using a novel model-driven method that exploits the highly regulated and standardised nature of railways. It starts by restricting the search for OLE elements relative to point clusters of the railway masts. The resulting point clusters of the OLE elements are then converged with various parametric models of different catenary configurations to verify the presence of OLE elements and to find the best possible fit. The method outputs a geometry-only digital twin of the OLE system in Industry Foundation Classes (IFC) format. The method was tested on an 18 km railway point cloud and achieves overall detection rates of 93.2% F1 score for OLE cables and 98.1% F1 score for other OLE elements. The accuracy of the generated model is evaluated using distance-based metrics between the ground truth model and the automated model. The average modelling distance is 3.82 cm Root Mean Square Error (RMSE) for all 18 km dataCambridge Commonwealth, European & International Trust Bentley Systems UK Plc

State of research in automatic as-built modelling

This is the final version of the article. It first appeared from Elsevier via http://dx.doi.org/10.1016/j.aei.2015.01.001Building Information Models (BIMs) are becoming the official standard in the construction industry for encoding, reusing, and exchanging information about structural assets. Automatically generating such representations for existing assets stirs up the interest of various industrial, academic, and governmental parties, as it is expected to have a high economic impact. The purpose of this paper is to provide a general overview of the as-built modelling process, with focus on the geometric modelling side. Relevant works from the Computer Vision, Geometry Processing, and Civil Engineering communities are presented and compared in terms of their potential to lead to automatic as-built modelling.We acknowledge the support of EPSRC Grant NMZJ/114,DARPA UPSIDE Grant A13–0895-S002, NSF CAREER Grant N. 1054127, European Grant Agreements No. 247586 and 334241. We would also like to thank NSERC Canada, Aecon, and SNC-Lavalin for financially supporting some parts of this research