Point cloud segmentation using hierarchical tree for architectural models

Recent developments in the 3D scanning technologies have made the generation of highly accurate 3D point clouds relatively easy but the segmentation of these point clouds remains a challenging area. A number of techniques have set precedent of either planar or primitive based segmentation in literature. In this work, we present a novel and an effective primitive based point cloud segmentation algorithm. The primary focus, i.e. the main technical contribution of our method is a hierarchical tree which iteratively divides the point cloud into segments. This tree uses an exclusive energy function and a 3D convolutional neural network, HollowNets to classify the segments. We test the efficacy of our proposed approach using both real and synthetic data obtaining an accuracy greater than 90% for domes and minarets.Comment: 9 pages. 10 figures. Submitted in EuroGraphics 201

Probabilistic RGB-D Odometry based on Points, Lines and Planes Under Depth Uncertainty

This work proposes a robust visual odometry method for structured environments that combines point features with line and plane segments, extracted through an RGB-D camera. Noisy depth maps are processed by a probabilistic depth fusion framework based on Mixtures of Gaussians to denoise and derive the depth uncertainty, which is then propagated throughout the visual odometry pipeline. Probabilistic 3D plane and line fitting solutions are used to model the uncertainties of the feature parameters and pose is estimated by combining the three types of primitives based on their uncertainties. Performance evaluation on RGB-D sequences collected in this work and two public RGB-D datasets: TUM and ICL-NUIM show the benefit of using the proposed depth fusion framework and combining the three feature-types, particularly in scenes with low-textured surfaces, dynamic objects and missing depth measurements.Comment: Major update: more results, depth filter released as opensource, 34 page

3D indoor scene modeling from RGB-D data: a survey

3D scene modeling has long been a fundamental problem in computer graphics and computer vision. With the popularity of consumer-level RGB-D cameras, there is a growing interest in digitizing real-world indoor 3D scenes. However, modeling indoor 3D scenes remains a challenging problem because of the complex structure of interior objects and poor quality of RGB-D data acquired by consumer-level sensors. Various methods have been proposed to tackle these challenges. In this survey, we provide an overview of recent advances in indoor scene modeling techniques, as well as public datasets and code libraries which can facilitate experiments and evaluation

OBLIQUE PHOTOGRAMMETRY SUPPORTING 3D URBAN RECONSTRUCTION OF COMPLEX SCENARIOS

Accurate 3D city models represent an important source of geospatial information to support various “smart city” applications, such as space management, energy assessment, 3D cartography, noise and pollution mapping as well as disaster management. Even though remarkable progress has been made in recent years, there are still many open issues, especially when it comes to the 3D modelling of complex urban scenarios like historical and densely-built city centres featuring narrow streets and non-conventional building shapes. Most approaches introduce strong building priors/constraints on symmetry and roof typology that penalize urban environments having high variations of roof shapes. Furthermore, although oblique photogrammetry is rapidly maturing, the use of slanted views for façade reconstruction is not completely included in the reconstruction pipeline of state-of-the-art software. This paper aims to investigate state-of-the-art methods for 3D building modelling in complex urban scenarios with the support of oblique airborne images. A reconstruction approach based on roof primitives fitting is tested. Oblique imagery is then exploited to support the manual editing of the generated building models. At the same time, mobile mapping data are collected at cm resolution and then integrated with the aerial ones. All approaches are tested on the historical city centre of Bergamo (Italy)

OBLIQUE PHOTOGRAMMETRY SUPPORTING 3D URBAN RECONSTRUCTION OF COMPLEX SCENARIOS

open9siAccurate 3D city models represent an important source of geospatial information to support various “smart city” applications, such as space management, energy assessment, 3D cartography, noise and pollution mapping as well as disaster management. Even though remarkable progress has been made in recent years, there are still many open issues, especially when it comes to the 3D modelling of complex urban scenarios like historical and densely-built city centres featuring narrow streets and non-conventional building shapes. Most approaches introduce strong building priors/constraints on symmetry and roof typology that penalize urban environments having high variations of roof shapes. Furthermore, although oblique photogrammetry is rapidly maturing, the use of slanted views for façade reconstruction is not completely included in the reconstruction pipeline of state-of-the-art software. This paper aims to investigate state-of-the-art methods for 3D building modelling in complex urban scenarios with the support of oblique airborne images. A reconstruction approach based on roof primitives fitting is tested. Oblique imagery is then exploited to support the manual editing of the generated building models. At the same time, mobile mapping data are collected at cm resolution and then integrated with the aerial ones. All approaches are tested on the historical city centre of Bergamo (Italy).openToschi, I.; Ramos, M. M.; Nocerino, E.; Menna, F.; Remondino, F.; Moe, K.; Poli, D.; Legat, K.; Fassi, F.Toschi, I.; Ramos, M. M.; Nocerino, E.; Menna, F.; Remondino, F.; Moe, K.; Poli, D.; Legat, K.; Fassi, Francesc

Automated segmentation, detection and fitting of piping elements from terrestrial LIDAR data

Since the invention of light detection and ranging (LIDAR) in the early 1960s, it has been adopted for use in numerous applications, from topographical mapping with airborne LIDAR platforms to surveying of urban sites with terrestrial LIDAR systems. Static terrestrial LIDAR has become an especially effective tool for surveying, in some cases replacing traditional techniques such as electronic total stations and GPS methods. Current state-of-the-art LIDAR scanners have very fine spatial resolution, generating precise 3D point cloud data with millimeter accuracy. Therefore, LIDAR data can provide 3D details of a scene with an unprecedented level of details. However, automated exploitation of LIDAR data is challenging, due to the non-uniform spatial sampling of the point clouds as well as to the massive volumes of data, which may range from a few million points to hundreds of millions of points depending on the size and complexity of the scene being scanned. ^ This dissertation focuses on addressing these challenges to automatically exploit large LIDAR point clouds of piping systems in industrial sites, such as chemical plants, oil refineries, and steel mills. A complete processing chain is proposed in this work, using raw LIDAR point clouds as input and generating cylinder parameter estimates for pipe segments as the output, which could then be used to produce computer aided design (CAD) models of pipes. The processing chain consists of three stages: (1) segmentation of LIDAR point clouds, (2) detection and identification of piping elements, and (3) cylinder fitting and parameter estimation. The final output of the cylinder fitting stage gives the estimated orientation, position, and radius of each detected pipe element. ^ A robust octree-based split and merge segmentation algorithm is proposed in this dissertation that can efficiently process LIDAR data. Following octree decomposition of the point cloud, graph theory analysis is used during the splitting process to separate points within each octant into components based on spatial connectivity. A series of connectivity criteria (proximity, orientation, and curvature) are developed for the merging process, which exploits contextual information to effectively merge cylindrical segments into complete pipes and planar segments into complete walls. Furthermore, by conducting surface fitting of segments and analyzing their principal curvatures, the proposed segmentation approach is capable of detecting and identifying the piping segments. ^ A novel cylinder fitting technique is proposed to accurately estimate the cylinder parameters for each detected piping segment from the terrestrial LIDAR point cloud. Specifically, the orientation, radius, and position of each piping element must be robustly estimated in the presence of noise. An original formulation has been developed to estimate the cylinder axis orientation using gradient descent optimization of an angular distance cost function. The cost function is based on the concept that surface normals of points in a cylinder point cloud are perpendicular to the cylinder axis. The key contribution of this algorithm is its capability to accurately estimate the cylinder orientation in the presence of noise without requiring a good initial starting point. After estimation of the cylinder\u27s axis orientation, the radius and position are then estimated in the 2D space formed from the projection of the 3D cylinder point cloud onto the plane perpendicular to the cylinder\u27s axis. With these high quality approximations, a least squares estimation in 3D is made for the final cylinder parameters. ^ Following cylinder fitting, the estimated parameters of each detected piping segment are used to generate a CAD model of the piping system. The algorithms and techniques in this dissertation form a complete processing chain that can automatically exploit large LIDAR point cloud of piping systems and generate CAD models