Consistent Density Scanning and Information Extraction From Point Clouds of Building Interiors

Over the last decade, 3D range scanning systems have improved considerably enabling the designers to capture large and complex domains such as building interiors. The captured point cloud is processed to extract specific Building Information Models, where the main research challenge is to simultaneously handle huge and cohesive point clouds representing multiple objects, occluded features and vast geometric diversity. These domain characteristics increase the data complexities and thus make it difficult to extract accurate information models from the captured point clouds. The research work presented in this thesis improves the information extraction pipeline with the development of novel algorithms for consistent density scanning and information extraction automation for building interiors. A restricted density-based, scan planning methodology computes the number of scans to cover large linear domains while ensuring desired data density and reducing rigorous post-processing of data sets. The research work further develops effective algorithms to transform the captured data into information models in terms of domain features (layouts), meaningful data clusters (segmented data) and specific shape attributes (occluded boundaries) having better practical utility. Initially, a direct point-based simplification and layout extraction algorithm is presented that can handle the cohesive point clouds by adaptive simplification and an accurate layout extraction approach without generating an intermediate model. Further, three information extraction algorithms are presented that transforms point clouds into meaningful clusters. The novelty of these algorithms lies in the fact that they work directly on point clouds by exploiting their inherent characteristic. First a rapid data clustering algorithm is presented to quickly identify objects in the scanned scene using a robust hue, saturation and value (H S V) color model for better scene understanding. A hierarchical clustering algorithm is developed to handle the vast geometric diversity ranging from planar walls to complex freeform objects. The shape adaptive parameters help to segment planar as well as complex interiors whereas combining color and geometry based segmentation criterion improves clustering reliability and identifies unique clusters from geometrically similar regions. Finally, a progressive scan line based, side-ratio constraint algorithm is presented to identify occluded boundary data points by investigating their spatial discontinuity

AUTOMATIC FAÇADE SEGMENTATION FOR THERMAL RETROFIT

Abstract. In this paper we present an automated method to derive highly detailed 3D vector models of modern building facades from terrestrial laser scanning data. The developed procedure can be divided into two main steps: firstly the main elements constituting the facade are identified by means of a segmentation process, then the 3D vector model is generated including some priors on architectural scenes. The identification of main facade elements is based on random sampling and detection of planar elements including topology information in the process to reduce under- and over-segmentation problems. Finally, the prevalence of straight lines and orthogonal intersections in the vector model generation phase is exploited to set additional constraints to enforce automated modeling. Contemporary a further classification is performed, enriching the data with semantics by means of a classification tree. The main application field for these vector models is the design of external insulation thermal retrofit. In particular, in this paper we present a possible application for energy efficiency evaluation of buildings by mean of Infrared Thermography data overlaid to the facade model

Photogrammetry as a surveying thechnique apllied to heritage constructions recording - avantages and limitations

Dissertação de Mestrado Integrado em Arquitetura, com a especialização em Arquitetura apresentada na Faculdade de Arquitetura da Universidade de Lisboa para obtenção do grau de Mestre.A presente dissertação tem por objectivo investigar e evidenciar as vantagens da aplicação da fotogrametria, e possíveis integrações com outros métodos de levantamento, como seja o varrimento laser terrestre, posicionamento por GPS, entre outros, para realizar levantamentos de construções patrimoniais ou eruditas e a respectiva produção de documentação base para viabilizar intervenções de conservação, restauro ou reabilitação. A motivação para a investigação advém da aplicação flexível, versátil, simples, acessível, e baixo-custo da fotogrametria em projectos de levantamento pequenos ou extensos. Tenciona-se igualmente colmatar as desvantagens tradicionais da fotogrametria, nomeadamente a transição entre espaços interiores e exteriores, e registo de espaços estreitos, de difícil acesso, e de geometrias complexas, num único projecto de documentação. Pretende-se ultrapassar estas dificuldades através da utilização máxima das potencialidades da fotogrametria com o uso de imagens olho de peixe e apenas como último recurso utilizar instrumentos complementares. No caso de estudo principal, o Castelo do Convento de Cristo, demonstra-se a aplicação dos métodos investigados. Nos casos de estudo secundários abordam-se problemas parcelares, desde elementos decorativos até à totalidade do edificado: Convento dos Capuchos, em Sintra; Alcáçova e trecho de muralha do Castelo de Sesimbra; Igreja de Stº André, em Mafra; entre outros. Os casos auxiliaram na determinação de procedimentos a generalizar posteriormente. Por fim, propõem-se algoritmos que auxiliam na produção de documentação.ABSTRACT: The present dissertation aims to research and demonstrate the advantages of the application of photogrammetry, and its possible integrations with other methods, such as terrestrial laser scanning, GPS positioning, and among others, to perform surveys of heritage or erudite buildings and respective production of base documentation to enable interventions of conservation, restoration, or rehabilitation. The motivation for researching is due to the flexible, versatile, simple, affordable, and low-cost application of photogrammetry in small and extensive survey projects. It is also intended to overcome the traditional disadvantages of photogrammetry, such as the transition between interior and exterior spaces, and difficulty of recording narrow, hard-to-access, and complex geometric spaces, in a single project. It is intended to overcome such challenges by maximizing the potential uses of photogrammetry with the use of fisheye images and by using other survey instruments as a last resort. In the main case study, the Castle of the Convent of Christ, the application of the investigated methods is demonstrated. In the secondary case studies, partial problems are addressed, ranging from decorative elements to the entire building: Convento dos Capuchos, in Sintra; Citadel and section of a wall of the Castle of Sesimbra; Igreja de St André, in Mafra; among others; The case studies aided in determining general procedures. Finally, algorithms that accelerate the production of documentation are proposed.N/

Semantizing Complex 3D Scenes using Constrained Attribute Grammars

International audienceWe propose a new approach to automatically semantize complex objects in a 3D scene. For this, we define an expressive formalism combining the power of both attribute grammars and constraint. It offers a practical conceptual interface, which is crucial to write large maintainable specifications. As recursion is inadequate to express large collections of items, we introduce maximal operators, that are essential to reduce the parsing search space. Given a grammar in this formalism and a 3D scene, we show how to automatically compute a shared parse forest of all interpretations -- in practice, only a few, thanks to relevant constraints. We evaluate this technique for building model semantization using CAD model examples as well as photogrammetric and simulated LiDAR data

Airborne LiDAR for DEM generation: some critical issues

Airborne LiDAR is one of the most effective and reliable means of terrain data collection. Using LiDAR data for DEM generation is becoming a standard practice in spatial related areas. However, the effective processing of the raw LiDAR data and the generation of an efficient and high-quality DEM remain big challenges. This paper reviews the recent advances of airborne LiDAR systems and the use of LiDAR data for DEM generation, with special focus on LiDAR data filters, interpolation methods, DEM resolution, and LiDAR data reduction. Separating LiDAR points into ground and non-ground is the most critical and difficult step for DEM generation from LiDAR data. Commonly used and most recently developed LiDAR filtering methods are presented. Interpolation methods and choices of suitable interpolator and DEM resolution for LiDAR DEM generation are discussed in detail. In order to reduce the data redundancy and increase the efficiency in terms of storage and manipulation, LiDAR data reduction is required in the process of DEM generation. Feature specific elements such as breaklines contribute significantly to DEM quality. Therefore, data reduction should be conducted in such a way that critical elements are kept while less important elements are removed. Given the highdensity characteristic of LiDAR data, breaklines can be directly extracted from LiDAR data. Extraction of breaklines and integration of the breaklines into DEM generation are presented

Infrared face recognition: a comprehensive review of methodologies and databases

Automatic face recognition is an area with immense practical potential which includes a wide range of commercial and law enforcement applications. Hence it is unsurprising that it continues to be one of the most active research areas of computer vision. Even after over three decades of intense research, the state-of-the-art in face recognition continues to improve, benefitting from advances in a range of different research fields such as image processing, pattern recognition, computer graphics, and physiology. Systems based on visible spectrum images, the most researched face recognition modality, have reached a significant level of maturity with some practical success. However, they continue to face challenges in the presence of illumination, pose and expression changes, as well as facial disguises, all of which can significantly decrease recognition accuracy. Amongst various approaches which have been proposed in an attempt to overcome these limitations, the use of infrared (IR) imaging has emerged as a particularly promising research direction. This paper presents a comprehensive and timely review of the literature on this subject. Our key contributions are: (i) a summary of the inherent properties of infrared imaging which makes this modality promising in the context of face recognition, (ii) a systematic review of the most influential approaches, with a focus on emerging common trends as well as key differences between alternative methodologies, (iii) a description of the main databases of infrared facial images available to the researcher, and lastly (iv) a discussion of the most promising avenues for future research.Comment: Pattern Recognition, 2014. arXiv admin note: substantial text overlap with arXiv:1306.160

Skeletonization and segmentation of binary voxel shapes

Preface. This dissertation is the result of research that I conducted between January 2005 and December 2008 in the Visualization research group of the Technische Universiteit Eindhoven. I am pleased to have the opportunity to thank a number of people that made this work possible. I owe my sincere gratitude to Alexandru Telea, my supervisor and first promotor. I did not consider pursuing a PhD until my Master’s project, which he also supervised. Due to our pleasant collaboration from which I learned quite a lot, I became convinced that becoming a doctoral student would be the right thing to do for me. Indeed, I can say it has greatly increased my knowledge and professional skills. Alex, thank you for our interesting discussions and the freedom you gave me in conducting my research. You made these four years a pleasant experience. I am further grateful to Jack vanWijk, my second promotor. Our monthly discussions were insightful, and he continuously encouraged me to take a more formal and scientific stance. I would also like to thank Prof. Jan de Graaf from the department of mathematics for our discussions on some of my conjectures. His mathematical rigor was inspiring. I am greatly indebted to the Netherlands Organisation for Scientific Research (NWO) for funding my PhD project (grant number 612.065.414). I thank Prof. Kaleem Siddiqi, Prof. Mark de Berg, and Dr. Remco Veltkamp for taking part in the core doctoral committee and Prof. Deborah Silver and Prof. Jos Roerdink for participating in the extended committee. Our Visualization group provides a great atmosphere to do research in. In particular, I would like to thank my fellow doctoral students Frank van Ham, Hannes Pretorius, Lucian Voinea, Danny Holten, Koray Duhbaci, Yedendra Shrinivasan, Jing Li, NielsWillems, and Romain Bourqui. They enabled me to take my mind of research from time to time, by discussing political and economical affairs, and more trivial topics. Furthermore, I would like to thank the senior researchers of our group, Huub van de Wetering, Kees Huizing, and Michel Westenberg. In particular, I thank Andrei Jalba for our fruitful collaboration in the last part of my work. On a personal level, I would like to thank my parents and sister for their love and support over the years, my friends for providing distractions outside of the office, and Michelle for her unconditional love and ability to light up my mood when needed