Recognition of one class of quadrics from 3D point clouds

Within cyber physical production systems 3D vision as a source of information from real-world provides enormous possibilities. While the hardware of contemporary 3D scanners is characterized by high speed along with high resolution and accuracy, there is a lack of real-time online data processing algorithms that would give certain elements of intelligence to the sensory system. Critical elements of data processing software are efficient, real-time applicable methods for fully automatic recognition of high level geometric primitives from point cloud (surface segmentation and fitting). This paper presents a method for recognition of one class of quadrics from 3D point clouds, in particular for recognition of cylinders, elliptical cylinders and ellipsoids. The method is based on the properties of scatter matrix during direct least squares fitting of ellipsoids. Presented recognition procedure can be employed for segmentation of regions with G1 or higher continuity, and this is its comparative advantage to similar methods. The applicability of the method is illustrated and experimentally verified using two case studies. First case study refers to a synthesized, and the second to a real-world scanned point cloud

Recognition of one class of quadrics from 3D point clouds

Within cyber physical production systems 3D vision as a source of information from real-world provides enormous possibilities. While the hardware of contemporary 3D scanners is characterized by high speed along with high resolution and accuracy, there is a lack of real-time online data processing algorithms that would give certain elements of intelligence to the sensory system. Critical elements of data processing software are efficient, real-time applicable methods for fully automatic recognition of high level geometric primitives from point cloud (surface segmentation and fitting). This paper presents a method for recognition of one class of quadrics from 3D point clouds, in particular for recognition of cylinders, elliptical cylinders and ellipsoids. The method is based on the properties of scatter matrix during direct least squares fitting of ellipsoids. Presented recognition procedure can be employed for segmentation of regions with G1 or higher continuity, and this is its comparative advantage to similar methods. The applicability of the method is illustrated and experimentally verified using two case studies. First case study refers to a synthesized, and the second to a real-world scanned point cloud

Recognition of one class of surfaces from structured point cloud

U određenim oblastima industrije postoji potreba za generisanjem kompjuterskih modela objekata samo na osnovu njihove fizičke realizacije, a bez unapred poznatih konstrukcionih ili tehnoloških informacija. Pri realizaciji ovakvih zahteva istaknuto mesto zauzimaju tzv. tehnike reverznog inženjerstva geometrijskih modela. Bitnu fazu primene navedenih tehnika predstavlja prepoznavanje geometrijskih primitiva od kojih se posmatrani objekat sastoji. U ovom radu predstavljen je metod za segmentaciju i prepoznavanje G1 kontinualnih površina koje su u skenirnim linijama struktuiranog oblaka predstavljene eliptičnim segmentima. Predloženi algoritam je pre svega namenjen za prepoznavanje eliptičkih cilindara, elipsoida i eliptičkih torusa, ali se u zavisnosti od načina skeniranja dela, može koristiti i za prepoznavanje još nekih površi drugog reda. Proces segmentacije je zasnovan na prepoznavanju eliptičkih segmenata u skeniranim linijama, a na osnovu osobina singulariteta informacione matrice pri regresionoj analizi metodom najmanjih kvadrata. Verifikacija predloženog metoda je izvršena procesiranjem tri sintetizovana, kao i jednog realnog oblaka tačaka.This paper presents a method for recognition of surfaces represented by elliptical segments in structured three dimensional (3D) point clouds. The method is based on direct least squares fitting of ellipses in scanned lines. By recognizing elliptical segments in both directions of structured cloud it is possible to efficiently allocate G1 (and higher) continuous regions which represent a certain class of surfaces. The proposed method is primarily developed for recognition of elliptical cylinders and ellipsoids, including cylinders and spheres. Depending on scanning mode, the method can be employed for recognition of other second degree surfaces like cones. Besides, as presented in the paper, the method can be utilized for recognition of certain class of higher degree surfaces such as elliptical tori. The proposed method is experimentally verified using several synthesized point clouds as well as using a real world case study

Recognition of elliptical segments in scanned lines

Cylindrical surfaces, as one of the most frequent surfaces in mechanical engineering, are represented by elliptical (circular) or linear segments in scanned lines within structured point cloud. Having this in mind, segmentation and fitting of elliptical regions is a very important issue in the recognition of cylindrical surfaces. This paper presents the research in the recognition of elliptical (or circular) segments in scanned lines. Segments connected with G1 (or higher) continuity are considered. Presented method is based on seed independent region growing using direct least squares fitting of ellipses. The method is tested in the case studies considering synthesized as well as real world (scanned lines) examples

Recognition of quadrics from 3d point clouds generated by scanning of rotational parts

This paper presents a method for recognition of second order surfaces (quadrics) from point clouds containing information about scanned rotational parts. The method is region growing method that exploits the scatter of data during least squares fitting of quadrics as a region growing criterion. The presented procedure is convenient for segmentation of regions with high (G1 or higher) continuity. Besides, the region seed point is automatically selected which is its comparative advantage to a number of existing methods. The applicability of the proposed method is evaluated using two case studies; the first case study refers to a synthesized signal, and the second presents the applicability of the method on a real world example.*Ovaj rad je izabran sa konferencije 12th International Scientific Conference MMA 2015 - Flexible Technologies, i publikovan u casopisu Journal of Production Engineering

Recognition of quadrics from 3d point clouds generated by scanning of rotational parts

This paper presents a method for recognition of second order surfaces (quadrics) from point clouds containing information about scanned rotational parts. The method is region growing method that exploits the scatter of data during least squares fitting of quadrics as a region growing criterion. The presented procedure is convenient for segmentation of regions with high (G1 or higher) continuity. Besides, the region seed point is automatically selected which is its comparative advantage to a number of existing methods. The applicability of the proposed method is evaluated using two case studies; the first case study refers to a synthesized signal, and the second presents the applicability of the method on a real world example.*Ovaj rad je izabran sa konferencije 12th International Scientific Conference MMA 2015 - Flexible Technologies, i publikovan u casopisu Journal of Production Engineering

Recognition of one class of quadric surfaces from unstructured point cloud

Critical elements of the state of the art three-dimensional (3D) point cloud processing software are the algorithms for retrieval of high level geometric primitives from raw data. This paper presents a method for recognition of a class of quadric surfaces, in particular for recognition of cylinders, elliptical cylinders, and ellipsoids from 3D point clouds. The method is based on direct least squares fitting of ellipsoids, and it exploits the closeness of scatter matrix to singular in the case when data are sampled for an approximate ellipsoid. This method belongs to the class of region growing methods, and the region is expanded using region growing strategy that is also proposed in this paper. Presented recognition procedure is suitable for segmentation of regions with G1 or higher continuality, and this is its advantage when compared to similar methods. Besides, recognition of quadric surfaces can be performed on unstructured, as well as on structured point clouds. The applicability of the method is illustrated and experimentally verified using two examples that contain G1 continuous surfaces from the considered class. The first example represents synthesized, and the second real-world scanned point cloud

Segmentacija jedne klase površi drugog reda iz struktuiranog oblaka tačaka

U radu se predlaže metod za segmentaciju jedne klase površi drugog reda (kvadrika) iz struktuiranog oblaka tačaka. Metod je zasnovan na segmentaciji elipsi iz skeniranih linija direktnom regresijom metodom najmanjih kvadrata. Segmentacijom elipsi u oba pravca struktuiranog oblaka mogu se efikasno izdvojiti G1 (i više) kontinualni regioni koji odgovaraju određenim površima drugog reda. Predloženi metod je pre svega namenjen segmentaciji eliptičkih cilindara i elipsoida čije posebne slučajeve predstavljaju cilindar i sfera, a u zavisnosti od načina skeniranja može se upotrebiti i za segmentaciju drugih kvadrika (na primer konusa). Pored toga, u radu se pokazuje da metod daje dobre rezultate i u segmentaciji površi višeg reda u odnosu na kvadrike – na primer eliptičkih torusa. Predloženi metod je eksperimentalno verifikovan na većem broju sintetizovanih oblaka tačaka kao i na primeru skeniranog dela iz realnog sveta

Prepoznavanje cilindara i ravni u trodimenzionim oblacima tačaka

U radu se predlaže metod za prepoznavanje cilindara i ravni u nestruktuiranim oblacima tačaka. Predloženi proces prepoznavanja se može podeliti u tri osnovne faze. Prvu fazu predstavlja automatska segmentacija širenjem regiona počev od jedne karakteristične tačke. Kriterijumi širenja regiona zasnovani su na osobinama singularnosti informacione matrice sistema kao i pripadnosti tačaka površi čiji su parametri estimirani metodom najmanjih kvadrata. Druga faza algoritma se odnosi na grupisanje presegmentiranih oblasti i estimaciju parametara prepoznatih cilindara i ravni. Dobre performanse ovoj fazi obezbeđuje upotreba unapređenog algoritma robusnog prepoznavanja cilindara iz oblaka tačaka kao i uvođenje procesa precizne estimacije parametara ravni. Na samom kraju, odnosno u trećoj fazi procesa upotrebom predloženog algoritma vrši se ponovna obrada celokupnog polaznog oblaka tačaka u cilju ekstrakcije prepoznatih primitiva i obezbeđivanja preciznih krajnjih rezultata. Predloženi metod je pre svega namenjen prepoznavanju cilindara i ravni u oblacima tačaka koji reprezentuju određene mašinske delove, pa je u skladu sa tim i eksperimentalno verifikovan na većem broju odgovarajućih sintetizovanih oblaka

Extraction robuste de primitives géométriques 3D dans un nuage de points et alignement basé sur les primitives

Dans ce projet, nous étudions les problèmes de rétro-ingénierie et de contrôle de la qualité qui jouent un rôle important dans la fabrication industrielle. La rétro-ingénierie tente de reconstruire un modèle 3D à partir de nuages de points, qui s’apparente au problème de la reconstruction de la surface 3D. Le contrôle de la qualité est un processus dans lequel la qualité de tous les facteurs impliqués dans la production est abordée. En fait, les systèmes ci-dessus nécessitent beaucoup d’intervention de la part d’un utilisateur expérimenté, résultat souhaité est encore loin soit une automatisation complète du processus. Par conséquent, de nombreux défis doivent encore être abordés pour atteindre ce résultat hautement souhaitable en production automatisée. La première question abordée dans la thèse consiste à extraire les primitives géométriques 3D à partir de nuages de points. Un cadre complet pour extraire plusieurs types de primitives à partir de données 3D est proposé. En particulier, une nouvelle méthode de validation est proposée pour évaluer la qualité des primitives extraites. À la fin, toutes les primitives présentes dans le nuage de points sont extraites avec les points de données associés et leurs paramètres descriptifs. Ces résultats pourraient être utilisés dans diverses applications telles que la reconstruction de scènes on d’édifices, la géométrie constructive et etc. La seconde question traiée dans ce travail porte sur l’alignement de deux ensembles de données 3D à l’aide de primitives géométriques, qui sont considérées comme un nouveau descripteur robuste. L’idée d’utiliser les primitives pour l’alignement arrive à surmonter plusieurs défis rencontrés par les méthodes d’alignement existantes. Ce problème d’alignement est une étape essentielle dans la modélisation 3D, la mise en registre, la récupération de modèles. Enfin, nous proposons également une méthode automatique pour extraire les discontinutés à partir de données 3D d’objets manufacturés. En intégrant ces discontinutés au problème d’alignement, il est possible d’établir automatiquement les correspondances entre primitives en utilisant l’appariement de graphes relationnels avec attributs. Nous avons expérimenté tous les algorithmes proposés sur différents jeux de données synthétiques et réelles. Ces algorithmes ont non seulement réussi à accomplir leur tâches avec succès mais se sont aussi avérés supérieus aux méthodes proposées dans la literature. Les résultats présentés dans le thèse pourraient s’avérér utilises à plusieurs applications.In this research project, we address reverse engineering and quality control problems that play significant roles in industrial manufacturing. Reverse engineering attempts to rebuild a 3D model from the scanned data captured from a object, which is the problem similar to 3D surface reconstruction. Quality control is a process in which the quality of all factors involved in production is monitored and revised. In fact, the above systems currently require significant intervention from experienced users, and are thus still far from being fully automated. Therefore, many challenges still need to be addressed to achieve the desired performance for automated production. The first proposition of this thesis is to extract 3D geometric primitives from point clouds for reverse engineering and surface reconstruction. A complete framework to extract multiple types of primitives from 3D data is proposed. In particular, a novel validation method is also proposed to assess the quality of the extracted primitives. At the end, all primitives present in the point cloud are extracted with their associated data points and descriptive parameters. These results could be used in various applications such as scene and building reconstruction, constructive solid geometry, etc. The second proposition of the thesis is to align two 3D datasets using the extracted geometric primitives, which is introduced as a novel and robust descriptor. The idea of using primitives for alignment is addressed several challenges faced by existing registration methods. This alignment problem is an essential step in 3D modeling, registration and model retrieval. Finally, an automatic method to extract sharp features from 3D data of man-made objects is also proposed. By integrating the extracted sharp features into the alignment framework, it is possible implement automatic assignment of primitive correspondences using attribute relational graph matching. Each primitive is considered as a node of the graph and an attribute relational graph is created to provide a structural and relational description between primitives. We have experimented all the proposed algorithms on different synthetic and real scanned datasets. Our algorithms not only are successful in completing their tasks with good results but also outperform other methods. We believe that the contribution of them could be useful in many applications