A Novel Framework for Highlight Reflectance Transformation Imaging

We propose a novel pipeline and related software tools for processing the multi-light image collections (MLICs) acquired in different application contexts to obtain shape and appearance information of captured surfaces, as well as to derive compact relightable representations of them. Our pipeline extends the popular Highlight Reflectance Transformation Imaging (H-RTI) framework, which is widely used in the Cultural Heritage domain. We support, in particular, perspective camera modeling, per-pixel interpolated light direction estimation, as well as light normalization correcting vignetting and uneven non-directional illumination. Furthermore, we propose two novel easy-to-use software tools to simplify all processing steps. The tools, in addition to support easy processing and encoding of pixel data, implement a variety of visualizations, as well as multiple reflectance-model-fitting options. Experimental tests on synthetic and real-world MLICs demonstrate the usefulness of the novel algorithmic framework and the potential benefits of the proposed tools for end-user applications.Terms: "European Union (EU)" & "Horizon 2020" / Action: H2020-EU.3.6.3. - Reflective societies - cultural heritage and European identity / Acronym: Scan4Reco / Grant number: 665091DSURF project (PRIN 2015) funded by the Italian Ministry of University and ResearchSardinian Regional Authorities under projects VIGEC and Vis&VideoLa

Decision support system for form verification of manufactured parts.

The form verification of manufactured parts is a process composed of a set of operations that are expensive and yet add no value to the product. Yet, the resources used to inspect the parts add a small but significant amount of noise that can affect the outcome of the process. For this reason, this research provides guidelines to effectively perform the inspection process by suggesting new mathematical models and approaches that can be used for the creation of a decision support system that can assist in the verification of the accuracy of machined parts.This research proposes two approaches to improve the robustness of the mathematical models from the noise induced by the inspection process. The Dynamic Angle Approach (DAA) and the Free Form Orientation approach (FFO) presented here focus on finding the parameters of the axes and origin of the form that counteract the inaccuracies of the inspection equipment.In summary, this research suggests formalized methods for feature extraction, sampling, path planning, and form fitting, although the last mentioned received the most attention. It is believed that this comprehensive, integrated analysis will lead to the development of a decision support system.The proposed approaches and mathematical models were verified using measurements from features that were perfectly aligned with the coordinate system of the inspection equipment and from features that were intentionally misaligned. The results showed that the models were accurate and robust enough to estimate the parameters and zone of error of the form features and they performed better than existing models.The main goal of this research is to develop procedures that are simple to implement but at the same time are robust enough to provide reliable information that help the metrologist to make accurate decisions about the inspected parts. Form features such as spheres, cylinders, cones, frustums, and torus forms are commonly used to design complex parts. However, the procedures to verify most of these form features have not been developed yet by the national standards. Therefore, this research proposes new mathematical models that combine the concepts of analytic geometry and optimization to provide optimal solutions

New Confocal Hyperbola-based Ellipse Fitting with Applications to Estimating Parameters of Mechanical Pipes from Point Clouds

This manuscript presents a new method for fitting ellipses to two-dimensional data using the confocal hyperbola approximation to the geometric distance of points to ellipses. The proposed method was evaluated and compared to established methods on simulated and real-world datasets. First, it was revealed that the confocal hyperbola distance considerably outperforms other distance approximations such as algebraic and Sampson. Next, the proposed ellipse fitting method was compared with five reliable and established methods proposed by Halir, Taubin, Kanatani, Ahn and Szpak. The performance of each method as a function of rotation, aspect ratio, noise, and arc-length were examined. It was observed that the proposed ellipse fitting method achieved almost identical results (and in some cases better) than the gold standard geometric method of Ahn and outperformed the remaining methods in all simulation experiments. Finally, the proposed method outperformed the considered ellipse fitting methods in estimating the geometric parameters of cylindrical mechanical pipes from point clouds. The results of the experiments show that the confocal hyperbola is an excellent approximation to the true geometric distance and produces reliable and accurate ellipse fitting in practical settings

Model-Based Environmental Visual Perception for Humanoid Robots

The visual perception of a robot should answer two fundamental questions: What? and Where? In order to properly and efficiently reply to these questions, it is essential to establish a bidirectional coupling between the external stimuli and the internal representations. This coupling links the physical world with the inner abstraction models by sensor transformation, recognition, matching and optimization algorithms. The objective of this PhD is to establish this sensor-model coupling

Least Squares Fitting of Analytic Primitives on a GPU

Metrology systems take coordinate information directly from the surface of a manufactured part and generate millions of (X, Y, Z) data points. The inspection process often involves fitting analytic primitives such as sphere, cone, torus, cylinder and plane to these points which represent an object with the corresponding shape. Typically, a least squares fit of the parameters of the shape to the point set is performed. The least squares fit attempts to minimize the sum of the squares of the distances between the points and the primitive. The objective function however, cannot be solved in the closed form and numerical minimization techniques are required to obtain the solution. These techniques as applied to primitive fitting entail iteratively solving large systems of linear equations generally involving large floating point numbers until the solution has converged. The current problem in-process metrology faces is the large computational times for the analysis of these millions of streaming data points. This research addresses the bottleneck using the Graphical Processing Unit (GPU), primarily developed by the computer gaming industry, to optimize operations. The explosive growth in the programming capabilities and raw processing power of Graphical Processing Units has opened up new avenues for their use in non-graphic applications. The combination of large stream of data and the need for 3D vector operations make the primitive shape fit algorithms excellent candidates for processing via a GPU. The work presented in this research investigates the use of the parallel processing capabilities of the GPU in expediting specific computations involved in the fitting procedure. The least squares fit algorithms for the circle, sphere, cylinder, plane, cone and torus have been implemented on the GPU using NVIDIA\u27s Compute Unified Device Architecture (CUDA). The implementations are benchmarked against those on a CPU which are carried out using C++. The Gauss Newton minimization algorithm is used to obtain the best fit parameters for each of the aforementioned primitives. The computation times for the two implementations are compared. It is demonstrated that the GPU is about 3-4 times faster than the CPU for a relatively simple geometry such as the circle while the factor scales to about 14 for a torus which is more complex

Intrinsic Properties and Fabric Anisotropy of Sands

The intrinsic properties and fabric anisotropy of sands significantly affect their macroscopic engineering behavior including packing densities, compressibility and strength. However, due to difficulties in reliably and rapidly determining them, intrinsic properties such as gradation, particle roundness and sphericity as well as the related fabric anisotropy of soils have not received their deserved attention and usage in practice. This dissertation introduces research that has facilitated rapid and precise quantification of soil properties and fabric anisotropy using various newly developed image analysis techniques. Extensive laboratory tests were performed on sands of various gradations, roundnesses, sphericities and geologic origins to develop relationships between their intrinsic properties and macroscopic mechanical behavior. A gradation-shape-fabric based Distinct Element Modeling technique was developed to simulate the properties and fabric anisotropy of soils. Besides geotechnical engineering, the technique can be used by engineers and scientists in various disciplines including material science, geology, mining, powder sciences, pavement engineering and agriculture to simulate more realistic material particle geometries and microstructures.PHDCivil EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttps://deepblue.lib.umich.edu/bitstream/2027.42/138645/1/junxing_1.pd

Extraction robuste de primitives géométriques 3D dans un nuage de points et alignement basé sur les primitives

Dans ce projet, nous étudions les problèmes de rétro-ingénierie et de contrôle de la qualité qui jouent un rôle important dans la fabrication industrielle. La rétro-ingénierie tente de reconstruire un modèle 3D à partir de nuages de points, qui s’apparente au problème de la reconstruction de la surface 3D. Le contrôle de la qualité est un processus dans lequel la qualité de tous les facteurs impliqués dans la production est abordée. En fait, les systèmes ci-dessus nécessitent beaucoup d’intervention de la part d’un utilisateur expérimenté, résultat souhaité est encore loin soit une automatisation complète du processus. Par conséquent, de nombreux défis doivent encore être abordés pour atteindre ce résultat hautement souhaitable en production automatisée. La première question abordée dans la thèse consiste à extraire les primitives géométriques 3D à partir de nuages de points. Un cadre complet pour extraire plusieurs types de primitives à partir de données 3D est proposé. En particulier, une nouvelle méthode de validation est proposée pour évaluer la qualité des primitives extraites. À la fin, toutes les primitives présentes dans le nuage de points sont extraites avec les points de données associés et leurs paramètres descriptifs. Ces résultats pourraient être utilisés dans diverses applications telles que la reconstruction de scènes on d’édifices, la géométrie constructive et etc. La seconde question traiée dans ce travail porte sur l’alignement de deux ensembles de données 3D à l’aide de primitives géométriques, qui sont considérées comme un nouveau descripteur robuste. L’idée d’utiliser les primitives pour l’alignement arrive à surmonter plusieurs défis rencontrés par les méthodes d’alignement existantes. Ce problème d’alignement est une étape essentielle dans la modélisation 3D, la mise en registre, la récupération de modèles. Enfin, nous proposons également une méthode automatique pour extraire les discontinutés à partir de données 3D d’objets manufacturés. En intégrant ces discontinutés au problème d’alignement, il est possible d’établir automatiquement les correspondances entre primitives en utilisant l’appariement de graphes relationnels avec attributs. Nous avons expérimenté tous les algorithmes proposés sur différents jeux de données synthétiques et réelles. Ces algorithmes ont non seulement réussi à accomplir leur tâches avec succès mais se sont aussi avérés supérieus aux méthodes proposées dans la literature. Les résultats présentés dans le thèse pourraient s’avérér utilises à plusieurs applications.In this research project, we address reverse engineering and quality control problems that play significant roles in industrial manufacturing. Reverse engineering attempts to rebuild a 3D model from the scanned data captured from a object, which is the problem similar to 3D surface reconstruction. Quality control is a process in which the quality of all factors involved in production is monitored and revised. In fact, the above systems currently require significant intervention from experienced users, and are thus still far from being fully automated. Therefore, many challenges still need to be addressed to achieve the desired performance for automated production. The first proposition of this thesis is to extract 3D geometric primitives from point clouds for reverse engineering and surface reconstruction. A complete framework to extract multiple types of primitives from 3D data is proposed. In particular, a novel validation method is also proposed to assess the quality of the extracted primitives. At the end, all primitives present in the point cloud are extracted with their associated data points and descriptive parameters. These results could be used in various applications such as scene and building reconstruction, constructive solid geometry, etc. The second proposition of the thesis is to align two 3D datasets using the extracted geometric primitives, which is introduced as a novel and robust descriptor. The idea of using primitives for alignment is addressed several challenges faced by existing registration methods. This alignment problem is an essential step in 3D modeling, registration and model retrieval. Finally, an automatic method to extract sharp features from 3D data of man-made objects is also proposed. By integrating the extracted sharp features into the alignment framework, it is possible implement automatic assignment of primitive correspondences using attribute relational graph matching. Each primitive is considered as a node of the graph and an attribute relational graph is created to provide a structural and relational description between primitives. We have experimented all the proposed algorithms on different synthetic and real scanned datasets. Our algorithms not only are successful in completing their tasks with good results but also outperform other methods. We believe that the contribution of them could be useful in many applications

Imaging and discrete modelling of sand shape

The shape of particles is known to play an important role in soil behaviour, with significant effects of engineering responses. Investigating how the shape of particles can be measured and quantified is therefore considered increasingly important in modern soil mechanics. This is propelled by the advent of computer based image-analyses and discrete modelling algorithms, which have opened new ways to tackle this problem. This work demonstrates how these two techniques can be made to work together. Image analyses are performed on x-rays micro-tomographs (µ-CT) of triaxial sand specimens, focusing on the characterisation and quantification of particle shapes. Two with very different particle shape sands are studied in details: Caicos ooids (rounded) and Hostun sand (angular). A discrete Digital Volume Correlation (DVC) algorithm is then used to track the kinematics of individual grains (around 50000 for each sand specimen) during the triaxial test and measure, with good precision, their cumulated displacements and rotations. Joint analysis of the shape and kinematic databases acquired is performed to find how particle shape descriptors are related to observed kinematics at the microscale level. It appears that true sphericity is a good predictor of upper bound rotational restraint. Modelling is based on the Discrete Element Method (DEM). Models that introduce rolling resistance at the contact are widely employed in DEM simulations, these approaches offer substantial computational benefits at the prize of increased calibration complexity. In this work, the values of true sphericity obtained by image analysis of the grains, either directly by 3D acquisition or by correlation with simpler to obtain 2D shape measures, are used to establish mechanically equivalent rotational restrictions. An empirical relation between a contact parameter (rolling friction) and a 3D grain shape descriptor (true sphericity is first calibrated - using both specimen-scale and grain scale results from two triaxial tests in Hostun sand and Caicos ooids. It is then validated by simulating other triaxial tests (1) with the same sands, but in different conditions (2) with Ottawa sand, for which 3D grain images were also available for examination, and (3) with Ticino sand, for which only 2D grain images were available. Finally, results of large-scale DEM simulations on the Cone Penetration Test (CPT) - exploiting the new proposed contact model - are presented. Experimental data on the CPT performed in a Calibration Chamber (CC) comprised of Ticino sand are successfully fitted by the numerical penetration curves at different confining pressures and conditions. A parametric study about the influence of particle shape and particle shape variability put in evidence the strong-coupled effects of rolling and frictional resistances at the particles contacts. The work described in this thesis will ease the use of DEM for large-scale simulations of geotechnical engineering problems.Se sabe que la forma de las partículas juega un papel importante en el comportamiento del suelo, con efectos significativos de las respuestas mecánicas relevantes en ingeniería geotécnica. Por lo tanto, investigar cómo se puede medir y cuantificar la forma de las partículas se considera cada vez más importante en la mecánica del suelo moderna. Esto se acrecienta debido a las técnicas de análisis computacionales de imágenes y algoritmos de modelado discreto (DEM), que han abierto nuevas formas de abordar este problema. Este trabajo demuestra cómo se pueden hacer que estas dos técnicas funcionen juntas. Los análisis de imagen se realizan sobre micro-tomografías de rayos X (µ-CT) de muestras de arena en celdas triaxiales, centrándose en la caracterización y cuantificación de la forma de las partículas. Se estudian en detalle dos arenas con la forma de sus partículas muy diferentes: Caicos ooids (redondeados) y Hostun sand (angular). Luego se utiliza un algoritmo discreto de correlación de volumen digital (DVC) para rastrear la cinemática de granos individuales (alrededor de 50000 por cada muestra de arena) durante la prueba triaxial y medir, con buena precisión, sus desplazamientos y rotaciones acumulados. El análisis conjunto de la forma y las bases de datos cinemáticas adquiridas se realiza para encontrar cómo los descriptores de forma de partículas se relacionan con la cinemática observada a nivel de micro-escala. Resulta que la esfericidad verdadera predice bien el límite superior de rotación de una partícula. La modelización numérica se basa en el Método de Elementos Discretos (DEM). Los modelos que introducen resistencia a la rotación en el contacto se emplean ampliamente en simulaciones DEM, estos enfoques ofrecen beneficios computacionales sustanciales a costa de una mayor complejidad de calibración. En este trabajo, los valores de esfericidad verdadera (i.e., true sphericity) obtenidos mediante análisis de imagen de los granos, ya sea directamente por adquisición 3D o por correlación con medidas de forma 2D más simples, se utilizan para establecer restricciones de rotación mecánicamente equivalentes. Una relación empírica entre un parámetro de contacto (rolling friction) y un descriptor de forma de grano 3D (la esfericidad verdadera) se calibra primero, utilizando los resultados de la escala de muestras y de la escala de granos de dos pruebas triaxiales en las arenas de Hostun y de Caicos. Luego se valida simulando otras pruebas triaxiales (1) con las mismas arenas, pero en diferentes condiciones (2) con arena de Ottawa, para la que también estaban disponibles imágenes 3D de granos para su examen, y (3) con arena de Ticino, para la cual solo estaban disponibles imágenes 2D de los granos. Finalmente, se presentan resultados de simulaciones DEM a gran escala de la prueba de penetración de cono (CPT), aprovechando el nuevo modelo de contacto propuesto. Los datos experimentales del CPT realizado en una cámara de calibración (CC) sobre arena de Ticino se ajustan con éxito por las curvas de penetración numérica a diferentes presiones y condiciones de confinamiento. Un estudio paramétrico sobre la influencia de la forma de las partículas y la variabilidad de las formas de las partículas puso de manifiesto los efectos fuertemente acoplados de las resistencias rotacional y friccional en los contactos entre partículas. El trabajo descrito en esta tesis facilitará el uso de DEM para simulaciones a gran escala en problemas de ingeniería geotécnica.Postprint (published version