Intelligent sampling for the measurement of structured surfaces

Uniform sampling in metrology has known drawbacks such as coherent spectral aliasing and a lack of efficiency in terms of measuring time and data storage. The requirement for intelligent sampling strategies has been outlined over recent years, particularly where the measurement of structured surfaces is concerned. Most of the present research on intelligent sampling has focused on dimensional metrology using coordinate-measuring machines with little reported on the area of surface metrology. In the research reported here, potential intelligent sampling strategies for surface topography measurement of structured surfaces are investigated by using numerical simulation and experimental verification. The methods include the jittered uniform method, low-discrepancy pattern sampling and several adaptive methods which originate from computer graphics, coordinate metrology and previous research by the authors. By combining the use of advanced reconstruction methods and feature-based characterization techniques, the measurement performance of the sampling methods is studied using case studies. The advantages, stability and feasibility of these techniques for practical measurements are discussed

Spatial resolution in three-dimensional photo-acoustic reconstruction

We present an analytic explanation of the spatial resolution in three-dimensional photo-acoustic (also called opto-acoustic or thermo-acoustic) reconstruction. Based on rigorous reconstruction formulas, we analytically derive the point-spread functions (PSFs) for three types of specific recording geometries, including spherical, planar, and cylindrical surfaces. The PSFs as a function of the bandwidth of the measurement system and the finite size of the detector aperture, as well as the discrete sampling effect on the reconstruction, are investigated. The analyses clearly reveal that the dependence of the PSFs on the bandwidth of all of the recording geometries shares the same space-invariant expression while the dependence on the aperture size of the detector differs. The bandwidth affects both axial and lateral resolution; in contrast, the detector aperture blurs the lateral resolution greatly but the axial resolution only slightly. Under-sampling in the measurement causes significant aliasing artifacts in the reconstruction. A general sampling strategy to avoid aliasing is proposed

Shape Anchor Guided Holistic Indoor Scene Understanding

This paper proposes a shape anchor guided learning strategy (AncLearn) for robust holistic indoor scene understanding. We observe that the search space constructed by current methods for proposal feature grouping and instance point sampling often introduces massive noise to instance detection and mesh reconstruction. Accordingly, we develop AncLearn to generate anchors that dynamically fit instance surfaces to (i) unmix noise and target-related features for offering reliable proposals at the detection stage, and (ii) reduce outliers in object point sampling for directly providing well-structured geometry priors without segmentation during reconstruction. We embed AncLearn into a reconstruction-from-detection learning system (AncRec) to generate high-quality semantic scene models in a purely instance-oriented manner. Experiments conducted on the challenging ScanNetv2 dataset demonstrate that our shape anchor-based method consistently achieves state-of-the-art performance in terms of 3D object detection, layout estimation, and shape reconstruction. The code will be available at https://github.com/Geo-Tell/AncRec

Doctor of Philosophy

dissertationShape analysis is a well-established tool for processing surfaces. It is often a first step in performing tasks such as segmentation, symmetry detection, and finding correspondences between shapes. Shape analysis is traditionally employed on well-sampled surfaces where the geometry and topology is precisely known. When the form of the surface is that of a point cloud containing nonuniform sampling, noise, and incomplete measurements, traditional shape analysis methods perform poorly. Although one may first perform reconstruction on such a point cloud prior to performing shape analysis, if the geometry and topology is far from the true surface, then this can have an adverse impact on the subsequent analysis. Furthermore, for triangulated surfaces containing noise, thin sheets, and poorly shaped triangles, existing shape analysis methods can be highly unstable. This thesis explores methods of shape analysis applied directly to such defect-laden shapes. We first study the problem of surface reconstruction, in order to obtain a better understanding of the types of point clouds for which reconstruction methods contain difficulties. To this end, we have devised a benchmark for surface reconstruction, establishing a standard for measuring error in reconstruction. We then develop a new method for consistently orienting normals of such challenging point clouds by using a collection of harmonic functions, intrinsically defined on the point cloud. Next, we develop a new shape analysis tool which is tolerant to imperfections, by constructing distances directly on the point cloud defined as the likelihood of two points belonging to a mutually common medial ball, and apply this for segmentation and reconstruction. We extend this distance measure to define a diffusion process on the point cloud, tolerant to missing data, which is used for the purposes of matching incomplete shapes undergoing a nonrigid deformation. Lastly, we have developed an intrinsic method for multiresolution remeshing of a poor-quality triangulated surface via spectral bisection

High-accuracy methodology for the integrative restoration of archaeological teeth by using reverse engineering techniques and rapid prototyping

The reconstruction of the original morphology of bones and teeth after sampling for physicochemical (e.g., radiocarbon and uranium series dating, stable isotope analysis, paleohistology, trace element analysis) and biomolecular analyses (e.g., ancient DNA, paleoproteomics) is appropriate in many contexts and compulsory when dealing with fossil human remains. The reconstruction protocols available to date are mostly based on manual re-integration of removed portions and can lead to an imprecise recovery of the original morphology. In this work, to restore the original external morphology of sampled teeth we used computed microtomography (microCT), reverse engineering (RE), computer-aided design (CAD) and rapid prototyping (RP) techniques to fabricate customized missing parts. The protocol was tested by performing the reconstruction of two Upper Palaeolithic human teeth from the archaeological excavations of Roccia San Sebastiano (Mondragone, Caserta, southern Italy) and Riparo I of Grotte Verdi di Pradis (Clauzetto, Pordenone, north-eastern Italy) (RSS2 and Pradis 1, respectively), which were sampled for physicochemical and biomolecular analyses. It involved a composite procedure consisting in: a) the microCT scanning of the original specimens; b) sampling; c) the microCT scanning of the specimens after sampling; d) the reconstruction of the digital 3D surfaces of the specimens before and after sampling; e) the creation of digital models of the missing/sampled portions by subtracting the 3D images of the preserved portions (after the sampling) from the images of the intact specimens (before the sampling) by using reverse engineering techniques; f) the prototyping of the missing/sampled portions to be integrated; g) the painting and application of the prototypes through the use of compatible and reversible adhesives. By following the proposed protocol, in addition to the fabrication of a physical element which is faithful to the original, it was possible to obtain a remarkable correspondence between the contact surfaces of the two portions (the original and the reconstructed one) without having to resort to any manipulation/adaptation of either element

Reconstruction of freeform surfaces for metrology

The application of freeform surfaces has increased since their complex shapes closely express a product's functional specifications and their machining is obtained with higher accuracy. In particular, optical surfaces exhibit enhanced performance especially when they take aspheric forms or more complex forms with multi-undulations. This study is mainly focused on the reconstruction of complex shapes such as freeform optical surfaces, and on the characterization of their form. The computer graphics community has proposed various algorithms for constructing a mesh based on the cloud of sample points. The mesh is a piecewise linear approximation of the surface and an interpolation of the point set. The mesh can further be processed for fitting parametric surfaces (Polyworks® or Geomagic®). The metrology community investigates direct fitting approaches. If the surface mathematical model is given, fitting is a straight forward task. Nonetheless, if the surface model is unknown, fitting is only possible through the association of polynomial Spline parametric surfaces. In this paper, a comparative study carried out on methods proposed by the computer graphics community will be presented to elucidate the advantages of these approaches. We stress the importance of the pre-processing phase as well as the significance of initial conditions. We further emphasize the importance of the meshing phase by stating that a proper mesh has two major advantages. First, it organizes the initially unstructured point set and it provides an insight of orientation, neighbourhood and curvature, and infers information on both its geometry and topology. Second, it conveys a better segmentation of the space, leading to a correct patching and association of parametric surfaces.EMR

Factored axis-aligned filtering for rendering multiple distribution effects

Monte Carlo (MC) ray-tracing for photo-realistic rendering often requires hours to render a single image due to the large sampling rates needed for convergence. Previous methods have attempted to filter sparsely sampled MC renders but these methods have high reconstruction overheads. Recent work has shown fast performance for individual effects, like soft shadows and indirect illumination, using axis-aligned filtering. While some components of light transport such as indirect or area illumination are smooth, they are often multiplied by high-frequency components such as texture, which prevents their sparse sampling and reconstruction. We propose an approach to adaptively sample and filter for simultaneously rendering primary (defocus blur) and secondary (soft shadows and indirect illumination) distribution effects, based on a multi-dimensional frequency analysis of the direct and indirect illumination light fields. We describe a novel approach of factoring texture and irradiance in the presence of defocus blur, which allows for pre-filtering noisy irradiance when the texture is not noisy. Our approach naturally allows for different sampling rates for primary and secondary effects, further reducing the overall ray count. While the theory considers only Lambertian surfaces, we obtain promising results for moderately glossy surfaces. We demonstrate 30x sampling rate reduction compared to equal quality noise-free MC. Combined with a GPU implementation and low filtering over-head, we can render scenes with complex geometry and diffuse and glossy BRDFs in a few seconds.National Science Foundation (U.S.) (Grant CGV 1115242)National Science Foundation (U.S.) (Grant CGV 1116303)Intel Corporation (Science and Technology Center for Visual Computing

Assessment of engineered surfaces roughness by high-resolution 3D SEM photogrammetry

We describe a methodology to obtain three-dimensional models of engineered surfaces using scanning electron microscopy and multi-view photogrammetry (3DSEM). For the reconstruction of the 3D models of the surfaces we used freeware available in the cloud. The method was applied to study the surface roughness of metallic samples patterned with parallel grooves by means of laser. The results are com- pared with measurements obtained using stylus profilometry (PR) and SEM stereo-photogrammetry (SP). The application of 3DSEM is more time demanding than PR or SP, but it provides a more accurate repre- sentation of the surfaces. The results obtained with the three techniques are compared by investigating the influence of sampling step on roughness parameters