Data-driven shape analysis and processing

Data-driven methods serve an increasingly important role in discovering geometric, structural, and semantic relationships between shapes. In contrast to traditional approaches that process shapes in isolation of each other, data-driven methods aggregate information from 3D model collections to improve the analysis, modeling and editing of shapes. Through reviewing the literature, we provide an overview of the main concepts and components of these methods, as well as discuss their application to classification, segmentation, matching, reconstruction, modeling and exploration, as well as scene analysis and synthesis. We conclude our report with ideas that can inspire future research in data-driven shape analysis and processing

Curvature-based remeshing methodology oriented to human face 3D models

Remeshing techniques seek to modify a mesh in order to adapt it to an specific application. This work proposes a remeshing methodology specialized in the human face, whose purpose is to reduce the number of faces and vertices that requires the mesh, keeping the characteristics of the human anatomy. Curvature information that highlights the intrinsic anisotropy of natural geometry or geometry of human origin is used to accomplish this. Results were polygonal anisotropic meshes, composed mainly of quadrilaterals, with less than 50% of the points and faces of the initial mesh, that maintain the anatomical features for models of the face in a neutral expression, or expressions of happiness, disgust, fear, angry, surprise, and sadness. The methodology was validated with models from the BU-3DFE database, and the quality of the obtained results were evaluated against the remeshing achieved when a technique of simplification based on quadric error metrics is used.Las técnicas de remallado buscan modificar la malla de entrada para adaptarla a la aplicación específica. En este trabajo se propone una metodología de remallado especializada en el rostro humano, cuyo propósito es reducir el número de caras y vértices que requiere la malla, manteniendo las características propias de la anatomía humana. Para lograr esto se utiliza la información de curvatura, la cual destaca la anisotropía intrínseca en la geometría natural o en la geometría de origen humano. Como resultado se obtuvieron mallas anisotrópicas poligonales, compuestas principalmente por cuadriláteros, con menos del 50% de los puntos y caras de la malla inicial, que mantienen las características anatómicas para modelos del rostro en expresión neutra, o con expresiones de alegría, enojo, repugnancia, miedo, sorpresa y tristeza. La metodología se validó con los modelos presentes en la base de datos BU-3DFE, y se comparó la calidad de los resultados obtenidos contra el remallado que se logra con la técnica de simplificación basada en quadric error metrics

Statistical Modelling of Craniofacial Shape

With prior knowledge and experience, people can easily observe rich shape and texture variation for a certain type of objects, such as human faces, cats or chairs, in both 2D and 3D images. This ability helps us recognise the same person, distinguish different kinds of creatures and sketch unseen samples of the same object class. The process of capturing this prior knowledge is mathematically interpreted as statistical modelling. The outcome is a morphable model, a vector space representation of objects, that captures the variation of shape and texture. This thesis presents research aimed at constructing 3DMMs of craniofacial shape and texture using new algorithms and processing pipelines to offer enhanced modelling abilities over existing techniques. In particular, we present several fully automatic modelling approaches and apply them to a large dataset of 3D images of the human head, the Headspace dataset, thus generating the first public shape-and- texture 3D Morphable Model (3DMM) of the full human head. We call this the Liverpool-York Head Model, reflecting the data collection and statistical modelling respectively. We also explore the craniofacial symmetry and asymmetry in template morphing and statistical modelling. We propose a Symmetry-aware Coherent Point Drift (SA-CPD) algorithm, which mitigates the tangential sliding problem seen in competing morphing algorithms. Based on the symmetry-constrained correspondence output of SA-CPD, we present a symmetry-factored statistical modelling method for craniofacial shape. Also, we propose an iterative process of refinement for a 3DMM of the human ear that employs data augmentation. Then we merge the proposed 3DMMs of the ear with the full head model. As craniofacial clinicians like to look at head profiles, we propose a new pipeline to build a 2D morphable model of the craniofacial sagittal profile and augment it with profile models from frontal and top-down views. Our models and data are made publicly available online for research purposes

Uses of uncalibrated images to enrich 3D models information

The decrease in costs of semi-professional digital cameras has led to the possibility for everyone to acquire a very detailed description of a scene in a very short time. Unfortunately, the interpretation of the images is usually quite hard, due to the amount of data and the lack of robust and generic image analysis methods. Nevertheless, if a geometric description of the depicted scene is available, it gets much easier to extract information from 2D data. This information can be used to enrich the quality of the 3D data in several ways. In this thesis, several uses of sets of unregistered images for the enrichment of 3D models are shown. In particular, two possible fields of application are presented: the color acquisition, projection and visualization and the geometry modification. Regarding color management, several practical and cheap solutions to overcome the main issues in this field are presented. Moreover, some real applications, mainly related to Cultural Heritage, show that provided methods are robust and effective. In the context of geometry modification, two approaches are presented to modify already existing 3D models. In the first one, information extracted from images is used to deform a dummy model to obtain accurate 3D head models, used for simulation in the context of three-dimensional audio rendering. The second approach presents a method to fill holes in 3D models, with the use of registered images depicting a pattern projected on the real object. Finally, some useful indications about the possible future work in all the presented fields are given, in order to delineate the developments of this promising direction of research

Metodología de remallado basado en la curvatura y orientado a modelos 3D del rostro humano

Remeshing techniques seek to modify a mesh in order to adapt it to an specific application. This work proposes a remeshing methodology specialized in the human face, whose purpose is to reduce the number of faces and vertices that requires the mesh, keeping the characteristics of the human anatomy. Curvature information that highlights the intrinsic anisotropy of natural geometry or geometry of human origin is used to accomplish this. Results were polygonal anisotropic meshes, composed mainly of quadrilaterals, with less than 50% of the points and faces of the initial mesh, that maintain the anatomical features for models of the face in a neutral expression, or expressions of happiness, disgust, fear, angry, surprise, and sadness. The methodology was validated with models from the BU-3DFE database, and the quality of the obtained results were evaluated against the remeshing achieved when a technique of simplification based on quadric error metrics is usedLas técnicas de remallado buscan modificar la malla de entrada para adaptarla a la aplicación específica. En este trabajo se propone una metodología de remallado especializada en el rostro humano, cuyo propósito es reducir el número de caras y vértices que requiere la malla, manteniendo las características propias de la anatomía humana. Para lograr esto se utiliza la información de curvatura, la cual destaca la anisotropía intrínseca en la geometría natural o en la geometría de origen humano. Como resultado se obtuvieron mallas anisotrópicas poligonales, compuestas principalmente por cuadriláteros, con menos del 50% de los puntos y caras de la malla inicial, que mantienen las características anatómicas para modelos del rostro en expresión neutra, o con expresiones de alegría, enojo, repugnancia, miedo, sorpresa y tristeza. La metodología se validó con los modelos presentes en la base de datos BU-3DFE, y se comparó la calidad de los resultados obtenidos contra el remallado que se logra con la técnica de simplificación basada en quadric error metric

Groupwise non-rigid registration for automatic construction of appearance models of the human craniofacial complex for analysis, synthesis and simulation

Finally, a novel application of 3D appearance modelling is proposed: a faster than real-time algorithm for statistically constrained quasi-mechanical simulation. Experiments demonstrate superior realism, achieved in the proposed method by employing statistical appearance models to drive the simulation, in comparison with the comparable state-of-the-art quasi-mechanical approaches.EThOS - Electronic Theses Online ServiceGBUnited Kingdo

Groupwise non-rigid registration for automatic construction of appearance models of the human craniofacial complex for analysis, synthesis and simulation

Finally, a novel application of 3D appearance modelling is proposed: a faster than real-time algorithm for statistically constrained quasi-mechanical simulation. Experiments demonstrate superior realism, achieved in the proposed method by employing statistical appearance models to drive the simulation, in comparison with the comparable state-of-the-art quasi-mechanical approaches

Automatic 3D facial modelling with deformable models.

Facial modelling and animation has been an active research subject in computer graphics since the 1970s. Due to extremely complex biomechanical structures of human faces and peoples visual familiarity with human faces, modelling and animating realistic human faces is still one of greatest challenges in computer graphics. Since we are so familiar with human faces and very sensitive to unnatural subtle changes in human faces, it usually requires a tremendous amount of artistry and manual work to create a convincing facial model and animation. There is a clear need of developing automatic techniques for facial modelling in order to reduce manual labouring. In order to obtain a realistic facial model of an individual, it is now common to make use of 3D scanners to capture range scans from the individual and then fit a template to the range scans. However, most existing template-fitting methods require manually selected landmarks to warp the template to the range scans. It would be tedious to select landmarks by hand over a large set of range scans. Another way to reduce repeated work is synthesis by reusing existing data. One example is expression cloning, which copies facial expression from one face to another instead of creating them from scratch. This aim of this study is to develop a fully automatic framework for template-based facial modelling, facial expression transferring and facial expression tracking from range scans. In this thesis, the author developed an extension of the iterative closest points (ICP) algorithm, which is able to match a template with range scans in different scales, and a deformable model, which can be used to recover the shapes of range scans and to establish correspondences between facial models. With the registration method and the deformable model, the author proposed a fully automatic approach to reconstructing facial models and textures from range scans without re-quiring any manual interventions. In order to reuse existing data for facial modelling, the author formulated and solved the problem of facial expression transferring in the framework of discrete differential geometry. The author also applied his methods to face tracking for 4D range scans. The results demonstrated the robustness of the registration method and the capabilities of the deformable model. A number of possible directions for future work were pointed out