Automatic landmark annotation and dense correspondence registration for 3D human facial images

Dense surface registration of three-dimensional (3D) human facial images holds great potential for studies of human trait diversity, disease genetics, and forensics. Non-rigid registration is particularly useful for establishing dense anatomical correspondences between faces. Here we describe a novel non-rigid registration method for fully automatic 3D facial image mapping. This method comprises two steps: first, seventeen facial landmarks are automatically annotated, mainly via PCA-based feature recognition following 3D-to-2D data transformation. Second, an efficient thin-plate spline (TPS) protocol is used to establish the dense anatomical correspondence between facial images, under the guidance of the predefined landmarks. We demonstrate that this method is robust and highly accurate, even for different ethnicities. The average face is calculated for individuals of Han Chinese and Uyghur origins. While fully automatic and computationally efficient, this method enables high-throughput analysis of human facial feature variation.Comment: 33 pages, 6 figures, 1 tabl

A new method for improved standardisation in three-dimensional computed tomography cephalometry

Interest for three-dimensional computed tomography cephalometry has risen over the last two decades. Current methods commonly rely on the examiner to manually point-pick the landmarks and/or orientate the skull. In this study, a new approach is presented, in which landmarks are calculated after selection of the landmark region on a triangular model and in which the skull is automatically orientated in a standardised way. Two examiners each performed five analyses on three skull models. Landmark reproducibility was tested by calculating the standard deviation for each observer and the difference between the mean values of both observers. The variation can be limited to 0.1 mm for most landmarks. However, some landmarks perform less well and require further investigation. With the proposed reference system, a symmetrical orientation of the skulls is obtained. The presented methods contribute to standardisation in cephalometry and could therefore allow improved comparison of patient data

3-D Face Analysis and Identification Based on Statistical Shape Modelling

This paper presents an effective method of statistical shape representation for automatic face analysis and identification in 3-D. The method combines statistical shape modelling techniques and the non-rigid deformation matching scheme. This work is distinguished by three key contributions. The first is the introduction of a new 3-D shape registration method using hierarchical landmark detection and multilevel B-spline warping technique, which allows accurate dense correspondence search for statistical model construction. The second is the shape representation approach, based on Laplacian Eigenmap, which provides a nonlinear submanifold that links underlying structure of facial data. The third contribution is a hybrid method for matching the statistical model and test dataset which controls the levels of the model’s deformation at different matching stages and so increases chance of the successful matching. The proposed method is tested on the public database, BU-3DFE. Results indicate that it can achieve extremely high verification rates in a series of tests, thus providing real-world practicality

Translational genetic modelling of 3D craniofacial dysmorphology: elaborating the facial phenotype of neurodevelopmental disorders through the prism of schizophrenia

Purpose of Review: In the context of human developmental conditions, we review the conceptualisation of schizophrenia as a neurodevelopmental disorder, the status of craniofacial dysmorphology as a clinically accessible index of brain dysmorphogenesis, the ability of genetically modified mouse models of craniofacial dysmorphology to inform on the underlying dysmorphogenic process and how geometric morphometric techniques in mutant mice can extend quantitative analysis. Recent Findings: Mutant mice with disruption of neuregulin-1, a gene associated meta-analytically with risk for schizophrenia, constitute proof-of-concept studies of murine facial dysmorphology in a manner analogous to clinical studies in schizophrenia. Geometric morphometric techniques informed on the topography of facial dysmorphology and identified asymmetry therein. Summary: Targeted disruption in mice of genes involved in individual components of developmental processes and analysis of resultant facial dysmorphology using geometric morphometrics can inform on mechanisms of dysmorphogenesis at levels of incisiveness not possible in human subjects

From 3D Point Clouds to Pose-Normalised Depth Maps

We consider the problem of generating either pairwise-aligned or pose-normalised depth maps from noisy 3D point clouds in a relatively unrestricted poses. Our system is deployed in a 3D face alignment application and consists of the following four stages: (i) data filtering, (ii) nose tip identification and sub-vertex localisation, (iii) computation of the (relative) face orientation, (iv) generation of either a pose aligned or a pose normalised depth map. We generate an implicit radial basis function (RBF) model of the facial surface and this is employed within all four stages of the process. For example, in stage (ii), construction of novel invariant features is based on sampling this RBF over a set of concentric spheres to give a spherically-sampled RBF (SSR) shape histogram. In stage (iii), a second novel descriptor, called an isoradius contour curvature signal, is defined, which allows rotational alignment to be determined using a simple process of 1D correlation. We test our system on both the University of York (UoY) 3D face dataset and the Face Recognition Grand Challenge (FRGC) 3D data. For the more challenging UoY data, our SSR descriptors significantly outperform three variants of spin images, successfully identifying nose vertices at a rate of 99.6%. Nose localisation performance on the higher quality FRGC data, which has only small pose variations, is 99.9%. Our best system successfully normalises the pose of 3D faces at rates of 99.1% (UoY data) and 99.6% (FRGC data)

Subjectivity and complexity of facial attractiveness

The origin and meaning of facial beauty represent a longstanding puzzle. Despite the profuse literature devoted to facial attractiveness, its very nature, its determinants and the nature of inter-person differences remain controversial issues. Here we tackle such questions proposing a novel experimental approach in which human subjects, instead of rating natural faces, are allowed to efficiently explore the face-space and 'sculpt' their favorite variation of a reference facial image. The results reveal that different subjects prefer distinguishable regions of the face-space, highlighting the essential subjectivity of the phenomenon.The different sculpted facial vectors exhibit strong correlations among pairs of facial distances, characterising the underlying universality and complexity of the cognitive processes, and the relative relevance and robustness of the different facial distances.Comment: 15 pages, 5 figures. Supplementary information: 26 pages, 13 figure

Assessing the outcome of orthognathic surgery by three-dimensional soft tissue analysis

Studies of orthognathic surgery often focus on pre-surgical versus post-surgical changes in facial shape. In contrast, this study provides an innovative comparison between post-surgical and control shape. Forty orthognathic surgery patients were included, who underwent three different types of surgical correction: Le Fort I maxillary advancement, bilateral sagittal split mandibular advancement, and bimaxillary advancement surgery. Control facial images were captured from volunteers from local communities in Glasgow, with patterns of age, sex, and ethnic background that matched those of the surgical patients. Facial models were fitted and Procrustes registration and principal components analysis used to allow quantitative analysis, including the comparison of group mean shape and mean asymmetry. The primary characteristic of the difference in shape was found to be residual mandibular prognathism in the group of female patients who underwent Le Fort I maxillary advancement. Individual cases were assessed against this type of shape difference, using a quantitative scale to aid clinical audit. Analysis of the combined surgical groups provided strong evidence that surgery reduces asymmetry in some parts of the face such as the upper lip region. No evidence was found that mean asymmetry in post-surgical patients is greater than that in controls