A Survey on Artificial Intelligence Techniques for Biomedical Image Analysis in Skeleton-Based Forensic Human Identification

This paper represents the first survey on the application of AI techniques for the analysis of biomedical images with forensic human identification purposes. Human identification is of great relevance in today’s society and, in particular, in medico-legal contexts. As consequence, all technological advances that are introduced in this field can contribute to the increasing necessity for accurate and robust tools that allow for establishing and verifying human identity. We first describe the importance and applicability of forensic anthropology in many identification scenarios. Later, we present the main trends related to the application of computer vision, machine learning and soft computing techniques to the estimation of the biological profile, the identification through comparative radiography and craniofacial superimposition, traumatism and pathology analysis, as well as facial reconstruction. The potentialities and limitations of the employed approaches are described, and we conclude with a discussion about methodological issues and future research.Spanish Ministry of Science, Innovation and UniversitiesEuropean Union (EU) PGC2018-101216-B-I00Regional Government of Andalusia under grant EXAISFI P18-FR-4262Instituto de Salud Carlos IIIEuropean Union (EU) DTS18/00136European Commission H2020-MSCA-IF-2016 through the Skeleton-ID Marie Curie Individual Fellowship 746592Spanish Ministry of Science, Innovation and Universities-CDTI, Neotec program 2019 EXP-00122609/SNEO-20191236European Union (EU)Xunta de Galicia ED431G 2019/01European Union (EU) RTI2018-095894-B-I0

Forensic facial reconstruction using 3-D computer graphics: evaluation and improvement of its reliability in identification

This thesis is concerned with computerised forensic 3-D facial reconstruction as a means of identification and involves the restoration of the face on the skull in an attempt to achieve a close likeness of the individual when alive. The reconstruction process begins with the biological identification of the skeletal remains, (age, sex, ancestry and build). Facial reconstruction is then carried out and essentially works by building the “face” up from the skull using soft tissue thicknesses at specific locations from existing data. However, it is used as a last resort on skeletonised, badly decomposed or mutilated corpses, when no other information is available; even then it is only accepted as corroborative evidence in court. It is performed in the hope that it may stimulate recognition, and consequently narrow the field of identification, allowing other tests to be carried out, such as radiographic and/or dental comparisons, DNA analysis or other means, to establish positive identification. The advantages of the computerised method over the manual clay reconstruction are speed, rapid editing capability, production of images that can be stored and reconstructions repeated at any time if required. Furthermore, in many cases, the original skull instead of a cast or model may be used for reconstruction because the 3-D computerised procedure is rapid and non invasive. However, the most significant advantage of this technique with regard to the aims and objectives of the thesis is that a number of alternative reconstructions may be produced sequentially for the same skull by using different facial templates from the database that meet the anthropological/biological criteria of the skull. The issues addressed by the study and therefore its main aims are: a) evaluation and b) improvement of the reliability of facial reconstruction using 3-D computer graphics. The methodology involved initially digitizing a skull using a low-power laser scanner and a video camera interfaced to a computer. From a database of previously scanned faces, ten facial templates were selected that matched the anthropological criteria of each of the skulls, i.e. age, sex, ancestry and build. Landmarks with their corresponding soft tissue thicknesses were then located and placed on the skull and the equivalent ones on the face. The 3-D computer graphics then reconstructed the face by morphing (warping) the facial template over the skull by matching the corresponding landmarks on the skull and face with the appropriate soft tissue thicknesses at those landmark locations. The soft tissue thicknesses used at their specific landmark locations also matched the anthropological criteria of the skulls, since soft tissue depths are dependent on age, sex, ancestry and build. One of the major problems with any reconstruction which affect its reliability for identification is the uncertainty of the shape of some of the individual characteristics of soft tissue structures such as shape of lips, ears and nose/nasal tip since there is not direct information on the skull regarding the shape of some of these features. In addition, with the laser scanning system, the faces within the database all have closed eyes, because of the potential laser hazard to the eyes. Thus it is necessary to add “opened” eyes, head and facial hair (where appropriate) to give a realistic appearance to the face. The software provides the facility to export a 2-D view in a TIFF or JPEG format from the 3-D reconstructed image. The file can then be imported into a police identi-kit system such as E-FIT™, which allows the addition of features. In this study five skulls of known individuals were used for reconstruction in the manner explained. Ten facial templates which fulfilled the anthropological criteria (age, sex, ancestry and build) for each skull were used for the rebuilding process, thus totalling fifty reconstructions. The study employed a psychological resemblance test (experiment 1) where 20 different assessors, were asked to select in each case study, the best three matches of the ten reconstructions with the ante-mortem photograph of the individual during life. The results from these tests were correlated with a mathematical shape analysis assessment using Procrustes Analysis in which, the skull was compared in turn with each of the ten facial templates of each case study (experiment 2).The ranking of the assessors’ reconstruction choice was correlated with the ranking of the Procrustes Analysis by using Spearman’s Rank Order Correlation. The results indicate that although not statistically significant, it would seem however, that in some of the case studies, the mathematical approach using Procrustes Analysis does seems to capture some perceptual similarity in human observers. Experiment 3, similar to experiment 1, was a further psychological resemblance test, which involved implementing E-Fit features on four of the ten reconstructed images per case study. Assessors were asked to select the closest E-Fit image match with the ante-mortem photograph. Again, results indicated that, although not statistically significant, adding E-Fit feature to the images appears to improve perceptual similarity in human observers, provided, the limitations of adding these characteristics are addressed. Furthermore, there also appears to be good agreement in most of the case studies between the two psychological resemblance tests using the two different sets of assessors in experiment 1 and 3 (reconstruction choice and E-Fit choice, respectively). Further work involving anthropometric comparisons and using two methods of assessment (landmark line matching between images and proportion indices) was also carried out (experiment 4). It was found that matching landmark lines between images appeared to be only of limited value due to the images not being aligned at exactly the same viewpoint and magnification. It should be appreciated that because the thesis was based on recognition and was not an anthropometric study, precise alignment of viewpoints was not a requirement. Hence using the same data from the study, although images were in the frontal view, they were not aligned to the accuracy acceptable for an anthropometric study as there was no requirement to so. It would appear that, although there was some correspondence between the discrepant distances and the first and second ranked reconstructions, no firm conclusions could be drawn from this technique and therefore does not assist in understanding the way observers made their choices. Further tests would need to be carried out (beyond the scope of the thesis) to reach any firm conclusions. Undoubtedly, given the complex nature of the recognition process, it would have been desirable to use reconstructions of persons known to the assessors rather than asking them to assess unfamiliar persons, since it is well established that familiar faces are easier to recognize than those that are unfamiliar to observers. It should be appreciated however, that, although the study was designed in this way for practical and ethical reasons, it nevertheless does not truly reflect the real operational forensic scenario. Furthermore, recognition/matching is a much more complex process and even a reconstructed face which may be generally morphologically similar to the person in life may not capture perceptual similarity in human observers, especially in an unfamiliar scenario. It is not certain that identification will always occur even when the facial reconstruction bears good resemblance to the target individual

Developmental and Functional Influences on Covariance in the Mandible

Abstract The mandible is a morphologically complex structure shaped by multiple demands including function and development. It is difficult to untangle the extent to which complex external influences and internal constraints impact mandibular shape. The study of covariance plays an essential role in understanding the development and evolution of complex morphologies like the mandible. Determining the pattern and magnitude of covariance elucidates the degree to which traits are developmentally and/or functionally correlated while illuminating the extent of morphological constraints. The hypotheses of this dissertation address whether and to what extent covariance 1) changes in the mandible over ontogeny and whether these changes are linked to function, and; 2) is different between primates with distinct dietary demands. Two samples were collected to address these hypotheses, separately. The first was an ontogenetic sample of mutant mice and wild-type littermates. Ontogenetic comparisons of covariance were conducted between wild-type age groups, as well as between age-matched wild-type and mutant cohorts. The second sample consisted of four closely related plattyrrhines, belonging to Cebidae (Cebus apella; Saimiri sciureus) and Pitheciidae (Pithecia pithecia; Callicebus torquatus). Within-clade pair-wise comparisons of covariance were conducted between primates that possess mechanically challenging diets and those that do not. Procrustes superimposition techniques were applied to three-dimensional landmarks collected from the mandibles of each individual. Procrustes data were used to compare patterns and magnitudes of covariance within each sample. Results showed that pattern and magnitude of covariance changed throughout ontogeny in mice. Patterns shifted between peri-weaning and adult mice, coincident with a transition to an adult diet. Thus, early developmental constraints may deter selective pressures. Comparisons of mutant and wild-type mice, as well as primate dietary groups revealed similar patterns of covariance between groups. In contrast, magnitude of covariance varied drastically in each group comparison. Previous studies also document these trends in other model mice and across taxonomic groups within mammals. This indicates that patterns of covariance are conserved, likely via stabilizing selection on development and functional constraints. Plasticity in magnitudes of covariance, however, likely facilitates morphological diversity. Lastly, primates that consumed hard foods possessed higher magnitudes of covariance, further suggesting an important role for function in determining mandibular shape

Characterization of normal facial features and their association with genes

ABSTRACT Background: Craniofacial morphology has been reported to be highly heritable, but little is known about which genetic variants influence normal facial variation in the general population. Aim: To identify facial variation and explore phenotype-genotype associations in a 15-year-old population (2514 females and 2233 males). Subjects and Methods: The subjects involved in this study were recruited from the Avon Longitudinal Study of Parents and Children (ALSPAC). Three-dimensional (3D) facial images were obtained for each subject using two high-resolution Konica Minolta laser scanners. Twenty-one reproducible facial soft tissue landmarks and one constructed mid-endocanthion point (men) were identified and their coordinates were recorded. The 3D facial images were registered using Procrustes analysis (with and without scaling). Principal Component Analysis (PCA) was then employed to identify independent groups ‘principal components, PCs’ of correlated landmark coordinates that represent key facial features contributing to normal facial variation. A novel surface-based method of facial averaging was employed to visualize facial variation. Facial parameters (distances, angles, and ratios) were also generated using facial landmarks. Sex prediction based on facial parameters was explored using discriminant function analysis. A discovery-phase genome-wide association analysis (GWAS) was carried out for 2,185 ALSPAC subjects and replication was undertaken in a further 1,622 ALSPAC individuals. Results: 14 (unscaled) and 17 (scaled) PCs were identified explaining 82% of the total variance in facial form and shape. 250 facial parameters were derived (90 distances, 118 angles, 42 ratios). 24 facial parameters were found to provide sex prediction efficiency of over 70%, 23 of these parameters are distances that describe variation in face height, nose width, and prominence of various facial structures. 54 distances associated with previous reported high heritability and the 14 (unscaled) PCs were included in the discovery-phase GWAS. Four genetic associations with the distances were identified in the discovery analysis, and one of these, the association between the common ‘intronic’ SNP (rs7559271) in PAX3 gene on chromosome (2) and the nasion to mid-endocanthion 3D distance (n-men) was replicated strongly (p = 4 x 10-7). PAX3 gene encodes a transcription factor that plays crucial role in fetal development including craniofacial bones. PAX3 contains two DNA-binding domains, a paired-box domain and a homeodomain. The protein made from PAX3 gene directs the activity of other genes that signal neural crest cells to form specialized tissues such as craniofacial bones. PAX3 different mutations may lead to non-functional PAX3 polypeptides and destroy the ability of the PAX3 proteins to bind to DNA and regulate the activity of other genes to form bones and other specific tissues. Conclusions: The variation in facial form and shape can be accurately quantified and visualized as a multidimensional statistical continuum with respect to the principal components. The derived PCs may be useful to identify and classify faces according to a scale of normality. A strong genetic association was identified between the common SNP (rs7559271) in PAX3 gene on chromosome (2) and the nasion to mid-endocanthion 3D distance (n-men). Variation in this distance leads to nasal bridge prominence

CT Scanning

Since its introduction in 1972, X-ray computed tomography (CT) has evolved into an essential diagnostic imaging tool for a continually increasing variety of clinical applications. The goal of this book was not simply to summarize currently available CT imaging techniques but also to provide clinical perspectives, advances in hybrid technologies, new applications other than medicine and an outlook on future developments. Major experts in this growing field contributed to this book, which is geared to radiologists, orthopedic surgeons, engineers, and clinical and basic researchers. We believe that CT scanning is an effective and essential tools in treatment planning, basic understanding of physiology, and and tackling the ever-increasing challenge of diagnosis in our society

Evaluation of the results of orthodontic treatment by non-rigid image registration and deformation-based morphometry

The goal of this research was to find out, whether the non-rigid registration of dental casts can be used in the evaluation of orthodontic treatment and to develop a program, which would at least partially automatize the evaluation process of images. The aim was also to experiment the evaluation of three-dimensional models of the casts. This research was delimited to cover only the evaluation of malocclusions within the dental arch. The relationships between the dental arches were not considered. This thesis was done in the University of Vaasa at the Department of Electrical Engineering and Energy Technology as a part of the HammasSkanneri research project, whose aim is to automatize the digitization and archiving of dental casts. This research used two-dimensional images of dental casts which were taken of orthodontically treated patients before and after orthodontic treatment. Non-rigid registration was performed by using a registration tool of Fiji software. The evaluation of the accuracy of the registration was performed by measuring distances between manually inserted landmarks, and by comparing the linear and angular parameters of the registered images and the original target images. The displacements of the teeth were approximated with the help of deformation-based morphometry. The accuracy of registration is within reasonable error limits, if the image is taken straight from above of the cast and the registration is performed with the help of landmarks inserted by a human. Estimation of the changes showed that the movement of teeth can be coarsely measured by using deformation-based morphometry based on change estimates that resemble the Jacobian estimates. A set of programs, which partially automatize the evaluation of the accuracy and the changes, were developed. Three-dimensional imaging of the casts was unsuccessful, and thus the development of 3D evaluation system was left as a future research topic.fi=Opinnäytetyö kokotekstinä PDF-muodossa.|en=Thesis fulltext in PDF format.|sv=Lärdomsprov tillgängligt som fulltext i PDF-format