Unsupervised Learning of Category-Specific Symmetric 3D Keypoints from Point Sets

Automatic discovery of category-specific 3D keypoints from a collection of objects of a category is a challenging problem. The difficulty is added when objects are represented by 3D point clouds, with variations in shape and semantic parts and unknown coordinate frames. We define keypoints to be category-specific, if they meaningfully represent objects’ shape and their correspondences can be simply established order-wise across all objects. This paper aims at learning such 3D keypoints, in an unsupervised manner, using a collection of misaligned 3D point clouds of objects from an unknown category. In order to do so, we model shapes defined by the keypoints, within a category, using the symmetric linear basis shapes without assuming the plane of symmetry to be known. The usage of symmetry prior leads us to learn stable keypoints suitable for higher misalignments. To the best of our knowledge, this is the first work on learning such keypoints directly from 3D point clouds for a general category. Using objects from four benchmark datasets, we demonstrate the quality of our learned keypoints by quantitative and qualitative evaluations. Our experiments also show that the keypoints discovered by our method are geometrically and semantically consistent

Simple identification tools in FishBase

Simple identification tools for fish species were included in the FishBase information system from its inception. Early tools made use of the relational model and characters like fin ray meristics. Soon pictures and drawings were added as a further help, similar to a field guide. Later came the computerization of existing dichotomous keys, again in combination with pictures and other information, and the ability to restrict possible species by country, area, or taxonomic group. Today, www.FishBase.org offers four different ways to identify species. This paper describes these tools with their advantages and disadvantages, and suggests various options for further development. It explores the possibility of a holistic and integrated computeraided strategy

SCULPTOR: Skeleton-Consistent Face Creation Using a Learned Parametric Generator

Recent years have seen growing interest in 3D human faces modelling due to its wide applications in digital human, character generation and animation. Existing approaches overwhelmingly emphasized on modeling the exterior shapes, textures and skin properties of faces, ignoring the inherent correlation between inner skeletal structures and appearance. In this paper, we present SCULPTOR, 3D face creations with Skeleton Consistency Using a Learned Parametric facial generaTOR, aiming to facilitate easy creation of both anatomically correct and visually convincing face models via a hybrid parametric-physical representation. At the core of SCULPTOR is LUCY, the first large-scale shape-skeleton face dataset in collaboration with plastic surgeons. Named after the fossils of one of the oldest known human ancestors, our LUCY dataset contains high-quality Computed Tomography (CT) scans of the complete human head before and after orthognathic surgeries, critical for evaluating surgery results. LUCY consists of 144 scans of 72 subjects (31 male and 41 female) where each subject has two CT scans taken pre- and post-orthognathic operations. Based on our LUCY dataset, we learn a novel skeleton consistent parametric facial generator, SCULPTOR, which can create the unique and nuanced facial features that help define a character and at the same time maintain physiological soundness. Our SCULPTOR jointly models the skull, face geometry and face appearance under a unified data-driven framework, by separating the depiction of a 3D face into shape blend shape, pose blend shape and facial expression blend shape. SCULPTOR preserves both anatomic correctness and visual realism in facial generation tasks compared with existing methods. Finally, we showcase the robustness and effectiveness of SCULPTOR in various fancy applications unseen before.Comment: 16 page, 13 fig

Sea dragons of Avalon

Tourists driving through the village2 of Street on their way to Glastonbury might well wonder at the representation of a skeleton on the road sign. Could this perhaps be a warning that this stretch of the A39 is a roadkill hotspot? I (Stig Walsh, once a local inhabitant) suspect that the skeleton’s true identity may be far from what most outsiders expect of this part of Somerset (and most locals too). Cider, cheddar cheese, sheepskins, sensible shoes and scratched vinyl LPs of ‘The Best of the Wurzels’ probably rank highly in a top ten list of ‘objects found on and around the Somerset Levels’; Mesozoic ichthyosaurs probably wouldn’t make the top 40. Street nonetheless has an important place in the history of vertebrate palaeontology, and the PalAss review seminar held in late July was organised to look at what can be said about those fossils today

Relating multivariate shapes to genescapes using phenotype-biological process associations for craniofacial shape.

Realistic mappings of genes to morphology are inherently multivariate on both sides of the equation. The importance of coordinated gene effects on morphological phenotypes is clear from the intertwining of gene actions in signaling pathways, gene regulatory networks, and developmental processes underlying the development of shape and size. Yet, current approaches tend to focus on identifying and localizing the effects of individual genes and rarely leverage the information content of high-dimensional phenotypes. Here, we explicitly model the joint effects of biologically coherent collections of genes on a multivariate trait - craniofacial shape - in a sample of n = 1145 mice from the Diversity Outbred (DO) experimental line. We use biological process Gene Ontology (GO) annotations to select skeletal and facial development gene sets and solve for the axis of shape variation that maximally covaries with gene set marker variation. We use our process-centered, multivariate genotype-phenotype (process MGP) approach to determine the overall contributions to craniofacial variation of genes involved in relevant processes and how variation in different processes corresponds to multivariate axes of shape variation. Further, we compare the directions of effect in phenotype space of mutations to the primary axis of shape variation associated with broader pathways within which they are thought to function. Finally, we leverage the relationship between mutational and pathway-level effects to predict phenotypic effects beyond craniofacial shape in specific mutants. We also introduce an online application that provides users the means to customize their own process-centered craniofacial shape analyses in the DO. The process-centered approach is generally applicable to any continuously varying phenotype and thus has wide-reaching implications for complex trait genetics

Applications of Virtual Reality

Information Technology is growing rapidly. With the birth of high-resolution graphics, high-speed computing and user interaction devices Virtual Reality has emerged as a major new technology in the mid 90es, last century. Virtual Reality technology is currently used in a broad range of applications. The best known are games, movies, simulations, therapy. From a manufacturing standpoint, there are some attractive applications including training, education, collaborative work and learning. This book provides an up-to-date discussion of the current research in Virtual Reality and its applications. It describes the current Virtual Reality state-of-the-art and points out many areas where there is still work to be done. We have chosen certain areas to cover in this book, which we believe will have potential significant impact on Virtual Reality and its applications. This book provides a definitive resource for wide variety of people including academicians, designers, developers, educators, engineers, practitioners, researchers, and graduate students

Hand X-ray absorptiometry for measurement of bone mineral density on a slot-scanning X-ray imaging system

Includes bibliographical references.Bone mineral density (BMD) is an indicator of bone strength. While femoral and spinal BMDs are traditionally used in the management of osteoporosis, BMD at peripheral sites such as the hand has been shown to be useful in evaluating fracture risk for axial sites. These peripheral locations have been suggested as alternatives to the traditional sites for BMD measurement. Dual-energy X-ray absorptiometry (DXA) is the gold standard for measuring BMD due to low radiation dose, high accuracy and proven ability to evaluate fracture risk. Computed digital absorptiometry (CDA) has also been shown to be very effective at measuring the bone mass in hand bones using an aluminium step wedge as a calibration reference. In this project, the aim was to develop algorithm s for accurate measurement of BMD in hand bones on a slot - scanning digital radiography system. The project assess e d the feasibility of measuring bone mineral mass in hand bones using CDA on the current system. Images for CDA - based measurement were acquired using the default settings on the system for a medium sized patient. A method for automatic processing of the hand images to detect the aluminium step wedge, included in the scan for calibration, was developed and the calibration accuracy of the step wedge was evaluated. The CDA method was used for computation of bone mass with units of equivalent aluminium thickness (mmA1). The precision of the method was determined by taking three measurements in each of 1 6 volunteering subjects and computing the root - mean - square coefficient of variation (CV) of the measurements. The utility of the method was assessed by taking measurements of excised bones and assessing the correlation between the measured bone mass and ash weight obtained by incinerating the bones. The project also assessed the feasibility of implementing a DXA technique using two detectors in a slot-scanning digital radiography system to acquire dual-energy X-ray images for measuring areal and volumetric BMD of the middle phalanx of the middle finger. The dual-energy images were captured in two consecutive scans. The first scan captured the low- energy image using the detector in its normal set-up. The second scan captured the high- energy image with the detector modified to include an additional scintillator to simulate the presence of a second detector that would capture the low-energy image in a two-detector system. Scan parameters for acquisition of the dual-energy images were chosen to optimise spectral separation, entrance dose and image quality. Simulations were carried out to evaluate the spectral separation of the low- and high-energy spectra

MALDI-MSI Towards Multimodal Imaging: Challenges and Perspectives

Multimodal imaging is a powerful strategy for combining information from multiple images. It involves several fields in the acquisition, processing and interpretation of images. As multimodal imaging is a vast subject area with various combinations of imaging techniques, it has been extensively reviewed. Here we focus on Matrix-assisted Laser Desorption Ionization Mass Spectrometry Imaging (MALDI-MSI) coupling other imaging modalities in multimodal approaches. While MALDI-MS images convey a substantial amount of chemical information, they are not readily informative about the morphological nature of the tissue. By providing a supplementary modality, MALDI-MS images can be more informative and better reflect the nature of the tissue. In this mini review, we emphasize the analytical and computational strategies to address multimodal MALDI-MSI.Imagerie multimodale combinant la spectroscopie Raman et la spectrométrie de masse appliquée à la tuberculos