Deep Autoencoder for Combined Human Pose Estimation and body Model Upscaling

We present a method for simultaneously estimating 3D human pose and body shape from a sparse set of wide-baseline camera views. We train a symmetric convolutional autoencoder with a dual loss that enforces learning of a latent representation that encodes skeletal joint positions, and at the same time learns a deep representation of volumetric body shape. We harness the latter to up-scale input volumetric data by a factor of $4 \times$, whilst recovering a 3D estimate of joint positions with equal or greater accuracy than the state of the art. Inference runs in real-time (25 fps) and has the potential for passive human behaviour monitoring where there is a requirement for high fidelity estimation of human body shape and pose

VNect: Real-time 3D Human Pose Estimation with a Single RGB Camera

We present the first real-time method to capture the full global 3D skeletal pose of a human in a stable, temporally consistent manner using a single RGB camera. Our method combines a new convolutional neural network (CNN) based pose regressor with kinematic skeleton fitting. Our novel fully-convolutional pose formulation regresses 2D and 3D joint positions jointly in real time and does not require tightly cropped input frames. A real-time kinematic skeleton fitting method uses the CNN output to yield temporally stable 3D global pose reconstructions on the basis of a coherent kinematic skeleton. This makes our approach the first monocular RGB method usable in real-time applications such as 3D character control---thus far, the only monocular methods for such applications employed specialized RGB-D cameras. Our method's accuracy is quantitatively on par with the best offline 3D monocular RGB pose estimation methods. Our results are qualitatively comparable to, and sometimes better than, results from monocular RGB-D approaches, such as the Kinect. However, we show that our approach is more broadly applicable than RGB-D solutions, i.e. it works for outdoor scenes, community videos, and low quality commodity RGB cameras.Comment: Accepted to SIGGRAPH 201

A holistic multi-scale approach to using 3D scanning technology in accident reconstruction

Three-dimensional scanning and documentation methods are becoming increasingly employed by law enforcement personnel for crime scene and accident scene recording. Three-dimensional documentation of the victim’s body in such cases is also increasingly used as the field of forensic radiology and imaging is expanding rapidly. These scanning technologies enable a more complete and detailed documentation than standard autopsy. This was used to examine a fatal pedestrian-vehicle collision where the pedestrian was killed by a van whilst crossing the road. Two competing scenarios were considered for the vehicle speed calculation: the pedestrian being projected forward by the impact or the pedestrian being carried on the vehicle’s bonnet. In order to assist with this, the impact area of the accident vehicle was scanned using laser surface scanning, the victim was scanned using postmortem CT and micro-CT and the data sets were combined to virtually match features of the vehicle to injuries on the victim. Micro-CT revealed additional injuries not previously detected, lending support to the pedestrian-carry theory

3D mapping of the SPRY2 domain of ryanodine receptor 1 by single-particle Cryo-EM

The type 1 skeletal muscle ryanodine receptor (RyR1) is principally responsible for Ca(2+) release from the sarcoplasmic reticulum and for the subsequent muscle contraction. The RyR1 contains three SPRY domains. SPRY domains are generally known to mediate protein-protein interactions, however the location of the three SPRY domains in the 3D structure of the RyR1 is not known. Combining immunolabeling and single-particle cryo-electron microscopy we have mapped the SPRY2 domain (S1085-V1208) in the 3D structure of RyR1 using three different antibodies against the SPRY2 domain. Two obstacles for the image processing procedure; limited amount of data and signal dilution introduced by the multiple orientations of the antibody bound in the tetrameric RyR1, were overcome by modifying the 3D reconstruction scheme. This approach enabled us to ascertain that the three antibodies bind to the same region, to obtain a 3D reconstruction of RyR1 with the antibody bound, and to map SPRY2 to the periphery of the cytoplasmic domain of RyR1. We report here the first 3D localization of a SPRY2 domain in any known RyR isoform.The authors want to thank the Brigham and Women’s Hospital Biomedical Research Institute (to MS), the Australian National Health and the Medical Research Council (471418 to AD, MC and PB), and the European Commission (Marie Curie Action PIOF-GA-2009-237120 to AP-M)

Connectivity of the Superficial Muscles of the Human Perineum: A Diffusion Tensor Imaging-Based Global Tractography Study.

Despite the importance of pelvic floor muscles, significant controversy still exists about the true structural details of these muscles. We provide an objective analysis of the architecture and orientation of the superficial muscles of the perineum using a novel approach. Magnetic Resonance Diffusion Tensor Images (MR-DTI) were acquired in 10 healthy asymptomatic nulliparous women, and 4 healthy males. Global tractography was then used to generate the architecture of the muscles. Micro-CT imaging of a male cadaver was performed for validation of the fiber tracking results. Results show that muscles fibers of the external anal sphincter, from the right and left side, cross midline in the region of the perineal body to continue as transverse perinea and bulbospongiosus muscles of the opposite side. The morphology of the external anal sphincter resembles that of the number '8' or a "purse string". The crossing of muscle fascicles in the perineal body was supported by micro-CT imaging in the male subject. The superficial muscles of the perineum, and external anal sphincter are frequently damaged during child birth related injuries to the pelvic floor; we propose the use of MR-DTI based global tractography as a non-invasive imaging technique to assess damage to these muscles