Single camera pose estimation using Bayesian filtering and Kinect motion priors

Traditional approaches to upper body pose estimation using monocular vision rely on complex body models and a large variety of geometric constraints. We argue that this is not ideal and somewhat inelegant as it results in large processing burdens, and instead attempt to incorporate these constraints through priors obtained directly from training data. A prior distribution covering the probability of a human pose occurring is used to incorporate likely human poses. This distribution is obtained offline, by fitting a Gaussian mixture model to a large dataset of recorded human body poses, tracked using a Kinect sensor. We combine this prior information with a random walk transition model to obtain an upper body model, suitable for use within a recursive Bayesian filtering framework. Our model can be viewed as a mixture of discrete Ornstein-Uhlenbeck processes, in that states behave as random walks, but drift towards a set of typically observed poses. This model is combined with measurements of the human head and hand positions, using recursive Bayesian estimation to incorporate temporal information. Measurements are obtained using face detection and a simple skin colour hand detector, trained using the detected face. The suggested model is designed with analytical tractability in mind and we show that the pose tracking can be Rao-Blackwellised using the mixture Kalman filter, allowing for computational efficiency while still incorporating bio-mechanical properties of the upper body. In addition, the use of the proposed upper body model allows reliable three-dimensional pose estimates to be obtained indirectly for a number of joints that are often difficult to detect using traditional object recognition strategies. Comparisons with Kinect sensor results and the state of the art in 2D pose estimation highlight the efficacy of the proposed approach.Comment: 25 pages, Technical report, related to Burke and Lasenby, AMDO 2014 conference paper. Code sample: https://github.com/mgb45/SignerBodyPose Video: https://www.youtube.com/watch?v=dJMTSo7-uF

Kinetochore alignment within the metaphase plate is regulated by centromere stiffness and microtubule depolymerases

During mitosis in most eukaryotic cells, chromosomes align and form a metaphase plate halfway between the spindle poles, about which they exhibit oscillatory movement. These movements are accompanied by changes in the distance between sister kinetochores, commonly referred to as breathing. We developed a live cell imaging assay combined with computational image analysis to quantify the properties and dynamics of sister kinetochores in three dimensions. We show that baseline oscillation and breathing speeds in late prometaphase and metaphase are set by microtubule depolymerases, whereas oscillation and breathing periods depend on the stiffness of the mechanical linkage between sisters. Metaphase plates become thinner as cells progress toward anaphase as a result of reduced oscillation speed at a relatively constant oscillation period. The progressive slowdown of oscillation speed and its coupling to plate thickness depend nonlinearly on the stiffness of the mechanical linkage between sisters. We propose that metaphase plate formation and thinning require tight control of the state of the mechanical linkage between sisters mediated by centromeric chromatin and cohesion

Multilevel analysis of nuclear dynamics in lamin perturbed fibroblasts

The nuclear lamina provides structural support to the nucleus and has a central role in defining nuclear organization. Defects in its filamentous constituents, the lamins, lead to a class of diseases collectively referred to as laminopathies. On the cellular level, lamin mutations affect the physical integrity of nuclei and nucleo-cytoskeletal interactions, resulting in increased susceptibility to mechanical stress and altered gene expression [1]. Most studies regarding the mechanical properties of the nucleus in laminopathic conditions are based on the induction of extracellular stress, such as strain or compression, and focus on nuclear integrity and/or nucleo-cytoskeletal interaction [2]. Far less is known about the role of nuclear organization and mobility under basal steady-state conditions. In this study, we quantitatively compared nuclear organization, nuclear deformation and chromatin mobility of fibroblasts from a Hutchinson-Gilford progeria patient with cells from a lamin A/C-deficient patient and wild-type dermal fibroblasts. To this end, we created a toolbox in imageJ for automatically analyzing both nuclear as well as subnuclear dynamics in living cells. Simultaneously, we developed a workflow for comparing cellular morphology and subcellular protein distribution in a high content fashion. We found that the absence of functional lamin A/C leads to increased nuclear plasticity on the hour and minute time scale but also to increased intranuclear mobility down to the seconds time scale. In contrast, progeria cells showed overall reduced nuclear dynamics. In addition, high content analysis revealed marked morphological and topological differences between different culture passages within a cell type and between different pathological variants of culture-age matched laminopathic cell types

Tracking by Prediction: A Deep Generative Model for Mutli-Person localisation and Tracking

Current multi-person localisation and tracking systems have an over reliance on the use of appearance models for target re-identification and almost no approaches employ a complete deep learning solution for both objectives. We present a novel, complete deep learning framework for multi-person localisation and tracking. In this context we first introduce a light weight sequential Generative Adversarial Network architecture for person localisation, which overcomes issues related to occlusions and noisy detections, typically found in a multi person environment. In the proposed tracking framework we build upon recent advances in pedestrian trajectory prediction approaches and propose a novel data association scheme based on predicted trajectories. This removes the need for computationally expensive person re-identification systems based on appearance features and generates human like trajectories with minimal fragmentation. The proposed method is evaluated on multiple public benchmarks including both static and dynamic cameras and is capable of generating outstanding performance, especially among other recently proposed deep neural network based approaches.Comment: To appear in IEEE Winter Conference on Applications of Computer Vision (WACV), 201

MoDeep: A Deep Learning Framework Using Motion Features for Human Pose Estimation

In this work, we propose a novel and efficient method for articulated human pose estimation in videos using a convolutional network architecture, which incorporates both color and motion features. We propose a new human body pose dataset, FLIC-motion, that extends the FLIC dataset with additional motion features. We apply our architecture to this dataset and report significantly better performance than current state-of-the-art pose detection systems

Long-term experiments with an adaptive spherical view representation for navigation in changing environments

Real-world environments such as houses and offices change over time, meaning that a mobile robot’s map will become out of date. In this work, we introduce a method to update the reference views in a hybrid metric-topological map so that a mobile robot can continue to localize itself in a changing environment. The updating mechanism, based on the multi-store model of human memory, incorporates a spherical metric representation of the observed visual features for each node in the map, which enables the robot to estimate its heading and navigate using multi-view geometry, as well as representing the local 3D geometry of the environment. A series of experiments demonstrate the persistence performance of the proposed system in real changing environments, including analysis of the long-term stability