Article thumbnail

A Bayesian Framework for Human Body Pose Tracking from Depth Image Sequences

By Youding Zhu and Kikuo Fujimura


This paper addresses the problem of accurate and robust tracking of 3D human body pose from depth image sequences. Recovering the large number of degrees of freedom in human body movements from a depth image sequence is challenging due to the need to resolve the depth ambiguity caused by self-occlusions and the difficulty to recover from tracking failure. Human body poses could be estimated through model fitting using dense correspondences between depth data and an articulated human model (local optimization method). Although it usually achieves a high accuracy due to dense correspondences, it may fail to recover from tracking failure. Alternately, human pose may be reconstructed by detecting and tracking human body anatomical landmarks (key-points) based on low-level depth image analysis. While this method (key-point based method) is robust and recovers from tracking failure, its pose estimation accuracy depends solely on image-based localization accuracy of key-points. To address these limitations, we present a flexible Bayesian framework for integrating pose estimation results obtained by methods based on key-points and local optimization. Experimental results are shown and performance comparison is presented to demonstrate the effectiveness of the proposed approach

Topics: Article
Publisher: Molecular Diversity Preservation International (MDPI)
OAI identifier:
Provided by: PubMed Central

Suggested articles


  1. (1992). A method for registration of 3-d shapes.
  2. (1999). A multiple hypothesis approach to figure tracking.
  3. (2005). Avoiding the streetlight effect: Tracking by exploring likelihood modes.
  4. (2007). Constrained optimization for human pose estimation from depth sequences.
  5. (2008). Controlled human pose estimation from depth image streams.
  6. (2003). Kinematic jump processes for monocular 3d human tracking.
  7. (2005). Nonlinear body pose estimation from depth images.
  8. (2010). Online Time-of-Flight Camera Information. Available online: (accessed on 5
  9. (2000). Pose space deformations: A unified approach to shape interpolation and skeleton-driven deformation.
  10. Proposal maps driven mcmc for estimating human body pose in static images.
  11. (2006). Sensor fusion for 3d human body tracking with an articulated 3d body model.
  12. (1998). Singularity analysis for articulated object tracking.
  13. (2006). Tracking of the articulated upper body on multi-view stereo image sequences.

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.