13,498 research outputs found
Deep Autoencoder for Combined Human Pose Estimation and body Model Upscaling
We present a method for simultaneously estimating 3D human pose and body
shape from a sparse set of wide-baseline camera views. We train a symmetric
convolutional autoencoder with a dual loss that enforces learning of a latent
representation that encodes skeletal joint positions, and at the same time
learns a deep representation of volumetric body shape. We harness the latter to
up-scale input volumetric data by a factor of , whilst recovering a
3D estimate of joint positions with equal or greater accuracy than the state of
the art. Inference runs in real-time (25 fps) and has the potential for passive
human behaviour monitoring where there is a requirement for high fidelity
estimation of human body shape and pose
Multi-Context Attention for Human Pose Estimation
In this paper, we propose to incorporate convolutional neural networks with a
multi-context attention mechanism into an end-to-end framework for human pose
estimation. We adopt stacked hourglass networks to generate attention maps from
features at multiple resolutions with various semantics. The Conditional Random
Field (CRF) is utilized to model the correlations among neighboring regions in
the attention map. We further combine the holistic attention model, which
focuses on the global consistency of the full human body, and the body part
attention model, which focuses on the detailed description for different body
parts. Hence our model has the ability to focus on different granularity from
local salient regions to global semantic-consistent spaces. Additionally, we
design novel Hourglass Residual Units (HRUs) to increase the receptive field of
the network. These units are extensions of residual units with a side branch
incorporating filters with larger receptive fields, hence features with various
scales are learned and combined within the HRUs. The effectiveness of the
proposed multi-context attention mechanism and the hourglass residual units is
evaluated on two widely used human pose estimation benchmarks. Our approach
outperforms all existing methods on both benchmarks over all the body parts.Comment: The first two authors contribute equally to this wor
Integral Human Pose Regression
State-of-the-art human pose estimation methods are based on heat map
representation. In spite of the good performance, the representation has a few
issues in nature, such as not differentiable and quantization error. This work
shows that a simple integral operation relates and unifies the heat map
representation and joint regression, thus avoiding the above issues. It is
differentiable, efficient, and compatible with any heat map based methods. Its
effectiveness is convincingly validated via comprehensive ablation experiments
under various settings, specifically on 3D pose estimation, for the first time
Human Pose Estimation using Global and Local Normalization
In this paper, we address the problem of estimating the positions of human
joints, i.e., articulated pose estimation. Recent state-of-the-art solutions
model two key issues, joint detection and spatial configuration refinement,
together using convolutional neural networks. Our work mainly focuses on
spatial configuration refinement by reducing variations of human poses
statistically, which is motivated by the observation that the scattered
distribution of the relative locations of joints e.g., the left wrist is
distributed nearly uniformly in a circular area around the left shoulder) makes
the learning of convolutional spatial models hard. We present a two-stage
normalization scheme, human body normalization and limb normalization, to make
the distribution of the relative joint locations compact, resulting in easier
learning of convolutional spatial models and more accurate pose estimation. In
addition, our empirical results show that incorporating multi-scale supervision
and multi-scale fusion into the joint detection network is beneficial.
Experiment results demonstrate that our method consistently outperforms
state-of-the-art methods on the benchmarks.Comment: ICCV201
- …