Skip to main content
Article thumbnail
Location of Repository

Upper body detection and tracking in extended signing sequences

By Patrick Buehler, Mark Everingham, Daniel P. Huttenlocher and Andrew Zisserman


<p>The goal of this work is to detect and track the articulated pose of a human in signing videos of more than one hour in length. In particular we wish to accurately localise hands and arms, despite fast motion and a cluttered and changing background.</p><p>We cast the problem as inference in a generative model of the image, and propose a complete model which accounts for self-occlusion of the arms. Under this model, limb detection is expensive due to the very large number of possible configurations each part can assume. We make the following contributions to reduce this cost: (i) efficient sampling from a pictorial structure proposal distribution to obtain reasonable configurations; (ii) identifying a large number of frames where configurations can be correctly inferred, and exploiting temporal tracking elsewhere.</p><p>Results are reported for signing footage with challenging image conditions and for different signers. We show that the method is able to identify the true arm and hand locations with high reliability. The results exceed the state-of-the-art for the length and stability of continuous limb tracking.</p>The full-text of this article is not currently available in ORA, but the original publication is available at (which you may be able to access via the publisher copy link on this record page)

Topics: Engineering & allied sciences, person tracking, human pose estimation, sign language, gesture recognition
Year: 2011
DOI identifier: 10.1007/s11263-011-0480-9
OAI identifier:
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • (external link)
  • Suggested articles

    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.