Skip to main content
Article thumbnail
Location of Repository

"'Who are you?' - Learning person specific classifiers from video"

By J. Sivic, M. Everingham and A. Zisserman


We investigate the problem of automatically labelling\ud faces of characters in TV or movie material with their\ud names, using only weak supervision from automaticallyaligned\ud subtitle and script text. Our previous work (Everingham\ud et al. [8]) demonstrated promising results on the\ud task, but the coverage of the method (proportion of video\ud labelled) and generalization was limited by a restriction to\ud frontal faces and nearest neighbour classification.\ud In this paper we build on that method, extending the coverage\ud greatly by the detection and recognition of characters\ud in profile views. In addition, we make the following contributions:\ud (i) seamless tracking, integration and recognition\ud of profile and frontal detections, and (ii) a character specific\ud multiple kernel classifier which is able to learn the features\ud best able to discriminate between the characters.\ud We report results on seven episodes of the TV series\ud “Buffy the Vampire Slayer”, demonstrating significantly increased\ud coverage and performance with respect to previous\ud methods on this material

Year: 2009
OAI identifier:

Suggested articles

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.