Location of Repository

A bank of unscented Kalman filters for multimodal human perception with mobile service robots

By Nicola Bellotto and Huosheng Hu


A new generation of mobile service robots could be ready soon to operate in human environments if they can robustly estimate position and identity of surrounding people. Researchers in this field face a number of challenging problems, among which sensor uncertainties and real-time constraints.\ud In this paper, we propose a novel and efficient solution for simultaneous tracking and recognition of people within the observation range of a mobile robot. Multisensor techniques for legs and face detection are fused in a robust probabilistic framework to height, clothes and face recognition algorithms. The system is based on an efficient bank of Unscented Kalman Filters that keeps a multi-hypothesis estimate of the person being tracked, including the case where the latter is unknown to the robot.\ud Several experiments with real mobile robots are presented to validate the proposed approach. They show that our solutions can improve the robot's perception and recognition of humans, providing a useful contribution for the future application of service robotics

Topics: H670 Robotics and Cybernetics
Publisher: Springer
Year: 2010
DOI identifier: 10.1007/s12369-010-0047-x
OAI identifier: oai:eprints.lincoln.ac.uk:2566

Suggested articles



  1. (2005). A generative framework for realtime object detection and classification. Computer Vision and Image Understanding, doi
  2. (2003). A survey of socially interactive robots. Robotics and Autonomous Systems, doi
  3. (2006). An efficient face normalization algorithm based on eyes detection. doi
  4. (2004). An introduction to biometric recognition. doi
  5. (2003). Automatic extraction and description of human gait models for recognition purposes. doi
  6. (2010). Computationally Effi-cient Solutions for Tracking People with a Mobile Robot: an Experimental Evaluation of Bayesian Filters. Autonomous Robots, doi
  7. (2010). Computationally Efficient Solutions for Tracking People with a Mobile Robot: an Experimental Evaluation of Bayesian Filters. Autonomous Robots, doi
  8. (2004). Data fusion for visual tracking with particles. doi
  9. (2001). Detecting and tracking moving objects from a mobile platform using a laser range scanner. doi
  10. (2002). Efficient particle filters for joint tracking and classification. doi
  11. (1991). Eigenfaces for recognition. doi
  12. (2001). Estimation with Applications to Tracking and Navigation. doi
  13. (2008). Face and facial feature detection evaluation.
  14. (2003). Face recognition: A literature survey. doi
  15. (2003). Facial recognition in video. doi
  16. (2003). Fast face detection for mobile robots by integrating laser range data with vision.
  17. (2004). Fast, reliable, adaptive, bimodal people tracking for indoor environments. doi
  18. (2003). Full-body person recognition system. doi
  19. (1995). Getting to Know Each Other - Artificial Social Intelligence for Autonomous Robots. Robotics and Autonomous Systems, doi
  20. (2007). He was a General Co-Chair of doi
  21. (2005). iBotGuard: an internet-based intelligent robot security system using invariant face recognition against intruder. doi
  22. (2001). Jijo-2: An office robot that communicates and learns. doi
  23. (2005). Joint Target Tracking and Identification - Part II: Shape video computing. doi
  24. (2005). Keeping track of humans: Have I seen this person before? doi
  25. (2005). Learning motion patterns of people for compliant robot motion. The Int. doi
  26. (2002). Learning motion patterns of persons for mobile service robots. doi
  27. (2003). Multi-modal anchoring for human-robot-interaction. Robotics and Autonomous Systems, doi
  28. (2007). Multisensor data fusion for joint people tracking and identification with a service robot. doi
  29. (2009). Multisensor-based human detection and tracking for mobile service robots. doi
  30. (1995). MultitargetMultisensor Tracking: Principles
  31. (2004). On target classification using kinematic data. doi
  32. (2006). Panoramic vision and laser range finder fusion for multiple person tracking. doi
  33. (2004). People recognition by mobile robots. doi
  34. (2003). People Tracking with Mobile Robots Using Sample-based Joint Probabilistic Data Association Filters. doi
  35. (2003). Person identification by mobile robots in indoor environments. doi
  36. (2002). Probabilistic human recognition from video. doi
  37. (2000). Realtime tracking of non-rigid objects using mean shift. doi
  38. (2004). Robust real-time face detection. doi
  39. (2000). Robust real-time pursuit of persons with a mobile robot using multisensor fusion.
  40. (2005). Sensor fusion using a probabilistic aggregation scheme for people detection and tracking. doi
  41. (2003). The CSU Face Identification Evaluation System User’s Guide: Version 5.0. doi
  42. (2003). The mobot museum robot installations: a five year experiment. doi
  43. (2001). Tracking people from a mobile platform. doi
  44. (2004). Unscented filtering and nonlinear estimation. doi
  45. (2007). Using boosted features for the detection of people in 2d range data. In doi
  46. (2003). Utilizing learned motion patterns to robustly track persons.

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.