Skip to main content
Article thumbnail
Location of Repository

Structure Inference for Bayesian Multisensory Perception and Tracking

By Timothy Hospedales and Joel Cartwright


We investigate a solution to the problem of multisensor\ud perception and tracking by formulating it in\ud the framework of Bayesian model selection. Humans\ud robustly associate multi-sensory data as appropriate,\ud but previous theoretical work has focused\ud largely on purely integrative cases, leaving\ud segregation unaccounted for and unexploited by\ud machine perception systems. We illustrate a unifying,\ud Bayesian solution to multi-sensor perception\ud and tracking which accounts for both integration\ud and segregation by explicit probabilistic reasoning\ud about data association in a temporal context. Unsupervised\ud learning of such a model with EM is illustrated\ud for a real world audio-visual application

Topics: Sensor Fusion
Year: 2010
OAI identifier:

Suggested articles


  1. (1999). Bayesian Multiple Target Tracking. Artech House,
  2. (2004). Data fusion for visual tracking with particles. doi
  3. (2001). Democratic integration: self-organized integration of adaptive cues. doi
  4. (1997). Factorial hidden markov models. doi
  5. (2004). Greedy learning of multiple objects in images using robust statistics and factorial learning. doi
  6. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. doi
  7. (2000). Illusions: What you see is what you hear. doi
  8. (2003). Information Theory, Inference, and Learning Algorithms. doi
  9. (2003). Nebojsa Jojic, and Hagai Attias. A graphical model for audiovisual object tracking. doi
  10. (2005). Probabilistic data association techniques for target tracking with applications to sonar, radar and eo sensors. doi
  11. (2004). The ventriloquist effect results from near-optimal bimodal integration. doi

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.