Two-layer particle filter for multiple target detection and tracking

This paper deals with the detection and tracking of an unknown number of targets using a Bayesian hierarchical model with target labels. To approximate the posterior probability density function, we develop a two-layer particle filter. One deals with track initiation, and the other with track maintenance. In addition, the parallel partition method is proposed to sample the states of the surviving targets

A track-before-detect labelled multi-Bernoulli particle filter with label switching

This paper presents a multitarget tracking particle filter (PF) for general track-before-detect measurement models. The PF is presented in the random finite set framework and uses a labelled multi-Bernoulli approximation. We also present a label switching improvement algorithm based on Markov chain Monte Carlo that is expected to increase filter performance if targets get in close proximity for a sufficiently long time. The PF is tested in two challenging numerical examples.Comment: Accepted for publication in IEEE Transactions on Aerospace and Electronic System

Array of sensors: A spatiotemporal-state-space model for target trajectory tracking

In this paper, with the objective of tracking the trajectory of multiple mobile targets, a novel spatiotemporal-state-space model is introduced for an array of sensors distributed in space. Under the wideband assumption, the proposed model incorporates the array geometry in conjunction with crucial target parameters namely (i) ranges, (ii) directions, (iii) velocities and (iv) associated Doppler effects. Computer simulation studies show some representative examples where the proposed model is utilised to track the locations of sources in space with a very high accuracy

Parallelized Particle and Gaussian Sum Particle Filters for Large Scale Freeway Traffic Systems

Large scale traffic systems require techniques able to: 1) deal with high amounts of data and heterogenous data coming from different types of sensors, 2) provide robustness in the presence of sparse sensor data, 3) incorporate different models that can deal with various traffic regimes, 4) cope with multimodal conditional probability density functions for the states. Often centralized architectures face challenges due to high communication demands. This paper develops new estimation techniques able to cope with these problems of large traffic network systems. These are Parallelized Particle Filters (PPFs) and a Parallelized Gaussian Sum Particle Filter (PGSPF) that are suitable for on-line traffic management. We show how complex probability density functions of the high dimensional trafc state can be decomposed into functions with simpler forms and the whole estimation problem solved in an efcient way. The proposed approach is general, with limited interactions which reduces the computational time and provides high estimation accuracy. The efciency of the PPFs and PGSPFs is evaluated in terms of accuracy, complexity and communication demands and compared with the case where all processing is centralized

Audio‐Visual Speaker Tracking

Target motion tracking found its application in interdisciplinary fields, including but not limited to surveillance and security, forensic science, intelligent transportation system, driving assistance, monitoring prohibited area, medical science, robotics, action and expression recognition, individual speaker discrimination in multi‐speaker environments and video conferencing in the fields of computer vision and signal processing. Among these applications, speaker tracking in enclosed spaces has been gaining relevance due to the widespread advances of devices and technologies and the necessity for seamless solutions in real‐time tracking and localization of speakers. However, speaker tracking is a challenging task in real‐life scenarios as several distinctive issues influence the tracking process, such as occlusions and an unknown number of speakers. One approach to overcome these issues is to use multi‐modal information, as it conveys complementary information about the state of the speakers compared to single‐modal tracking. To use multi‐modal information, several approaches have been proposed which can be classified into two categories, namely deterministic and stochastic. This chapter aims at providing multimedia researchers with a state‐of‐the‐art overview of tracking methods, which are used for combining multiple modalities to accomplish various multimedia analysis tasks, classifying them into different categories and listing new and future trends in this field

Bibliographic Review on Distributed Kalman Filtering

In recent years, a compelling need has arisen to understand the effects of distributed information structures on estimation and filtering. In this paper, a bibliographical review on distributed Kalman filtering (DKF) is provided.\ud The paper contains a classification of different approaches and methods involved to DKF. The applications of DKF are also discussed and explained separately. A comparison of different approaches is briefly carried out. Focuses on the contemporary research are also addressed with emphasis on the practical applications of the techniques. An exhaustive list of publications, linked directly or indirectly to DKF in the open literature, is compiled to provide an overall picture of different developing aspects of this area

Tracking interacting targets in multi-modal sensors

PhDObject tracking is one of the fundamental tasks in various applications such as surveillance, sports, video conferencing and activity recognition. Factors such as occlusions, illumination changes and limited field of observance of the sensor make tracking a challenging task. To overcome these challenges the focus of this thesis is on using multiple modalities such as audio and video for multi-target, multi-modal tracking. Particularly, this thesis presents contributions to four related research topics, namely, pre-processing of input signals to reduce noise, multi-modal tracking, simultaneous detection and tracking, and interaction recognition. To improve the performance of detection algorithms, especially in the presence of noise, this thesis investigate filtering of the input data through spatio-temporal feature analysis as well as through frequency band analysis. The pre-processed data from multiple modalities is then fused within Particle filtering (PF). To further minimise the discrepancy between the real and the estimated positions, we propose a strategy that associates the hypotheses and the measurements with a real target, using a Weighted Probabilistic Data Association (WPDA). Since the filtering involved in the detection process reduces the available information and is inapplicable on low signal-to-noise ratio data, we investigate simultaneous detection and tracking approaches and propose a multi-target track-beforedetect Particle filtering (MT-TBD-PF). The proposed MT-TBD-PF algorithm bypasses the detection step and performs tracking in the raw signal. Finally, we apply the proposed multi-modal tracking to recognise interactions between targets in regions within, as well as outside the cameras’ fields of view. The efficiency of the proposed approaches are demonstrated on large uni-modal, multi-modal and multi-sensor scenarios from real world detections, tracking and event recognition datasets and through participation in evaluation campaigns

Tracking sperm whales using passive acoustics and particle filters

Passive acoustics provides a powerful tool for marine mammal research and mitigation of the risk posed by high energy anthropogenic acoustic activities through monitoring animal positions. Animal vocalisations can be detected and utilised in poor visibility conditions and while animals are dived. Marine mammal research is often conducted on restricted financial budgets by non-government organisations and academic institutions from boats or ships towing hydrophone arrays often comprising only two elements. The arrival time-delay of the acoustic wavefront from the vocalising animals across the array aperture is computed, often using freely available software, and typically regarded as the bearing of the animal to the array. This methodology is limited as it provides no ranging information and, until a boat manoeuvre is performed, whether the animal is to the left or right of the array remains ambiguous. Methods of determining range that have been suggested either negate the fact the animal is moving, rely on robust detection of acoustic reflections, rely on accurate equipment calibration and knowledge of the animal’s orientation or require modification of hydrophone equipment. There is a clear need to develop an improved method of estimating animal position as relative bearing, range and elevation to a hydrophone array or boat based on time-delay measurements. To avoid the costs of upgrading hydrophone arrays, and potentially the size of the vessels required to tow them, a software solution is desirable. This thesis proposes that the source location be modelled as a probability density function and that the source location is estimated as the mean. This is developed into a practical method using particle filters to track sperm whales. Sperm whales are the ideal subject species for this kind of development because the high sound pressure levels of their impulsive vocalisations (up to 236 dB re 1 ?Pa) makes them relatively simple to detect. Simulation tracking results demonstrate particle filters are capable of tracking a manoeuvring target using time-delay measurements. Tracking results for real data are presented and compared to the pseudotrack reconstructed from a tag equipped with accelerometers, magnetometers, a depth sensor and an acoustic recorder placed on the subject animal. For the majority of datasets the animal is tracked to a position relatively close to the surface sighting position. Sperm whales are typically encountered in groups, therefore a viable tracking solution needs to be capable of tracking multiple animals. A multiple hypothesis tracking method is proposed and tested for associating received vocalisations with animals, whereby vocalisations are correctly associated for periods exceeding 15 minute