Robust automatic target tracking based on a Bayesian ego-motion compensation framework for airborne FLIR imagery

Automatic target tracking in airborne FLIR imagery is currently a challenge due to the camera ego-motion. This phenomenon distorts the spatio-temporal correlation of the video sequence, which dramatically reduces the tracking performance. Several works address this problem using ego-motion compensation strategies. They use a deterministic approach to compensate the camera motion assuming a specific model of geometric transformation. However, in real sequences a specific geometric transformation can not accurately describe the camera ego-motion for the whole sequence, and as consequence of this, the performance of the tracking stage can significantly decrease, even completely fail. The optimum transformation for each pair of consecutive frames depends on the relative depth of the elements that compose the scene, and their degree of texturization. In this work, a novel Particle Filter framework is proposed to efficiently manage several hypothesis of geometric transformations: Euclidean, affine, and projective. Each type of transformation is used to compute candidate locations of the object in the current frame. Then, each candidate is evaluated by the measurement model of the Particle Filter using the appearance information. This approach is able to adapt to different camera ego-motion conditions, and thus to satisfactorily perform the tracking. The proposed strategy has been tested on the AMCOM FLIR dataset, showing a high efficiency in the tracking of different types of targets in real working conditions

Abrupt Motion Tracking via Nearest Neighbor Field Driven Stochastic Sampling

Stochastic sampling based trackers have shown good performance for abrupt motion tracking so that they have gained popularity in recent years. However, conventional methods tend to use a two-stage sampling paradigm, in which the search space needs to be uniformly explored with an inefficient preliminary sampling phase. In this paper, we propose a novel sampling-based method in the Bayesian filtering framework to address the problem. Within the framework, nearest neighbor field estimation is utilized to compute the importance proposal probabilities, which guide the Markov chain search towards promising regions and thus enhance the sampling efficiency; given the motion priors, a smoothing stochastic sampling Monte Carlo algorithm is proposed to approximate the posterior distribution through a smoothing weight-updating scheme. Moreover, to track the abrupt and the smooth motions simultaneously, we develop an abrupt-motion detection scheme which can discover the presence of abrupt motions during online tracking. Extensive experiments on challenging image sequences demonstrate the effectiveness and the robustness of our algorithm in handling the abrupt motions.Comment: submitted to Elsevier Neurocomputin

Joint probabilistic data association filter with unknown detection probability and clutter rate

This paper proposes a novel joint probabilistic data association (JPDA) filter for joint target tracking and track maintenance under unknown detection probability and clutter rate. The proposed algorithm consists of two main parts: (1) the standard JPDA filter with a Poisson point process birth model for multi-object state estimation; and (2) a multi-Bernoulli filter for detection probability and clutter rate estimation. The performance of the proposed JPDA filter is evaluated through empirical tests. The results of the empirical tests show that the proposed JPDA filter has comparable performance with ideal JPDA that is assumed to have perfect knowledge of detection probability and clutter rate. Therefore, the algorithm developed is practical and could be implemented in a wide range of application

Crowd-Centric Counting via Unsupervised Learning

Counting targets (people or things) within a moni-tored area is an important task in emerging wireless applications,including those for smart environments, safety, and security.Conventional device-free radio-based systems for counting targetsrely on localization and data association (i.e., individual-centric information) to infer the number of targets present in an area(i.e., crowd-centric information). However, many applications(e.g., affluence analytics) require only crowd-centric rather than individual-centric information. Moreover, individual-centric approaches may be inadequate due to the complexity of data association. This paper proposes a new technique for crowd-centric counting of device-free targets based on unsupervised learning, where the number of targets is inferred directly from a low-dimensional representation of the received waveforms. The proposed technique is validated via experimentation using an ultra-wideband sensor radar in an indoor environment.RYC-2016-1938