Bayesian Intent Prediction in Object Tracking Using Bridging Distributions.

In several application areas, such as human computer interaction, surveillance and defence, determining the intent of a tracked object enables systems to aid the user/operator and facilitate effective, possibly automated, decision making. In this paper, we propose a probabilistic inference approach that permits the prediction, well in advance, of the intended destination of a tracked object and its future trajectory. Within the framework introduced here, the observed partial track of the object is modeled as being part of a Markov bridge terminating at its destination, since the target path, albeit random, must end at the intended endpoint. This captures the underlying long term dependencies in the trajectory, as dictated by the object intent. By determining the likelihood of the partial track being drawn from a particular constructed bridge, the probability of each of a number of possible destinations is evaluated. These bridges can also be employed to produce refined estimates of the latent system state (e.g., object position, velocity, etc.), predict its future values (up until reaching the designated endpoint) and estimate the time of arrival. This is shown to lead to a low complexity Kalman-filter-based implementation of the inference routine, where any linear Gaussian motion model, including the destination reverting ones, can be applied. Free hand pointing gestures data collected in an instrumented vehicle and synthetic trajectories of a vessel heading toward multiple possible harbors are utilized to demonstrate the effectiveness of the proposed approach

Bayesian Approaches to Tracking, Sensor Fusion and Intent Prediction

This thesis presents work on the development of model-based Bayesian approaches to object tracking and intent prediction. Successful navigation/positioning applications rely fundamentally on the choice of appropriate dynamic model and the design of effective tracking algorithms capable of maximising the use of the structure of the dynamic system and the information from sensors. While the tracking problem with frequent and accurate position data has been well studied, we push back the frontiers of current technology where an object can undergo fast manoeuvres and position fixes are limited. On the other hand, intent prediction techniques which extract higher level information such as the intended destination of a moving object can be designed, given the ability to perform successful tracking. Such techniques can play important roles in various application areas, including traffic monitoring, intelligent human computer interaction systems and autonomous route planning. In the first part of this thesis Bayesian tracking methods are designed based on a standard fix-rate setting in which the dynamic system is formulated into a Markovian state space form. We show that the combination of an intrinsic coordinate dynamic model and sensors in the object's body frame leads to novel state space models according to which efficient proposal kernels can be designed and implemented by the sequential Monte Carlo (SMC) methods. Also, sequential Markov chain Monte Carlo schemes are considered for the first time to tackle the sequential batch inference problems due to the presence of infrequent position data. Performance evaluation on both synthetic and real-world data shows that the proposed algorithms are superior to simpler particle filters, implying that they can be favourable alternatives to tracking problems with inertial sensors. The modelling assumption that leads to Markovian state space models can be restrictive for real-world systems as it stipulates that the state sequence has to be synchronised with the observations. In the second major part of this thesis we relax this assumption and work with a more natural class of models, termed variable rate models. We generalise the existing variable rate intrinsic model to incorporate acceleration, speed, distance and position data and introduce new variable rate particle filtering methods tailored to the derived model to accommodate multi-sensor multi-rate tracking scenarios. The proposed algorithms can achieve substantial improvements in terms of tracking accuracy and robustness over a bootstrap variable rate particle filter. Moreover, full Bayesian inference schemes for the learning of both the hidden state and system parameters are presented, with numerical results illustrating their effectiveness. The last part of the thesis is about designing efficient intent prediction algorithms within a Bayesian framework. A pseudo-observation based approach to the incorporation of destination knowledge is introduced, making the mathematics of the dynamical model and the observation process consistent with the Markov state process. Based on the new interpretation, two algorithms are proposed to sequentially estimate the probability of all possible endpoints. Whilst the synthetic maritime surveillance data demonstrate that the proposed methods can achieve comparable prediction performance with reduced computational cost in comparison to the existing bridging distribution based methods, the results on an extensive freehand pointing database, which contains 95 three-dimensional pointing trajectories, show that the new algorithms can outperform other state-of-the-art techniques. Some sensitivity tests are also performed, confirming the good robustness of the introduced methods against model mismatches

Detection of malicious intent in non-cooperative drone surveillance

In this paper, a Bayesian approach is proposed for the early detection of a drone threatening or anomalous behaviour in a surveyed region. This is in relation to revealing, as early as possible, the drone intent to either leave a geographical area where it is authorised to fly (e.g. to conduct inspection work) or reach a prohibited zone (e.g. runway protection zones at airports or a critical infrastructure site). The inference here is based on the noisy sensory observations of the target state from a non-cooperative surveillance system such as a radar. Data from Aveillant's Gamekeeper radar from a live drone trial is used to illustrate the efficacy of the introduced approach

Simultaneous intent prediction and state estimation using an intent-driven intrinsic coordinate model

The motion of an object (e.g. ship, jet, pedestrian, bird, drone, etc.) is usually governed by premeditated actions as per an underlying intent, for instance reaching a destination. In this paper, we introduce a novel intent-driven dynamical model based on a continuous-time intrinsic coordinate model. By combining this model with particle filtering, a seamless approach for jointly predicting the destination and estimating the state of a highly manoeuvrable object is developed. We examine the proposed inference technique using real data with different measurement models to demonstrate its efficacy. In particular, we show that the introduced approach can be a flexible and competitive alternative, in terms of prediction and estimation performance, to other existing methods for various measurement models including nonlinear ones

Jump Particle Filtering Framework for Joint Target Tracking and Intent Recognition

This paper presents a Bayesian framework for inferring the posterior of the extended state of a target, incorporating its underlying goal or intent, such as any intermediate waypoints and/or final destination. The methodology is thus for joint tracking and intent recognition. Several novel latent intent models are proposed here within a virtual leader formulation. They capture the influence of the target's hidden goal on its instantaneous behaviour. In this context, various motion models, including for highly maneuvering objects, are also considered. The a priori unknown target intent (e.g. destination) can dynamically change over time and take any value within the state space (e.g. a location or spatial region). A sequential Monte Carlo (particle filtering) approach is introduced for the simultaneous estimation of the target's (kinematic) state and its intent. Rao-Blackwellisation is employed to enhance the statistical performance of the inference routine. Simulated data and real radar measurements are used to demonstrate the efficacy of the proposed techniques.Comment: Submitted to IEEE Transactions on Aerospace and Electronic Systems (T-AES