Performance evaluation of track association and maintenance for a MFPAR with doppler velocity measurements

This study investigates the effects of incorporating Doppler velocity measurements directly into track association and maintenance parts for single and multiple target tracking unit in a multi function phased array radar (MFPAR). Since Doppler velocity is the major discriminant of clutter from a desired target, the measurement set has been expanded from range, azimuth and elevation angles to include Doppler velocity measurements. We have developed data association and maintenance part of a well known tracking method, Interacting Multiple Model Probabilistic Data Association

Multiple Model Adaptive Estimator Target Tracker for Maneuvering Targets in Clutter

The task of tracking a target in the presence of measurement clutter is a two-fold problem: one of handling measurement association uncertainty (due to clutter), and poorly known or significantly varying target dynamics. Measurement association uncertainty does not allow conventional tracking algorithms (such as Kalman filters) to be implemented directly. Poorly known or varying target dynamics complicate the design of any tracking filter, and filters using only a single dynamics model can rarely handle anything beyond the most benign target maneuvers. In recent years, the Multiple Hypothesis Tracker (MHT) has gained acceptance as a means of handling targets in a measurement-clutter environment. MHT algorithms rely on Gaussian mixture representations of a target\u27s current state estimate, and the number of components within these mixtures grows exponentially with each successive sensor scan. Previous research into techniques that limit the growth of Gaussian mixture components proved that the Integral Square Error cost-function-based algorithm performs well in this role. Also, multiple-model adaptive algorithms have been shown to handle poorly known target dynamics or targets that exhibit a large range of maneuverability over time with excellent results. This research integrates the ISE mixture reduction algorithm into Multiple-Model Adaptive Estimator (MMAE) and Interacting Mixed Model (IMM) tracking algorithms. The algorithms were validated to perform well at a variety of measurement clutter densities by using a Monte Carlo simulation environment based on the C++ language. Compared to single-dynamics-model MHT trackers running against a maneuvering target, the Williams-filter-based, multiple-model algorithms exhibited superior tracking performance

Context Exploitation in Data Fusion

Complex and dynamic environments constitute a challenge for existing tracking algorithms. For this reason, modern solutions are trying to utilize any available information which could help to constrain, improve or explain the measurements. So called Context Information (CI) is understood as information that surrounds an element of interest, whose knowledge may help understanding the (estimated) situation and also in reacting to that situation. However, context discovery and exploitation are still largely unexplored research topics. Until now, the context has been extensively exploited as a parameter in system and measurement models which led to the development of numerous approaches for the linear or non-linear constrained estimation and target tracking. More specifically, the spatial or static context is the most common source of the ambient information, i.e. features, utilized for recursive enhancement of the state variables either in the prediction or the measurement update of the filters. In the case of multiple model estimators, context can not only be related to the state but also to a certain mode of the filter. Common practice for multiple model scenarios is to represent states and context as a joint distribution of Gaussian mixtures. These approaches are commonly referred as the join tracking and classification. Alternatively, the usefulness of context was also demonstrated in aiding the measurement data association. Process of formulating a hypothesis, which assigns a particular measurement to the track, is traditionally governed by the empirical knowledge of the noise characteristics of sensors and operating environment, i.e. probability of detection, false alarm, clutter noise, which can be further enhanced by conditioning on context. We believe that interactions between the environment and the object could be classified into actions, activities and intents, and formed into structured graphs with contextual links translated into arcs. By learning the environment model we will be able to make prediction on the target\u2019s future actions based on its past observation. Probability of target future action could be utilized in the fusion process to adjust tracker confidence on measurements. By incorporating contextual knowledge of the environment, in the form of a likelihood function, in the filter measurement update step, we have been able to reduce uncertainties of the tracking solution and improve the consistency of the track. The promising results demonstrate that the fusion of CI brings a significant performance improvement in comparison to the regular tracking approaches

Gaussian Mixture Reduction of Tracking Multiple Maneuvering Targets in Clutter

The problem of tracking multiple maneuvering targets in clutter naturally leads to a Gaussian mixture representation of the Provability Density Function (PDF) of the target state vector. State-of-the-art Multiple Hypothesis Tracking (MHT) techniques maintain the mean, covariance and probability weight corresponding to each hypothesis, yet they rely on ad hoc merging and pruning rules to control the growth of hypotheses

Multi Sensor Multi Target Perception and Tracking for Informed Decisions in Public Road Scenarios

Multi-target tracking in public traffic calls for a tracking system with automated track initiation and termination facilities in a randomly evolving driving environment. Besides, the key problem of data association needs to be handled effectively considering the limitations in the computational resources on-board an autonomous car. The challenge of the tracking problem is further evident in the use of high-resolution automotive sensors which return multiple detections per object. Furthermore, it is customary to use multiple sensors that cover different and/or over-lapping Field of View and fuse sensor detections to provide robust and reliable tracking. As a consequence, in high-resolution multi-sensor settings, the data association uncertainty, and the corresponding tracking complexity increases pointing to a systematic approach to handle and process sensor detections. In this work, we present a multi-target tracking system that addresses target birth/initiation and death/termination processes with automatic track management features. These tracking functionalities can help facilitate perception during common events in public traffic as participants (suddenly) change lanes, navigate intersections, overtake and/or brake in emergencies, etc. Various tracking approaches including the ones based on joint integrated probability data association (JIPDA) filter, Linear Multi-target Integrated Probabilistic Data Association (LMIPDA) Filter, and their multi-detection variants are adapted to specifically include algorithms that handle track initiation and termination, clutter density estimation and track management. The utility of the filtering module is further elaborated by integrating it into a trajectory tracking problem based on model predictive control. To cope with tracking complexity in the case of multiple high-resolution sensors, we propose a hybrid scheme that combines the approaches of data clustering at the local sensor and multiple detections tracking schemes at the fusion layer. We implement a track-to-track fusion scheme that de-correlates local (sensor) tracks to avoid double counting and apply a measurement partitioning scheme to re-purpose the LMIPDA tracking algorithm to multi-detection cases. In addition to the measurement partitioning approach, a joint extent and kinematic state estimation scheme are integrated into the LMIPDA approach to facilitate perception and tracking of an individual as well as group targets as applied to multi-lane public traffic. We formulate the tracking problem as a two hierarchical layer. This arrangement enhances the multi-target tracking performance in situations including but not limited to target initialization(birth process), target occlusion, missed detections, unresolved measurement, target maneuver, etc. Also, target groups expose complex individual target interactions to help in situation assessment which is challenging to capture otherwise. The simulation studies are complemented by experimental studies performed on single and multiple (group) targets. Target detections are collected from a high-resolution radar at a frequency of 20Hz; whereas RTK-GPS data is made available as ground truth for one of the target vehicle\u27s trajectory

Multiple Model Methods for Cost Function Based Multiple Hypothesis Trackers

Multiple hypothesis trackers (MHTs) are widely accepted as the best means of tracking targets in clutter. This research seeks to incorporate multiple model Kalman filters into an Integral Square Error (ISE) cost-function-based MHT to increase the fidelity of target state estimation. Results indicate that the proposed multiple model methods can properly identify the maneuver mode of a target in dense clutter and ensure that an appropriately tuned filter is used. During benign portions of flight, this causes significant reductions in position and velocity RMS errors compared to a single-filter MHT. During portions of flight when the mixture mean deviates significantly from true target position, so-called deferred decision periods, the multiple model structures tend to accumulate greater RMS errors than a single-filter MHT, but this effect is inconsequential considering the inherently large magnitude of these errors (a non-MHT tracker would not be able to track during these periods at all). The multiple model MHT structures do not negatively impact track life when compared to a single-filter MHT

Optimal Collision Avoidance Trajectories for Unmanned/Remotely Piloted Aircraft

The post-911 environment has punctuated the force-multiplying capabilities that Remotely Piloted Aircraft (RPA) provides combatant commanders at all echelons on the battlefield. Not only have unmanned aircraft systems made near-revolutionary impacts on the battlefield, their utility and proliferation in law enforcement, homeland security, humanitarian operations, and commercial applications have likewise increased at a rapid rate. As such, under the Federal Aviation Administration (FAA) Modernization and Reform Act of 2012, the United States Congress tasked the FAA to provide for the safe integration of civil unmanned aircraft systems into the national airspace system (NAS) as soon as practicable, but not later than September 30, 2015. However, a necessary entrance criterion to operate RPAs in the NAS is the ability to Sense and Avoid (SAA) both cooperative and noncooperative air traffic to attain a target level of safety as a traditional manned aircraft platform. The goal of this research effort is twofold: First, develop techniques for calculating optimal avoidance trajectories, and second, develop techniques for estimating an intruder aircraft\u27s trajectory in a stochastic environment. This dissertation describes the optimal control problem associated with SAA and uses a direct orthogonal collocation method to solve this problem and then analyzes these results for different collision avoidance scenarios

Novel Power Control Scheme for Target Tracking in Radar Network with Passive Cooperation

Distributed radar network systems (DRNS) have been shown to provide significant performance improvement. With the recent development, radar network has become an attractive platform for target tracking. In practice, the netted radars in DRNS are supposed to maximize their transmitting power to achieve better target tracking performance, which may be in contradiction with low probability of intercept (LPI). This paper investigates the problem of adaptive resource scheduling based on time difference of arrival (TDOA) cooperation for target tracking by DRNS consisting of a dedicated radar netting station and multiple netted radars. Firstly, the standard interacting multiple model (IMM) algorithm incorporating extended Kalman filter (EKF) is improved by modifying the Markov transition probability with current measurements. Then, a novel resource scheduling strategy based on TDOA cooperation is presented, in which the LPI perfor¬mance for target tracking in DRNS is improved by optimiz¬ing the radar revisit interval and the transmitted power for a predefined target tracking accuracy. The comparison of the predictive error covariance matrix and the expected error covariance matrix is utilized to control the radar netting station under intermittent-working state with TDOA cooperation. Due to the lack of analytical closed-form expression for receiver operating characteristics (ROC), we utilize several popular information-theoretic criteria, namely, Bhattacharyya distance, Kullback-Leibler (KL) divergence, J-divergence, and mutual information (MI) as the metrics for target detection performance in target tracking process. The resulting optimization problems which are associated with different information-theoretic criteria are unified under a common framework. The non¬linear programming (NP) based genetic algorithm (GA) or else known as NPGA is employed to encounter with the highly nonconvex and nonlinear optimization problems in the framework. Numerical results demonstrate that the proposed algorithm not only has excellent target tracking accuracy, but also has better LPI performance comparing to other methods

High-level Information Fusion for Constrained SMC Methods and Applications

Information Fusion is a field that studies processes utilizing data from various input sources, and techniques exploiting this data to produce estimates and knowledge about objects and situations. On the other hand, human computation is a new and evolving research area that uses human intelligence to solve computational problems that are beyond the scope of existing artificial intelligence algorithms. In previous systems, humans' role was mostly restricted for analysing a finished fusion product; however, in the current systems the role of humans is an integral element in a distributed framework, where many tasks can be accomplished by either humans or machines. Moreover, some information can be provided only by humans not machines, because the observational capabilities and opportunities for traditional electronic (hard) sensors are limited. A source-reliability-adaptive distributed non-linear estimation method applicable to a number of distributed state estimation problems is proposed. The proposed method requires only local data exchange among neighbouring sensor nodes. It therefore provides enhanced reliability, scalability, and ease of deployment. In particular, by taking into account the estimation reliability of each sensor node at any point in time, it yields a more robust distributed estimation. To perform the Multi-Model Particle Filtering (MMPF) in an adaptive distributed manner, a Gaussian approximation of the particle cloud obtained at each sensor node, along with a weighted Consensus Propagation (CP)-based distributed data aggregation scheme, are deployed to dynamically re-weight the particle clouds. The filtering is a soft-data-constrained variant of multi-model particle filter, and is capable of processing both soft human-generated data and conventional hard sensory data. If permanent noise occurs in the estimation provided by a sensor node, due to either a faulty sensing device or misleading soft data, the contribution of that node in the weighted consensus process is immediately reduced in order to alleviate its effect on the estimation provided by the neighbouring nodes and the entire network. The robustness of the proposed source-reliability-adaptive distributed estimation method is demonstrated through simulation results for agile target tracking scenarios. Agility here refers to cases in which the observed dynamics of targets deviate from the given probabilistic characterization. Furthermore, the same concept is applied to model soft data constrained multiple-model Probability Hypothesis Density (PHD) filter that can track agile multiple targets with non-linear dynamics, which is a challenging problem. In this case, a Sequential Monte Carlo-Probability Hypothesis Density (SMC-PHD) filter deploys a Random Set (RS) theoretic formulation, along with Sequential Monte Carlo approximation, a variant of Bayes filtering. In general, the performance of Bayesian filtering-based methods can be enhanced by using extra information incorporated as specific constraints into the filtering process. Following the same principle, the new approach uses a constrained variant of the SMC-PHD filter, in which a fuzzy logic approach is used to transform the inherently vague human-generated data into a set of constraints. These constraints are then enforced on the filtering process by applying them as coefficients to the particles' weights. Because the human generated Soft Data (SD), reports on target-agility level, the proposed constrained-filtering approach is capable of dealing with multiple agile target tracking scenarios

Human Motion Trajectory Prediction: A Survey

With growing numbers of intelligent autonomous systems in human environments, the ability of such systems to perceive, understand and anticipate human behavior becomes increasingly important. Specifically, predicting future positions of dynamic agents and planning considering such predictions are key tasks for self-driving vehicles, service robots and advanced surveillance systems. This paper provides a survey of human motion trajectory prediction. We review, analyze and structure a large selection of work from different communities and propose a taxonomy that categorizes existing methods based on the motion modeling approach and level of contextual information used. We provide an overview of the existing datasets and performance metrics. We discuss limitations of the state of the art and outline directions for further research.Comment: Submitted to the International Journal of Robotics Research (IJRR), 37 page