1,628 research outputs found
Tracking by Prediction: A Deep Generative Model for Mutli-Person localisation and Tracking
Current multi-person localisation and tracking systems have an over reliance
on the use of appearance models for target re-identification and almost no
approaches employ a complete deep learning solution for both objectives. We
present a novel, complete deep learning framework for multi-person localisation
and tracking. In this context we first introduce a light weight sequential
Generative Adversarial Network architecture for person localisation, which
overcomes issues related to occlusions and noisy detections, typically found in
a multi person environment. In the proposed tracking framework we build upon
recent advances in pedestrian trajectory prediction approaches and propose a
novel data association scheme based on predicted trajectories. This removes the
need for computationally expensive person re-identification systems based on
appearance features and generates human like trajectories with minimal
fragmentation. The proposed method is evaluated on multiple public benchmarks
including both static and dynamic cameras and is capable of generating
outstanding performance, especially among other recently proposed deep neural
network based approaches.Comment: To appear in IEEE Winter Conference on Applications of Computer
Vision (WACV), 201
Multiple Target, Multiple Type Filtering in the RFS Framework
A Multiple Target, Multiple Type Filtering (MTMTF) algorithm is developed
using Random Finite Set (RFS) theory. First, we extend the standard Probability
Hypothesis Density (PHD) filter for multiple types of targets, each with
distinct detection properties, to develop a multiple target, multiple type
filtering, N-type PHD filter, where , for handling confusions among
target types. In this approach, we assume that there will be confusions between
detections, i.e. clutter arises not just from background false positives, but
also from target confusions. Then, under the assumptions of Gaussianity and
linearity, we extend the Gaussian mixture (GM) implementation of the standard
PHD filter for the proposed N-type PHD filter termed the N-type GM-PHD filter.
Furthermore, we analyze the results from simulations to track sixteen targets
of four different types using a four-type (quad) GM-PHD filter as a typical
example and compare it with four independent GM-PHD filters using the Optimal
Subpattern Assignment (OSPA) metric. This shows the improved performance of our
strategy that accounts for target confusions by efficiently discriminating
them
Multi Sensor Multi Target Perception and Tracking for Informed Decisions in Public Road Scenarios
Multi-target tracking in public traffic calls for a tracking system with automated track initiation and termination facilities in a randomly evolving driving environment. Besides, the key problem of data association needs to be handled effectively considering the limitations in the computational resources on-board an autonomous car. The challenge of the tracking problem is further evident in the use of high-resolution automotive sensors which return multiple detections per object. Furthermore, it is customary to use multiple sensors that cover different and/or over-lapping Field of View and fuse sensor detections to provide robust and reliable tracking. As a consequence, in high-resolution multi-sensor settings, the data association uncertainty, and the corresponding tracking complexity increases pointing to a systematic approach to handle and process sensor detections.
In this work, we present a multi-target tracking system that addresses target birth/initiation and death/termination processes with automatic track management features. These tracking functionalities can help facilitate perception during common events in public traffic as participants (suddenly) change lanes, navigate intersections, overtake and/or brake in emergencies, etc. Various tracking approaches including the ones based on joint integrated probability data association (JIPDA) filter, Linear Multi-target Integrated Probabilistic Data Association (LMIPDA) Filter, and their multi-detection variants are adapted to specifically include algorithms that handle track initiation and termination, clutter density estimation and track management. The utility of the filtering module is further elaborated by integrating it into a trajectory tracking problem based on model predictive control.
To cope with tracking complexity in the case of multiple high-resolution sensors, we propose a hybrid scheme that combines the approaches of data clustering at the local sensor and multiple detections tracking schemes at the fusion layer. We implement a track-to-track fusion scheme that de-correlates local (sensor) tracks to avoid double counting and apply a measurement partitioning scheme to re-purpose the LMIPDA tracking algorithm to multi-detection cases. In addition to the measurement partitioning approach, a joint extent and kinematic state estimation scheme are integrated into the LMIPDA approach to facilitate perception and tracking of an individual as well as group targets as applied to multi-lane public traffic. We formulate the tracking problem as a two hierarchical layer. This arrangement enhances the multi-target tracking performance in situations including but not limited to target initialization(birth process), target occlusion, missed detections, unresolved measurement, target maneuver, etc. Also, target groups expose complex individual target interactions to help in situation assessment which is challenging to capture otherwise.
The simulation studies are complemented by experimental studies performed on single and multiple (group) targets. Target detections are collected from a high-resolution radar at a frequency of 20Hz; whereas RTK-GPS data is made available as ground truth for one of the target vehicle\u27s trajectory
FollowMe: Efficient Online Min-Cost Flow Tracking with Bounded Memory and Computation
One of the most popular approaches to multi-target tracking is
tracking-by-detection. Current min-cost flow algorithms which solve the data
association problem optimally have three main drawbacks: they are
computationally expensive, they assume that the whole video is given as a
batch, and they scale badly in memory and computation with the length of the
video sequence. In this paper, we address each of these issues, resulting in a
computationally and memory-bounded solution. First, we introduce a dynamic
version of the successive shortest-path algorithm which solves the data
association problem optimally while reusing computation, resulting in
significantly faster inference than standard solvers. Second, we address the
optimal solution to the data association problem when dealing with an incoming
stream of data (i.e., online setting). Finally, we present our main
contribution which is an approximate online solution with bounded memory and
computation which is capable of handling videos of arbitrarily length while
performing tracking in real time. We demonstrate the effectiveness of our
algorithms on the KITTI and PETS2009 benchmarks and show state-of-the-art
performance, while being significantly faster than existing solvers
An advanced Bayesian model for the visual tracking of multiple interacting objects
Visual tracking of multiple objects is a key component of many visual-based systems. While there are reliable
algorithms for tracking a single object in constrained scenarios, the object tracking is still a challenge in
uncontrolled situations involving multiple interacting objects that have a complex dynamics. In this article, a novel
Bayesian model for tracking multiple interacting objects in unrestricted situations is proposed. This is accomplished
by means of an advanced object dynamic model that predicts possible interactive behaviors, which in turn depend
on the inference of potential events of object occlusion. The proposed tracking model can also handle false and
missing detections that are typical from visual object detectors operating in uncontrolled scenarios. On the other
hand, a Rao-Blackwellization technique has been used to improve the accuracy of the estimated object trajectories,
which is a fundamental aspect in the tracking of multiple objects due to its high dimensionality. Excellent results
have been obtained using a publicly available database, proving the efficiency of the proposed approach
- …