7 research outputs found
Poisson multi-Bernoulli conjugate prior for multiple extended object filtering
This paper presents a Poisson multi-Bernoulli mixture (PMBM) conjugate prior
for multiple extended object filtering. A Poisson point process is used to
describe the existence of yet undetected targets, while a multi-Bernoulli
mixture describes the distribution of the targets that have been detected. The
prediction and update equations are presented for the standard transition
density and measurement likelihood. Both the prediction and the update preserve
the PMBM form of the density, and in this sense the PMBM density is a conjugate
prior. However, the unknown data associations lead to an intractably large
number of terms in the PMBM density, and approximations are necessary for
tractability. A gamma Gaussian inverse Wishart implementation is presented,
along with methods to handle the data association problem. A simulation study
shows that the extended target PMBM filter performs well in comparison to the
extended target d-GLMB and LMB filters. An experiment with Lidar data
illustrates the benefit of tracking both detected and undetected targets
Which Framework is Suitable for Online 3D Multi-Object Tracking for Autonomous Driving with Automotive 4D Imaging Radar?
Online 3D multi-object tracking (MOT) has recently received significant
research interests due to the expanding demand of 3D perception in advanced
driver assistance systems (ADAS) and autonomous driving (AD). Among the
existing 3D MOT frameworks for ADAS and AD, conventional point object tracking
(POT) framework using the tracking-by-detection (TBD) strategy has been well
studied and accepted for LiDAR and 4D imaging radar point clouds. In contrast,
extended object tracking (EOT), another important framework which accepts the
joint-detection-and-tracking (JDT) strategy, has rarely been explored for
online 3D MOT applications. This paper provides the first systematical
investigation of the EOT framework for online 3D MOT in real-world ADAS and AD
scenarios. Specifically, the widely accepted TBD-POT framework, the recently
investigated JDT-EOT framework, and our proposed TBD-EOT framework are compared
via extensive evaluations on two open source 4D imaging radar datasets:
View-of-Delft and TJ4DRadSet. Experiment results demonstrate that the
conventional TBD-POT framework remains preferable for online 3D MOT with high
tracking performance and low computational complexity, while the proposed
TBD-EOT framework has the potential to outperform it in certain situations.
However, the results also show that the JDT-EOT framework encounters multiple
problems and performs inadequately in evaluation scenarios. After analyzing the
causes of these phenomena based on various evaluation metrics and
visualizations, we provide possible guidelines to improve the performance of
these MOT frameworks on real-world data. These provide the first benchmark and
important insights for the future development of 4D imaging radar-based online
3D MOT.Comment: 8 pages, 5 figures, submitted to the 2024 IEEE International
Conference on Robotics and Automation (ICRA2024
Extended Object Tracking: Introduction, Overview and Applications
This article provides an elaborate overview of current research in extended
object tracking. We provide a clear definition of the extended object tracking
problem and discuss its delimitation to other types of object tracking. Next,
different aspects of extended object modelling are extensively discussed.
Subsequently, we give a tutorial introduction to two basic and well used
extended object tracking approaches - the random matrix approach and the Kalman
filter-based approach for star-convex shapes. The next part treats the tracking
of multiple extended objects and elaborates how the large number of feasible
association hypotheses can be tackled using both Random Finite Set (RFS) and
Non-RFS multi-object trackers. The article concludes with a summary of current
applications, where four example applications involving camera, X-band radar,
light detection and ranging (lidar), red-green-blue-depth (RGB-D) sensors are
highlighted.Comment: 30 pages, 19 figure
Estimation and control of multi-object systems with high-fidenlity sensor models: A labelled random finite set approach
Principled and novel multi-object tracking algorithms are proposed, that have the ability to optimally process realistic sensor data, by accommodating complex observational phenomena such as merged measurements and extended targets. Additionally, a sensor control scheme based on a tractable, information theoretic objective is proposed, the goal of which is to optimise tracking performance in multi-object scenarios. The concept of labelled random finite sets is adopted in the development of these new techniques
Multi Sensor Multi Target Perception and Tracking for Informed Decisions in Public Road Scenarios
Multi-target tracking in public traffic calls for a tracking system with automated track initiation and termination facilities in a randomly evolving driving environment. Besides, the key problem of data association needs to be handled effectively considering the limitations in the computational resources on-board an autonomous car. The challenge of the tracking problem is further evident in the use of high-resolution automotive sensors which return multiple detections per object. Furthermore, it is customary to use multiple sensors that cover different and/or over-lapping Field of View and fuse sensor detections to provide robust and reliable tracking. As a consequence, in high-resolution multi-sensor settings, the data association uncertainty, and the corresponding tracking complexity increases pointing to a systematic approach to handle and process sensor detections.
In this work, we present a multi-target tracking system that addresses target birth/initiation and death/termination processes with automatic track management features. These tracking functionalities can help facilitate perception during common events in public traffic as participants (suddenly) change lanes, navigate intersections, overtake and/or brake in emergencies, etc. Various tracking approaches including the ones based on joint integrated probability data association (JIPDA) filter, Linear Multi-target Integrated Probabilistic Data Association (LMIPDA) Filter, and their multi-detection variants are adapted to specifically include algorithms that handle track initiation and termination, clutter density estimation and track management. The utility of the filtering module is further elaborated by integrating it into a trajectory tracking problem based on model predictive control.
To cope with tracking complexity in the case of multiple high-resolution sensors, we propose a hybrid scheme that combines the approaches of data clustering at the local sensor and multiple detections tracking schemes at the fusion layer. We implement a track-to-track fusion scheme that de-correlates local (sensor) tracks to avoid double counting and apply a measurement partitioning scheme to re-purpose the LMIPDA tracking algorithm to multi-detection cases. In addition to the measurement partitioning approach, a joint extent and kinematic state estimation scheme are integrated into the LMIPDA approach to facilitate perception and tracking of an individual as well as group targets as applied to multi-lane public traffic. We formulate the tracking problem as a two hierarchical layer. This arrangement enhances the multi-target tracking performance in situations including but not limited to target initialization(birth process), target occlusion, missed detections, unresolved measurement, target maneuver, etc. Also, target groups expose complex individual target interactions to help in situation assessment which is challenging to capture otherwise.
The simulation studies are complemented by experimental studies performed on single and multiple (group) targets. Target detections are collected from a high-resolution radar at a frequency of 20Hz; whereas RTK-GPS data is made available as ground truth for one of the target vehicle\u27s trajectory
Robust Multi-Object Tracking: A Labeled Random Finite Set Approach
The labeled random finite set based generalized multi-Bernoulli filter is a tractable analytic solution for the multi-object tracking problem. The robustness of this filter is dependent on certain knowledge regarding the multi-object system being available to the filter. This dissertation presents techniques for robust tracking, constructed upon the labeled random finite set framework, where complete information regarding the system is unavailable