Extended Object Tracking: Introduction, Overview and Applications

This article provides an elaborate overview of current research in extended object tracking. We provide a clear definition of the extended object tracking problem and discuss its delimitation to other types of object tracking. Next, different aspects of extended object modelling are extensively discussed. Subsequently, we give a tutorial introduction to two basic and well used extended object tracking approaches - the random matrix approach and the Kalman filter-based approach for star-convex shapes. The next part treats the tracking of multiple extended objects and elaborates how the large number of feasible association hypotheses can be tackled using both Random Finite Set (RFS) and Non-RFS multi-object trackers. The article concludes with a summary of current applications, where four example applications involving camera, X-band radar, light detection and ranging (lidar), red-green-blue-depth (RGB-D) sensors are highlighted.Comment: 30 pages, 19 figure

Simultaneous Tracking and Shape Estimation of Extended Objects

This work is concerned with the simultaneous tracking and shape estimation of a mobile extended object based on noisy sensor measurements. Novel methods are developed for coping with the following two main challenges: i) The computational complexity due to the nonlinearity and high-dimensionality of the problem and ii) the lack of statistical knowledge about possible measurement sources on the extended object

Fast 3D Extended Target Tracking using NURBS Surfaces

This paper proposes fast and novel methods to jointly estimate the target's unknown 3D shape and dynamics. Measurements are noisy and sparsely distributed 3D points from a light detection and ranging (LiDAR) sensor. The methods utilize non-uniform rational B-splines (NURBS) surfaces to approximate the target's shape. One method estimates Cartesian scaling parameters of a NURBS surface, whereas the second method estimates the corresponding NURBS weights, too. Major advantages are the capability of estimating a fully 3D shape as well as the fast processing time. Real-world evaluations with a static and dynamic vehicle show promising results compared to state-of-the-art 3D extended target tracking algorithms.Comment: In Proceedings of IEEE Intelligent Transportation Systems Conference (ITSC), 201

Tracking Extended Objects in Noisy Point Clouds with Application in Telepresence Systems

We discuss theory and application of extended object tracking. This task is challenging as sensor noise prevents a correct association of the measurements to their sources on the object, the shape itself might be unknown a priori, and due to occlusion effects, only parts of the object are visible at a given time. We propose an approach to track the parameters of arbitrary objects, which provides new solutions to the above challenges, and marks a significant advance to the state of the art

Tracking of Spline Modeled Extended Objects Using Random Finite Sets

In the field of autonomously driving vehicles the environment perception containing dynamic objects like other road users is essential. Especially, detecting other vehicles in the road traffic using sensor data is of utmost importance. As the sensor data and the applied system model for the objects of interest are noise corrupted, a filter algorithm must be used to track moving objects. Using LIDAR sensors one object gives rise to more than one measurement per time step and is therefore called extended object. This allows to jointly estimate the objects, position, as well as its orientation, extension and shape. Estimating an arbitrary shaped object comes with a higher computational effort than estimating the shape of an object that can be approximated using a basic geometrical shape like an ellipse or a rectangle. In the case of a vehicle, assuming a rectangular shape is an accurate assumption. A recently developed approach models the contour of a vehicle as periodic B-spline function. This representation is an easy to use tool, as the contour can be specified by some basis points in Cartesian coordinates. Also rotating, scaling and moving the contour is easy to handle using a spline contour. This contour model can be used to develop a measurement model for extended objects, that can be integrated into a tracking filter. Another approach modeling the shape of a vehicle is the so-called bounding box that represents the shape as rectangle. In this thesis the basics of single, multi and extended object tracking, as well as the basics of B-spline functions are addressed. Afterwards, the spline measurement model is established in detail and integrated into an extended Kalman filter to track a single extended object. An implementation of the resulting algorithm is compared with the rectangular shape estimator. The implementation of the rectangular shape estimator is provided. The comparison is done using long-term considerations with Monte Carlo simulations and by analyzing the results of a single run. Therefore, both algorithms are applied to the same measurements. The measurements are generated using an artificial LIDAR sensor in a simulation environment. In a real-world tracking scenario detecting several extended objects and measurements that do not originate from a real object, named clutter measurements, is possible. Also, the sudden appearance and disappearance of an object is possible. A filter framework investigated in recent years that can handle tracking multiple objects in a cluttered environment is a random finite set based approach. The idea of random finite sets and its use in a tracking filter is recapped in this thesis. Afterwards, the spline measurement model is included in a multi extended object tracking framework. An implementation of the resulting filter is investigated in a long-term consideration using Monte Carlo simulations and by analyzing the results of a single run. The multi extended object filter is also applied to artificial LIDAR measurements generated in a simulation environment. The results of comparing the spline based and rectangular based extended object trackers show a more stable performance of the spline extended object tracker. Also, some problems that have to be addressed in future works are discussed. The investigation of the resulting multi extended object tracker shows a successful integration of the spline measurement model in a multi extended object tracker. Also, with these results some problems remain, that have to be solved in future works

Shape Tracking of Extended Objects and Group Targets with Star-Convex RHMs

This paper is about tracking an extended object or a group target, which gives rise to a varying number of measurements from different measurement sources. For this purpose, the shape of the target is tracked in addition to its kinematics. The target extent is modeled with a new approach called Random Hypersurface Model (RHM) that assumes varying measurement sources to lie on scaled versions of the shape boundaries. In this paper, a star-convex RHM is introduced for tracking star-convex shape approximations of targets. Bayesian inference for star-convex RHM is performed by means of a Gaussian-assumed state estimator allowing for an efficient recursive closed-form measurement update. Simulations demonstrate the performance of this approach for typical extended object and group tracking scenarios

Simultaneous Tracking and Shape Estimation of Extended Objects

This work is concerned with the simultaneous tracking and shape estimation of a mobile extended object based on noisy sensor measurements. Novel methods are developed for coping with the following two main challenges: i) The computational complexity due to the nonlinearity and high-dimensionality of the problem, and ii) the lack of statistical knowledge about possible measurement sources on the extended object

Tracking Extended Objects with Active Models and Negative Measurements

Extended object tracking deals with estimating the shape and pose of an object based on noisy point measurements. This task is not straightforward, as we may be faced with scarce low-quality measurements, little a priori information, or we may be unable to observe the entire target. This work aims to address these challenges by incorporating ideas from active contours and exploiting information from negative measurements, which tell us where the target cannot be