Estimation and control of multi-object systems with high-fidenlity sensor models: A labelled random finite set approach

Principled and novel multi-object tracking algorithms are proposed, that have the ability to optimally process realistic sensor data, by accommodating complex observational phenomena such as merged measurements and extended targets. Additionally, a sensor control scheme based on a tractable, information theoretic objective is proposed, the goal of which is to optimise tracking performance in multi-object scenarios. The concept of labelled random finite sets is adopted in the development of these new techniques

Mehrobjekt-Zustandsschätzung mit verteilten Sensorträgern am Beispiel der Umfeldwahrnehmung im Straßenverkehr

Umfeldwahrnehmung im automobilen Kontext kann als Zustandsschätzproblem mit mengenwertigem Systemzustand betrachtet werden. Basierend auf FISST wird eine SLAM-ähnliche Methodik gewählt, welche explizit die Unsicherheit bei der Lokalisierung des Sensorträgers berücksichtigt. Diese wird auf die PHD-, JIPDA- und MEMBER-Filteransätze angewandt. Hierbei ist eine Modifikation des Standardmessmodells nötig, um zu implementierbaren Korrekturgleichungen zu gelangen

Mehrobjekt-Zustandsschätzung mit verteilten Sensorträgern am Beispiel der Umfeldwahrnehmung im Straßenverkehr

Umfeldwahrnehmung im automobilen Kontext kann als Zustandsschätzproblem mit mengenwertigem Systemzustand betrachtet werden. Basierend auf FISST wird eine SLAM-ähnliche Methodik gewählt, welche explizit die Unsicherheit bei der Lokalisierung des Sensorträgers berücksichtigt. Diese wird auf die PHD-, JIPDA- und MEMBER-Filteransätze angewandt. Hierbei ist eine Modifikation des Standardmessmodells nötig, um zu implementierbaren Korrekturgleichungen zu gelangen

Acoustic Speaker Localization with Strong Reverberation and Adaptive Feature Filtering with a Bayes RFS Framework

The thesis investigates the challenges of speaker localization in presence of strong reverberation, multi-speaker tracking, and multi-feature multi-speaker state filtering, using sound recordings from microphones. Novel reverberation-robust speaker localization algorithms are derived from the signal and room acoustics models. A multi-speaker tracking filter and a multi-feature multi-speaker state filter are developed based upon the generalized labeled multi-Bernoulli random finite set framework. Experiments and comparative studies have verified and demonstrated the benefits of the proposed methods

Multi-object tracking in video using labeled random finite sets

The safety of industrial mobile platforms (such as fork lifts and boom lifts) is of major concern in the world today as industry embraces the concepts of Industry 4.0. The existing safety methods are predominantly based on Radio Frequency Identification (RFID) technology and therefore can only determine the distance at which a pedestrian who is wearing an RFID tag is standing. Other methods use expensive laser scanners to map the surrounding and warn the driver accordingly. The aim of this research project is to improve the safety of industrial mobile platforms, by detecting and tracking pedestrians in the path of the mobile platform, using readily available cheap camera modules. In order to achieve this aim, this research focuses on multi-object tracking which is one of the most ubiquitously addressed problems in the field of \textit{Computer Vision}. Algorithms that can track targets under severe conditions, such as varying number of objects, occlusion, illumination changes and abrupt movements of the objects are investigated in this research project. Furthermore, a substantial focus is given to improving the accuracy and, performance and to handling misdetections and false alarms. In order to formulate these algorithms, the recently introduced concept of Random Finite Sets (RFS) is used as the underlying mathematical framework. The algorithms formulated to meet the above criteria were tested on standard visual tracking datasets as well as on a dataset which was created by our research group, for performance and accuracy using standard performance and accuracy metrics that are widely used in the computer vision literature. These results were compared with numerous state-of-the-art methods and are shown to outperform or perform favourably in terms of the metrics mentioned above