Distributed Multi-Object Tracking Under Limited Field of View Heterogeneous Sensors with Density Clustering

We consider the problem of tracking multiple, unknown, and time-varying numbers of objects using a distributed network of heterogeneous sensors. In an effort to derive a formulation for practical settings, we consider limited and unknown sensor field-of-views (FoVs), sensors with limited local computational resources and communication channel capacity. The resulting distributed multi-object tracking algorithm involves solving an NP-hard multidimensional assignment problem either optimally for small-size problems or sub-optimally for general practical problems. For general problems, we propose an efficient distributed multi-object tracking algorithm that performs track-to-track fusion using a clustering-based analysis of the state space transformed into a density space to mitigate the complexity of the assignment problem. The proposed algorithm can more efficiently group local track estimates for fusion than existing approaches. To ensure we achieve globally consistent identities for tracks across a network of nodes as objects move between FoVs, we develop a graph-based algorithm to achieve label consensus and minimise track segmentation. Numerical experiments with a synthetic and a real-world trajectory dataset demonstrate that our proposed method is significantly more computationally efficient than state-of-the-art solutions, achieving similar tracking accuracy and bandwidth requirements but with improved label consistency

Robust Multi-target Tracking with Bootstrapped-GLMB Filter

This dissertation presents novel multi-target tracking algorithms that obviate the need for prior knowledge of system parameters such as clutter rate, detection probabilities, and birth models. Information on these parameters is unknown but important to tracking performance. The proposed algorithms exploit the advantages of existing RFS trackers and filters by bootstrapping them. This configuration inherits the efficiency of tracking target trajectories from the RFS trackers and low complexity in parameter estimation from the RFS filters

Estimation and control of multi-object systems with high-fidenlity sensor models: A labelled random finite set approach

Principled and novel multi-object tracking algorithms are proposed, that have the ability to optimally process realistic sensor data, by accommodating complex observational phenomena such as merged measurements and extended targets. Additionally, a sensor control scheme based on a tractable, information theoretic objective is proposed, the goal of which is to optimise tracking performance in multi-object scenarios. The concept of labelled random finite sets is adopted in the development of these new techniques

Optical based statistical space objects tracking for catalogue maintenance

The number of space objects has grown substantially in the past decades due to new launches, regular mission activities, and breakup events. This has significantly affected the space environment and the development of the space industry. To ensure safe operation of space assets, Space Situational Awareness (SSA) has attracted considerable attention in recent years. One primary strategy in SSA is to establish and maintain a Space Object Catalogue (SOC) to provide timely updated data for SSA applications, e.g., conjunction analysis, collision avoidance manoeuvring. This thesis investigates three techniques for SOC maintenance, namely the tracklet association method for initial orbit determination, the multi-target tracking method for the refinement of orbital state estimation, and multi-sensor tasking method for the optimisation of sensor resources. Generally speaking, due to the limited number of optical sensors used to track the large population of space objects, the obtained observational arcs for many targets are very short. Such short arcs, which contain a small number of angular observations, are referred as tracklets. Given such limited data, typical orbit determination methods, e.g., Laplace, Gaussian, Double-R methods, may fail to produce a valid orbital solution. By contrast, tracklet association methods compare and correlate multiple tracklets across time, and following successful association, a reliable initial orbital state can be further determined for SOC maintenance. This thesis proposes an improved initial value problem optimisation method for accurate and efficient tracklet association, and a common ellipse method to distinguish false associations of tracklets from objects in the same constellation. The proposed methods are validated using real optical data collected from the Mount Stromlo Observatory, Canberra, Australia. Furthermore, another challenging task in SSA is to track multiple objects for the maintenance of a catalog. The Bayesian multi-target tracking filter addresses this issue by associating measurements to initially known or newly detected targets and simultaneously estimating the timevarying number of targets and their orbital states. In order to achieve efficient tracking of the new space objects, a novel birth model using the Boundary Value Problem (BVP) approach is proposed. The proposed BVP birth model is implemented in the Labelled Multi-Bernoulli (LMB) filter, which is an efficient multi-target tracker developed based on the Random Finite Set (RFS) theory, for improved computational efficiency of new space object tracking. Simulation results indicate that the computational efficiency of the proposed method significantly outperforms the state-of-the-art methods. Finally, as limited sensors are available for SOC maintenance, an appropriate sensor tasking scheme is essential for the optimisation of sensor resources. The optimal sensor tasking command allocates multiple sensors to take the best action and produce useful measurements for more accurate orbital state estimation. In this thesis, an analytical form is derived for the Rényi divergence of LMB RFS in which each target state density is a single Gaussian component. The obtained analytical Rényi divergence is formulated as a reward function for multi-sensor tasking, which improves the computational efficiency, especially for large-scale space object tracking. In addition, this thesis further investigates the benefits of using the analytical Rényi  divergence and various space-based and ground-based sensor networks for accurate tracking of objects in geosynchronous Earth orbit

Online Audio-Visual Multi-Source Tracking and Separation: A Labeled Random Finite Set Approach

The dissertation proposes an online solution for separating an unknown and time-varying number of moving sources using audio and visual data. The random finite set framework is used for the modeling and fusion of audio and visual data. This enables an online tracking algorithm to estimate the source positions and identities for each time point. With this information, a set of beamformers can be designed to separate each desired source and suppress the interfering sources

Multiple-Object Estimation Techniques for Challenging Scenarios

A series of methods for solving the multi-object estimation problem in the context sequential Bayesian inference is presented. These methods concentrate on dealing with challenging scenarios of multiple target tracking, involving fundamental problems of nonlinearity and non-Gaussianity of processes, high state dimensionality, high number of targets, statistical dependence between target states, and degenerate cases of low signal-to-noise ratio, high uncertainty, lowly observable states or uninformative observations. These difficulties pose obstacles to most practical multi-object inference problems, lying at the heart of the shortcomings reported for state-of-the-art methods, and so elicit novel treatments to enable tackling a broader class of real problems. The novel algorithms offered as solutions in this dissertation address such challenges by acting on the root causes of the associated problems. Often this involves essential dilemmas commonly manifested in Statistics and Decision Theory, such as trading off estimation accuracy with algorithm complexity, soft versus hard decision, generality versus tractability, conciseness versus interpretativeness etc. All proposed algorithms constitute stochastic filters, each of which is formulated to address specific aspects of the challenges at hand while offering tools to achieve judicious compromises in the aforementioned dilemmas. Two of the filters address the weight degeneracy observed in sequential Monte Carlo filters, particularly for nonlinear processes. One of these filters is designed for nonlinear non-Gaussian high-dimensional problems, delivering representativeness of the uncertainty in high-dimensional states while mitigating part of the inaccuracies that arise from the curse of dimensionality. This filter is shown to cope well with scenarios of multimodality, high state uncertainty, uninformative observations and high number of false alarms. A multi-object filter deals with the problem of considering dependencies between target states in a way that is scalable to a large number of targets, by resorting to probabilistic graphical structures. Another multi-object filter treats the problem of reducing the computational complexity of a state-of-the-art cardinalized filter to deal with a large number of targets, without compromising accuracy significantly. Finally, a framework for associating measurements across observation sessions for scenarios of low state observability is proposed, with application to an important Space Surveillance task: cataloging of space debris in the geosynchronous/geostationary belt. The devised methods treat the considered challenges by bringing about rather general questions, and provide not only principled solutions but also analyzes the essence of the investigated problems, extrapolating the implemented techniques to a wider spectrum of similar problems in Signal Processing

Distributed joint probabilistic data association filter with hybrid fusion strategy

This paper investigates the problem of distributed multitarget tracking (MTT) over a large-scale sensor network, consisting of low-cost sensors. Each local sensor runs a joint probabilistic data association filter to obtain local estimates and communicates with its neighbors for information fusion. The conventional fusion strategies, i.e., consensus on measurement (CM) and consensus on information (CI), are extended to MTT scenarios. This means that data association uncertainty and sensor fusion problems are solved simultaneously. Motivated by the complementary characteristics of these two different fusion approaches, a novel distributed MTT algorithm using a hybrid fusion strategy, e.g., a mix of CM and CI, is proposed. A distributed counting algorithm is incorporated into the tracker to provide the knowledge of the total number of sensor nodes. The new algorithm developed shows advantages in preserving boundedness of local estimates, guaranteeing global convergence to the optimal centralized version and being implemented without requiring no global information, compared with other fusion approaches. Simulations clearly demonstrate the characteristics and tracking performance of the proposed algorithm

Exploring space situational awareness using neuromorphic event-based cameras

The orbits around earth are a limited natural resource and one that hosts a vast range of vital space-based systems that support international systems use by both commercial industries, civil organisations, and national defence. The availability of this space resource is rapidly depleting due to the ever-growing presence of space debris and rampant overcrowding, especially in the limited and highly desirable slots in geosynchronous orbit. The field of Space Situational Awareness encompasses tasks aimed at mitigating these hazards to on-orbit systems through the monitoring of satellite traffic. Essential to this task is the collection of accurate and timely observation data. This thesis explores the use of a novel sensor paradigm to optically collect and process sensor data to enhance and improve space situational awareness tasks. Solving this issue is critical to ensure that we can continue to utilise the space environment in a sustainable way. However, these tasks pose significant engineering challenges that involve the detection and characterisation of faint, highly distant, and high-speed targets. Recent advances in neuromorphic engineering have led to the availability of high-quality neuromorphic event-based cameras that provide a promising alternative to the conventional cameras used in space imaging. These cameras offer the potential to improve the capabilities of existing space tracking systems and have been shown to detect and track satellites or ‘Resident Space Objects’ at low data rates, high temporal resolutions, and in conditions typically unsuitable for conventional optical cameras. This thesis presents a thorough exploration of neuromorphic event-based cameras for space situational awareness tasks and establishes a rigorous foundation for event-based space imaging. The work conducted in this project demonstrates how to enable event-based space imaging systems that serve the goals of space situational awareness by providing accurate and timely information on the space domain. By developing and implementing event-based processing techniques, the asynchronous operation, high temporal resolution, and dynamic range of these novel sensors are leveraged to provide low latency target acquisition and rapid reaction to challenging satellite tracking scenarios. The algorithms and experiments developed in this thesis successfully study the properties and trade-offs of event-based space imaging and provide comparisons with traditional observing methods and conventional frame-based sensors. The outcomes of this thesis demonstrate the viability of event-based cameras for use in tracking and space imaging tasks and therefore contribute to the growing efforts of the international space situational awareness community and the development of the event-based technology in astronomy and space science applications