Exploiting Bounded Sensor Field-of-View Geometry in Tracking and Sensor Planning Problems

In search-detect-track problems, knowledge of where objects were not seen can be as valuable as knowledge of where objects were seen. Exploiting the sensor's known sensing extents, or field-of-view (FoV), this type of evidence can be incorporated in a Bayesian framework to improve tracking accuracy and form better sensor schedules. This paper presents new techniques for incorporating bounded FoV inclusion/exclusion evidence in object state densities and multi-object cardinality distributions. Some examples of how the proposed techniques may be applied to tracking and sensor planning problems are given

Robust Multi-target Tracking with Bootstrapped-GLMB Filter

This dissertation presents novel multi-target tracking algorithms that obviate the need for prior knowledge of system parameters such as clutter rate, detection probabilities, and birth models. Information on these parameters is unknown but important to tracking performance. The proposed algorithms exploit the advantages of existing RFS trackers and filters by bootstrapping them. This configuration inherits the efficiency of tracking target trajectories from the RFS trackers and low complexity in parameter estimation from the RFS filters

Online Audio-Visual Multi-Source Tracking and Separation: A Labeled Random Finite Set Approach

The dissertation proposes an online solution for separating an unknown and time-varying number of moving sources using audio and visual data. The random finite set framework is used for the modeling and fusion of audio and visual data. This enables an online tracking algorithm to estimate the source positions and identities for each time point. With this information, a set of beamformers can be designed to separate each desired source and suppress the interfering sources

Distributed joint probabilistic data association filter with hybrid fusion strategy

This paper investigates the problem of distributed multitarget tracking (MTT) over a large-scale sensor network, consisting of low-cost sensors. Each local sensor runs a joint probabilistic data association filter to obtain local estimates and communicates with its neighbors for information fusion. The conventional fusion strategies, i.e., consensus on measurement (CM) and consensus on information (CI), are extended to MTT scenarios. This means that data association uncertainty and sensor fusion problems are solved simultaneously. Motivated by the complementary characteristics of these two different fusion approaches, a novel distributed MTT algorithm using a hybrid fusion strategy, e.g., a mix of CM and CI, is proposed. A distributed counting algorithm is incorporated into the tracker to provide the knowledge of the total number of sensor nodes. The new algorithm developed shows advantages in preserving boundedness of local estimates, guaranteeing global convergence to the optimal centralized version and being implemented without requiring no global information, compared with other fusion approaches. Simulations clearly demonstrate the characteristics and tracking performance of the proposed algorithm

Optical based statistical space objects tracking for catalogue maintenance

The number of space objects has grown substantially in the past decades due to new launches, regular mission activities, and breakup events. This has significantly affected the space environment and the development of the space industry. To ensure safe operation of space assets, Space Situational Awareness (SSA) has attracted considerable attention in recent years. One primary strategy in SSA is to establish and maintain a Space Object Catalogue (SOC) to provide timely updated data for SSA applications, e.g., conjunction analysis, collision avoidance manoeuvring. This thesis investigates three techniques for SOC maintenance, namely the tracklet association method for initial orbit determination, the multi-target tracking method for the refinement of orbital state estimation, and multi-sensor tasking method for the optimisation of sensor resources. Generally speaking, due to the limited number of optical sensors used to track the large population of space objects, the obtained observational arcs for many targets are very short. Such short arcs, which contain a small number of angular observations, are referred as tracklets. Given such limited data, typical orbit determination methods, e.g., Laplace, Gaussian, Double-R methods, may fail to produce a valid orbital solution. By contrast, tracklet association methods compare and correlate multiple tracklets across time, and following successful association, a reliable initial orbital state can be further determined for SOC maintenance. This thesis proposes an improved initial value problem optimisation method for accurate and efficient tracklet association, and a common ellipse method to distinguish false associations of tracklets from objects in the same constellation. The proposed methods are validated using real optical data collected from the Mount Stromlo Observatory, Canberra, Australia. Furthermore, another challenging task in SSA is to track multiple objects for the maintenance of a catalog. The Bayesian multi-target tracking filter addresses this issue by associating measurements to initially known or newly detected targets and simultaneously estimating the timevarying number of targets and their orbital states. In order to achieve efficient tracking of the new space objects, a novel birth model using the Boundary Value Problem (BVP) approach is proposed. The proposed BVP birth model is implemented in the Labelled Multi-Bernoulli (LMB) filter, which is an efficient multi-target tracker developed based on the Random Finite Set (RFS) theory, for improved computational efficiency of new space object tracking. Simulation results indicate that the computational efficiency of the proposed method significantly outperforms the state-of-the-art methods. Finally, as limited sensors are available for SOC maintenance, an appropriate sensor tasking scheme is essential for the optimisation of sensor resources. The optimal sensor tasking command allocates multiple sensors to take the best action and produce useful measurements for more accurate orbital state estimation. In this thesis, an analytical form is derived for the Rényi divergence of LMB RFS in which each target state density is a single Gaussian component. The obtained analytical Rényi divergence is formulated as a reward function for multi-sensor tasking, which improves the computational efficiency, especially for large-scale space object tracking. In addition, this thesis further investigates the benefits of using the analytical Rényi  divergence and various space-based and ground-based sensor networks for accurate tracking of objects in geosynchronous Earth orbit

Estimation and control of multi-object systems with high-fidenlity sensor models: A labelled random finite set approach

Principled and novel multi-object tracking algorithms are proposed, that have the ability to optimally process realistic sensor data, by accommodating complex observational phenomena such as merged measurements and extended targets. Additionally, a sensor control scheme based on a tractable, information theoretic objective is proposed, the goal of which is to optimise tracking performance in multi-object scenarios. The concept of labelled random finite sets is adopted in the development of these new techniques

Exploring space situational awareness using neuromorphic event-based cameras

The orbits around earth are a limited natural resource and one that hosts a vast range of vital space-based systems that support international systems use by both commercial industries, civil organisations, and national defence. The availability of this space resource is rapidly depleting due to the ever-growing presence of space debris and rampant overcrowding, especially in the limited and highly desirable slots in geosynchronous orbit. The field of Space Situational Awareness encompasses tasks aimed at mitigating these hazards to on-orbit systems through the monitoring of satellite traffic. Essential to this task is the collection of accurate and timely observation data. This thesis explores the use of a novel sensor paradigm to optically collect and process sensor data to enhance and improve space situational awareness tasks. Solving this issue is critical to ensure that we can continue to utilise the space environment in a sustainable way. However, these tasks pose significant engineering challenges that involve the detection and characterisation of faint, highly distant, and high-speed targets. Recent advances in neuromorphic engineering have led to the availability of high-quality neuromorphic event-based cameras that provide a promising alternative to the conventional cameras used in space imaging. These cameras offer the potential to improve the capabilities of existing space tracking systems and have been shown to detect and track satellites or ‘Resident Space Objects’ at low data rates, high temporal resolutions, and in conditions typically unsuitable for conventional optical cameras. This thesis presents a thorough exploration of neuromorphic event-based cameras for space situational awareness tasks and establishes a rigorous foundation for event-based space imaging. The work conducted in this project demonstrates how to enable event-based space imaging systems that serve the goals of space situational awareness by providing accurate and timely information on the space domain. By developing and implementing event-based processing techniques, the asynchronous operation, high temporal resolution, and dynamic range of these novel sensors are leveraged to provide low latency target acquisition and rapid reaction to challenging satellite tracking scenarios. The algorithms and experiments developed in this thesis successfully study the properties and trade-offs of event-based space imaging and provide comparisons with traditional observing methods and conventional frame-based sensors. The outcomes of this thesis demonstrate the viability of event-based cameras for use in tracking and space imaging tasks and therefore contribute to the growing efforts of the international space situational awareness community and the development of the event-based technology in astronomy and space science applications

Consent To Shoot – Rethinking The Anti-satellite Weapon Versus Space Debris Dilemma

Space debris, whether caused by anti-satellite weapons or from collisions with defunct vehicles, has become a serious threat to the safe and sustainable use of space. Technologies have been proposed to mitigate this problem by actively removing debris (ADR) by capturing and de-orbiting the targets (e.g., rendezvous operations, tethers, or harpoons) or by indirectly affecting the target’s orbit (e.g., using lasers). However, rather sooner than later, deploying ADR technologies against healthy satellites turns the tools for making space safer into anti-satellite weapons, capable of crippling other nations’ infrastructure. In an attempt to resolve the tool-versus-weapon dilemma, we discuss in this paper technical solutions that involve a paradigm shift in the Concept of Operations, but that also have the potential to avoid political implications and many concerns that currently prevent us from solving the space-debris problem. The solutions we advocate require consensus between involved stakeholders for all critical operations of an ADR system. We show it is technologically possible and, in fact, already well understood how to enforce that such operations can only be performed consensually. We sketch a distributed infrastructure, capable of supporting such operations among all stakeholders, enforcing agreement in international cooperation about where and for how long an ADR system gets activated, what targets it follows and where safety zones and objects are. In this way, stakeholders have to validate every piece of information to remove single points of failures, but more importantly to put the required mutual trust on solid and technologically enforced foundations