Distributed agents for autonomous spacecraft

Space missions have evolved considerably in the last fifty years in both complexity and ambition. In order to enable this continued improvement in the scientific and commercial return of space missions new control systems are needed that can manage complex combinations of state of the art hardware with a minimum of human interaction. Distributed multi-agent systems are one approach to controlling complex multisatellite space missions. A distributed system is not enough on its own however,the spacecraft must be able to carry out complex tasks such as planning,negotiation and close proximity formation flying autonomously. It is the coupling of distributed control with autonomy that is the focus of this thesis. Three contributions to the state of the art are described herein. They all involve the innovative use of multi-agent systems in space missions. The first is the development of a multi-agent architecture, HASA, specifically for space missions. The second is to use embedded agents to autonomously control an interferometric type space telescope. The third is based on software agents that coordinate multiple Earth observation missions coupled with a global optimisation technique for data extraction. The HASA architecture was developed in reaction to the over generality of most multi-agent architectures in the computer science and robotics literature and the ad-hoc, case-by-case approach, to multi-agent architectures when developed and deployed for space missions. The HASA architecture has a recursive nature which allows for the multi-agent system to be completely described throughout its development process as the design evolves and more sub-systems are implemented. It also inherits a focus on the robust generation of a product and safe operation from architectures in use in the manufacturing industry. A multi-agent system was designed using the HASA architecture for an interferometric space telescope type mission. This type of mission puts high requirements on formation flying and cooperation between agents. The formation flying agents were then implemented using a Java framework and tested on a multi-platform distributed simulation suite developed especially for this thesis. Three different control methods were incorporated into the agents and the multi-agent system was shown to be able to acquire and change formation and avoid collisions autonomously. A second multi-agent system was designed for the GMES mission in collaboration with GMV, the industrial partner in this project. This basic MAS design was transferred to the HASA architecture. A novel image selection algorithm was developed to work alongside the GMES multi-agent system. This algorithm uses global optimisation techniques to suggest image parameters to users based on the output of the multi-agent system

Development of a guidance, navigation and control architecture and validation process enabling autonomous docking to a tumbling satellite

Thesis (Sc. D.)--Massachusetts Institute of Technology, Dept. of Aeronautics and Astronautics, 2007.Includes bibliographical references (p. 307-324).The capability to routinely perform autonomous docking is a key enabling technology for future space exploration, as well as assembly and servicing missions for spacecraft and commercial satellites. Particularly, in more challenging situations where the target spacecraft or satellite is tumbling, algorithms and strategies must be implemented to ensure the safety of both docking entities in the event of anomalies. However, difficulties encountered in past docking missions conducted with expensive satellites on orbit have indicated a lack of maturity in the technologies required for such operations. Therefore, more experimentation must be performed to improve the current autonomous docking capabilities. The main objectives of the research presented in this thesis are to develop a guidance, navigation and control (GN&C) architecture that enables the safe and fuel-efficient docking with a free tumbling target in the presence of obstacles and anomalies, and to develop the software tools and verification processes necessary in order to successfully demonstrate the GN&C architecture in a relevant environment. The GN&C architecture was developed by integrating a spectrum of GN&C algorithms including estimation, control, path planning, and failure detection, isolation and recovery algorithms.(cont.) The algorithms were implemented in GN&C software modules for real-time experimentation using the Synchronized Position Hold Engage and Reorient Experimental Satellite (SPHERES) facility that was created by the MIT Space Systems Laboratory. Operated inside the International Space Station (ISS), SPHERES allow the incremental maturation of formation flight and autonomous docking algorithms in a risk-tolerant, microgravity environment. Multiple autonomous docking operations have been performed in the ISS to validate the GN&C architecture. These experiments led to the first autonomous docking with a tumbling target ever achieved in microgravity. Furthermore, the author also demonstrated successful docking in spite of the presence of measurement errors that were detected and rejected by an online fault detection algorithm. The results of these experiments will be discussed in this thesis. Finally, based on experiments in a laboratory environment, the author establishes two processes for the verification of GN&C software prior to on-orbit testing on the SPHERES testbed.by Simon Nolet.Sc.D

Developing a distributed electronic health-record store for India

The DIGHT project is addressing the problem of building a scalable and highly available information store for the Electronic Health Records (EHRs) of the over one billion citizens of India

In pursuit of autonomous distributed satellite systems

Satellite imagery has become an essential resource for environmental, humanitarian, and industrial endeavours. As a means to satisfy the requirements of new applications and user needs, novel Earth Observation (EO) systems are exploring the suitability of Distributed Satellite Systems (DSS) in which multiple observation assets concurrently sense the Earth. Given the temporal and spatial resolution requirements of EO products, DSS are often envisioned as large-scale systems with multiple sensing capabilities operating in a networked manner. Enabled by the consolidation of small satellite platforms and fostered by the emerging capabilities of distributed systems, these new architectures pose multiple design and operational challenges. Two of them are the main pillars of this research, namely, the conception of decision-support tools to assist the architecting process of a DSS, and the design of autonomous operational frameworks based on decentralised, on-board decision-making. The first part of this dissertation addresses the architecting of heterogeneous, networked DSS architectures that hybridise small satellite platforms with traditional EO assets. We present a generic design-oriented optimisation framework based on tradespace exploration methodologies. The goals of this framework are twofold: to select the most optimal constellation design; and to facilitate the identification of design trends, unfeasible regions, and tensions among architectural attributes. Oftentimes in EO DSS, system requirements and stakeholder preferences are not only articulated through functional attributes (i.e. resolution, revisit time, etc.) or monetary constraints, but also through qualitative traits such as flexibility, evolvability, robustness, or resiliency, amongst others. In line with that, the architecting framework defines a single figure of merit that aggregates quantitative attributes and qualitative ones-the so-called ilities of a system. With that, designers can steer the design of DSS both in terms of performance or cost, and in terms of their high-level characteristics. The application of this optimisation framework has been illustrated in two timely use-cases identified in the context of the EU-funded ONION project: a system that measures ocean and ice parameters in Polar regions to facilitate weather forecast and off-shore operations; and a system that provides agricultural variables crucial for global management of water stress, crop state, and draughts. The analysis of architectural features facilitated a comprehensive understanding of the functional and operational characteristics of DSS. With that, this thesis continues to delve into the design of DSS by focusing on one particular functional trait: autonomy. The minimisation of human-operator intervention has been traditionally sought in other space systems and can be especially critical for large-scale, structurally dynamic, heterogeneous DSS. In DSS, autonomy is expected to cope with the likely inability to operate very large-scale systems in a centralised manner, to improve the science return, and to leverage many of their emerging capabilities (e.g. tolerance to failures, adaptability to changing structures and user needs, responsiveness). We propose an autonomous operational framework that provides decentralised decision-making capabilities to DSS by means of local reasoning and individual resource allocation, and satellite-to-satellite interactions. In contrast to previous works, the autonomous decision-making framework is evaluated in this dissertation for generic constellation designs the goal of which is to minimise global revisit times. As part of the characterisation of our solution, we stressed the implications that autonomous operations can have upon satellite platforms with stringent resource constraints (e.g. power, memory, communications capabilities) and evaluated the behaviour of the solution for a large-scale DSS composed of 117 CubeSat-like satellite units.La imatgeria per satèl·lit ha esdevingut un recurs essencial per assolir tasques ambientals, humanitàries o industrials. Per tal de satisfer els requeriments de les noves aplicacions i usuaris, els sistemes d’observació de la Terra (OT) estan explorant la idoneïtat dels Sistemes de Satèl·lit Distribuïts (SSD), on múltiples observatoris espacials mesuren el planeta simultàniament. Degut al les resolucions temporals i espacials requerides, els SSD sovint es conceben com sistemes de gran escala que operen en xarxa. Aquestes noves arquitectures promouen les capacitats emergents dels sistemes distribuïts i, tot i que són possibles gràcies a l’acceptació de les plataformes de satèl·lits petits, encara presenten molts reptes en quant al disseny i operacions. Dos d’ells són els pilars principals d’aquesta tesi, en concret, la concepció d’eines de suport a la presa de decisions pel disseny de SSD, i la definició d’operacions autònomes basades en gestió descentralitzada a bord dels satèl·lits. La primera part d’aquesta dissertació es centra en el disseny arquitectural de SSD heterogenis i en xarxa, imbricant tecnologies de petits satèl·lits amb actius tradicionals. Es presenta un entorn d’optimització orientat al disseny basat en metodologies d’exploració i comparació de solucions. Els objectius d’aquest entorn són: la selecció el disseny de constel·lació més òptim; i facilitar la identificació de tendències de disseny, regions d’incompatibilitat, i tensions entre atributs arquitecturals. Sovint en els SSD d’OT, els requeriments del sistema i l’expressió de prioritats no només s’articulen en quant als atributs funcionals o les restriccions monetàries, sinó també a través de les característiques qualitatives com la flexibilitat, l’evolucionabilitat, la robustesa, o la resiliència, entre d’altres. En línia amb això, l’entorn d’optimització defineix una única figura de mèrit que agrega rendiment, cost i atributs qualitatius. Així l’equip de disseny pot influir en les solucions del procés d’optimització tant en els aspectes quantitatius, com en les característiques dalt nivell. L’aplicació d’aquest entorn d’optimització s’il·lustra en dos casos d’ús actuals identificats en context del projecte europeu ONION: un sistema que mesura paràmetres de l’oceà i gel als pols per millorar la predicció meteorològica i les operacions marines; i un sistema que obté mesures agronòmiques vitals per la gestió global de l’aigua, l’estimació d’estat dels cultius, i la gestió de sequeres. L’anàlisi de propietats arquitecturals ha permès copsar de manera exhaustiva les característiques funcionals i operacionals d’aquests sistemes. Amb això, la tesi ha seguit aprofundint en el disseny de SSD centrant-se, particularment, en un tret funcional: l’autonomia. Minimitzar la intervenció de l’operador humà és comú en altres sistemes espacials i podria ser especialment crític pels SSD de gran escala, d’estructura dinàmica i heterogenis. En els SSD s’espera que l’autonomia solucioni la possible incapacitat d’operar sistemes de gran escala de forma centralitzada, que millori el retorn científic i que n’apuntali les seves propietats emergents (e.g. tolerància a errors, adaptabilitat a canvis estructural i de necessitats d’usuari, capacitat de resposta). Es proposa un sistema d’operacions autònomes que atorga la capacitat de gestionar els sistemes de forma descentralitzada, a través del raonament local, l’assignació individual de recursos, i les interaccions satèl·lit-a-satèl·lit. Al contrari que treballs anteriors, la presa de decisions autònoma s’avalua per constel·lacions que tenen com a objectius de missió la minimització del temps de revisita global

In pursuit of autonomous distributed satellite systems

A la pàgina 265 diu: "In an effort to facilitate the reproduction of results, both the source code of the simulation environment and the configuration files that were prepared for the design characterisation are available in an open repository: https://github.com/carlesaraguz/aeossSatellite imagery has become an essential resource for environmental, humanitarian, and industrial endeavours. As a means to satisfy the requirements of new applications and user needs, novel Earth Observation (EO) systems are exploring the suitability of Distributed Satellite Systems (DSS) in which multiple observation assets concurrently sense the Earth. Given the temporal and spatial resolution requirements of EO products, DSS are often envisioned as large-scale systems with multiple sensing capabilities operating in a networked manner. Enabled by the consolidation of small satellite platforms and fostered by the emerging capabilities of distributed systems, these new architectures pose multiple design and operational challenges. Two of them are the main pillars of this research, namely, the conception of decision-support tools to assist the architecting process of a DSS, and the design of autonomous operational frameworks based on decentralised, on-board decision-making. The first part of this dissertation addresses the architecting of heterogeneous, networked DSS architectures that hybridise small satellite platforms with traditional EO assets. We present a generic design-oriented optimisation framework based on tradespace exploration methodologies. The goals of this framework are twofold: to select the most optimal constellation design; and to facilitate the identification of design trends, unfeasible regions, and tensions among architectural attributes. Oftentimes in EO DSS, system requirements and stakeholder preferences are not only articulated through functional attributes (i.e. resolution, revisit time, etc.) or monetary constraints, but also through qualitative traits such as flexibility, evolvability, robustness, or resiliency, amongst others. In line with that, the architecting framework defines a single figure of merit that aggregates quantitative attributes and qualitative ones-the so-called ilities of a system. With that, designers can steer the design of DSS both in terms of performance or cost, and in terms of their high-level characteristics. The application of this optimisation framework has been illustrated in two timely use-cases identified in the context of the EU-funded ONION project: a system that measures ocean and ice parameters in Polar regions to facilitate weather forecast and off-shore operations; and a system that provides agricultural variables crucial for global management of water stress, crop state, and draughts. The analysis of architectural features facilitated a comprehensive understanding of the functional and operational characteristics of DSS. With that, this thesis continues to delve into the design of DSS by focusing on one particular functional trait: autonomy. The minimisation of human-operator intervention has been traditionally sought in other space systems and can be especially critical for large-scale, structurally dynamic, heterogeneous DSS. In DSS, autonomy is expected to cope with the likely inability to operate very large-scale systems in a centralised manner, to improve the science return, and to leverage many of their emerging capabilities (e.g. tolerance to failures, adaptability to changing structures and user needs, responsiveness). We propose an autonomous operational framework that provides decentralised decision-making capabilities to DSS by means of local reasoning and individual resource allocation, and satellite-to-satellite interactions. In contrast to previous works, the autonomous decision-making framework is evaluated in this dissertation for generic constellation designs the goal of which is to minimise global revisit times. As part of the characterisation of our solution, we stressed the implications that autonomous operations can have upon satellite platforms with stringent resource constraints (e.g. power, memory, communications capabilities) and evaluated the behaviour of the solution for a large-scale DSS composed of 117 CubeSat-like satellite units.La imatgeria per satèl·lit ha esdevingut un recurs essencial per assolir tasques ambientals, humanitàries o industrials. Per tal de satisfer els requeriments de les noves aplicacions i usuaris, els sistemes d’observació de la Terra (OT) estan explorant la idoneïtat dels Sistemes de Satèl·lit Distribuïts (SSD), on múltiples observatoris espacials mesuren el planeta simultàniament. Degut al les resolucions temporals i espacials requerides, els SSD sovint es conceben com sistemes de gran escala que operen en xarxa. Aquestes noves arquitectures promouen les capacitats emergents dels sistemes distribuïts i, tot i que són possibles gràcies a l’acceptació de les plataformes de satèl·lits petits, encara presenten molts reptes en quant al disseny i operacions. Dos d’ells són els pilars principals d’aquesta tesi, en concret, la concepció d’eines de suport a la presa de decisions pel disseny de SSD, i la definició d’operacions autònomes basades en gestió descentralitzada a bord dels satèl·lits. La primera part d’aquesta dissertació es centra en el disseny arquitectural de SSD heterogenis i en xarxa, imbricant tecnologies de petits satèl·lits amb actius tradicionals. Es presenta un entorn d’optimització orientat al disseny basat en metodologies d’exploració i comparació de solucions. Els objectius d’aquest entorn són: la selecció el disseny de constel·lació més òptim; i facilitar la identificació de tendències de disseny, regions d’incompatibilitat, i tensions entre atributs arquitecturals. Sovint en els SSD d’OT, els requeriments del sistema i l’expressió de prioritats no només s’articulen en quant als atributs funcionals o les restriccions monetàries, sinó també a través de les característiques qualitatives com la flexibilitat, l’evolucionabilitat, la robustesa, o la resiliència, entre d’altres. En línia amb això, l’entorn d’optimització defineix una única figura de mèrit que agrega rendiment, cost i atributs qualitatius. Així l’equip de disseny pot influir en les solucions del procés d’optimització tant en els aspectes quantitatius, com en les característiques dalt nivell. L’aplicació d’aquest entorn d’optimització s’il·lustra en dos casos d’ús actuals identificats en context del projecte europeu ONION: un sistema que mesura paràmetres de l’oceà i gel als pols per millorar la predicció meteorològica i les operacions marines; i un sistema que obté mesures agronòmiques vitals per la gestió global de l’aigua, l’estimació d’estat dels cultius, i la gestió de sequeres. L’anàlisi de propietats arquitecturals ha permès copsar de manera exhaustiva les característiques funcionals i operacionals d’aquests sistemes. Amb això, la tesi ha seguit aprofundint en el disseny de SSD centrant-se, particularment, en un tret funcional: l’autonomia. Minimitzar la intervenció de l’operador humà és comú en altres sistemes espacials i podria ser especialment crític pels SSD de gran escala, d’estructura dinàmica i heterogenis. En els SSD s’espera que l’autonomia solucioni la possible incapacitat d’operar sistemes de gran escala de forma centralitzada, que millori el retorn científic i que n’apuntali les seves propietats emergents (e.g. tolerància a errors, adaptabilitat a canvis estructural i de necessitats d’usuari, capacitat de resposta). Es proposa un sistema d’operacions autònomes que atorga la capacitat de gestionar els sistemes de forma descentralitzada, a través del raonament local, l’assignació individual de recursos, i les interaccions satèl·lit-a-satèl·lit. Al contrari que treballs anteriors, la presa de decisions autònoma s’avalua per constel·lacions que tenen com a objectius de missió la minimització del temps de revisita global.Postprint (published version

Fifth Conference on Artificial Intelligence for Space Applications

The Fifth Conference on Artificial Intelligence for Space Applications brings together diverse technical and scientific work in order to help those who employ AI methods in space applications to identify common goals and to address issues of general interest in the AI community. Topics include the following: automation for Space Station; intelligent control, testing, and fault diagnosis; robotics and vision; planning and scheduling; simulation, modeling, and tutoring; development tools and automatic programming; knowledge representation and acquisition; and knowledge base/data base integration

Model-based Fault Diagnosis and Fault Accommodation for Space Missions : Application to the Rendezvous Phase of the MSR Mission

The work addressed in this thesis draws expertise from actions undertaken between the EuropeanSpace Agency (ESA), the industry Thales Alenia Space (TAS) and the IMS laboratory (laboratoirede l’Intégration du Matériau au Système) which develop new generations of integrated Guidance, Navigationand Control (GNC) units with fault detection and tolerance capabilities. The reference mission isthe ESA’s Mars Sample Return (MSR) mission. The presented work focuses on the terminal rendezvoussequence of the MSR mission which corresponds to the last few hundred meters until the capture. Thechaser vehicle is the MSR Orbiter, while the passive target is a diameter spherical container. The objectiveat control level is a capture achievement with an accuracy better than a few centimeter. The research workaddressed in this thesis is concerned by the development of model-based Fault Detection and Isolation(FDI) and Fault Tolerant Control (FTC) approaches that could significantly increase the operational andfunctional autonomy of the chaser during rendezvous, and more generally, of spacecraft involved in deepspace missions. Since redundancy exist in the sensors and since the reaction wheels are not used duringthe rendezvous phase, the work presented in this thesis focuses only on the thruster-based propulsionsystem. The investigated faults have been defined in accordance with ESA and TAS requirements andfollowing their experiences. The presented FDI/FTC approaches relies on hardware redundancy in sensors,control redirection and control re-allocation methods and a hierarchical FDI including signal-basedapproaches at sensor level, model-based approaches for thruster fault detection/isolation and trajectorysafety monitoring. Carefully selected performance and reliability indices together with Monte Carlo simulationcampaigns, using a high-fidelity industrial simulator, demonstrate the viability of the proposedapproaches.Les travaux de recherche traités dans cette thèse s’appuient sur l’expertise des actionsmenées entre l’Agence spatiale européenne (ESA), l’industrie Thales Alenia Space (TAS) et le laboratoirede l’Intégration du Matériau au Système (IMS) qui développent de nouvelles générations d’unités intégréesde guidage, navigation et pilotage (GNC) avec une fonction de détection des défauts et de tolérance desdéfauts. La mission de référence retenue dans cette thèse est la mission de retour d’échantillons martiens(Mars Sample Return, MSR) de l’ESA. Ce travail se concentre sur la séquence terminale du rendez-vous dela mission MSR qui correspond aux dernières centaines de mètres jusqu’à la capture. Le véhicule chasseurest l’orbiteur MSR (chasseur), alors que la cible passive est un conteneur sphérique. L’objectif au niveaude contrôle est de réaliser la capture avec une précision inférieure à quelques centimètres. Les travaux derecherche traités dans cette thèse s’intéressent au développement des approches sur base de modèle de détectionet d’isolation des défauts (FDI) et de commande tolérante aux défaillances (FTC), qui pourraientaugmenter d’une manière significative l’autonomie opérationnelle et fonctionnelle du chasseur pendant lerendez-vous et, d’une manière plus générale, d’un vaisseau spatial impliqué dans des missions située dansl’espace lointain. Dès lors que la redondance existe dans les capteurs et que les roues de réaction ne sontpas utilisées durant la phase de rendez-vous, le travail présenté dans cette thèse est orienté seulementvers les systèmes de propulsion par tuyères. Les défaillances examinées ont été définies conformément auxexigences de l’ESA et de TAS et suivant leurs expériences. Les approches FDI/FTC présentées s’appuientsur la redondance de capteurs, la redirection de contrôle et sur les méthodes de réallocation de contrôle,ainsi que le FDI hiérarchique, y compris les approches à base de signaux au niveau de capteurs, les approchesà base de modèle de détection/localisation de défauts de propulseur et la surveillance de sécuritéde trajectoire. Utilisant un simulateur industriel de haute-fidélité, les indices de performance et de fiabilitéFDI, qui ont été soigneusement choisis accompagnés des campagnes de simulation de robustesse/sensibilitéMonte Carlo, démontrent la viabilité des approches proposées

Model predictive control system design and implementation for spacecraft rendezvous

This paper presents the design and implementation of a model predictive control (MPC) system to guide and control a chasing spacecraft during rendezvous with a passive target spacecraft in an elliptical or circular orbit, from the point of target detection all the way to capture. To achieve an efficient system design, the rendezvous manoeuvre has been partitioned into three main phases based on the range of operation, plus a collision-avoidance manoeuvre to be used in event of a fault. Each has its own associated MPC controller. Linear time-varying models are used to enable trajectory predictions in elliptical orbits, whilst a variable prediction horizon is used to achieve finite-time completion of manoeuvres, and a 1-norm cost on velocity change minimises propellant consumption. Constraints are imposed to ensure that trajectories do not collide with the target. A key feature of the design is the implementation of non-convex constraints as switched convex constraints, enabling the use of convex linear and quadratic programming. The system is implemented using commercial-off-the-shelf tools with deployment using automatic code generation in mind, and validated by closed-loop simulation. A significant reduction in total propellant consumption in comparison with a baseline benchmark solution is observed

Undergraduate engineering and built environment project conference 2017: book of abstracts - Toowoomba, Australia, 18-22 September 2017

Book of Abstracts of the USQ Undergraduate Engineering and Built Environment Conference 2017, held Toowoomba, Australia, 18-22 September 2017. These proceedings include extended abstracts of the verbal presentations that are delivered at the project conference. The work reported at the conference is the research undertaken by students in meeting the requirements of courses ENG4111/ENG4112 Research Project