Autonomous Navigation for Mars Exploration

The autonomous navigation technology uses the multiple sensors to percept and estimate the spatial locations of the aerospace prober or the Mars rover and to guide their motions in the orbit or the Mars surface. In this chapter, the autonomous navigation methods for the Mars exploration are reviewed. First, the current development status of the autonomous navigation technology is summarized. The popular autonomous navigation methods, such as the inertial navigation, the celestial navigation, the visual navigation, and the integrated navigation, are introduced. Second, the application of the autonomous navigation technology for the Mars exploration is presented. The corresponding issues in the Entry Descent and Landing (EDL) phase and the Mars surface roving phase are mainly discussed. Third, some challenges and development trends of the autonomous navigation technology are also addressed

Robust vision based slope estimation and rocks detection for autonomous space landers

As future robotic surface exploration missions to other planets, moons and asteroids become more ambitious in their science goals, there is a rapidly growing need to significantly enhance the capabilities of entry, descent and landing technology such that landings can be carried out with pin-point accuracy at previously inaccessible sites of high scientific value. As a consequence of the extreme uncertainty in touch-down locations of current missions and the absence of any effective hazard detection and avoidance capabilities, mission designers must exercise extreme caution when selecting candidate landing sites. The entire landing uncertainty footprint must be placed completely within a region of relatively flat and hazard free terrain in order to minimise the risk of mission ending damage to the spacecraft at touchdown. Consequently, vast numbers of scientifically rich landing sites must be rejected in favour of safer alternatives that may not offer the same level of scientific opportunity. The majority of truly scientifically interesting locations on planetary surfaces are rarely found in such hazard free and easily accessible locations, and so goals have been set for a number of advanced capabilities of future entry, descent and landing technology. Key amongst these is the ability to reliably detect and safely avoid all mission critical surface hazards in the area surrounding a pre-selected landing location. This thesis investigates techniques for the use of a single camera system as the primary sensor in the preliminary development of a hazard detection system that is capable of supporting pin-point landing operations for next generation robotic planetary landing craft. The requirements for such a system have been stated as the ability to detect slopes greater than 5 degrees and surface objects greater than 30cm in diameter. The primary contribution in this thesis, aimed at achieving these goals, is the development of a feature-based,self-initialising, fully adaptive structure from motion (SFM) algorithm based on a robust square-root unscented Kalman filtering framework and the fusion of the resulting SFM scene structure estimates with a sophisticated shape from shading (SFS) algorithm that has the potential to produce very dense and highly accurate digital elevation models (DEMs) that possess sufficient resolution to achieve the sensing accuracy required by next generation landers. Such a system is capable of adapting to potential changes in the external noise environment that may result from intermittent and varying rocket motor thrust and/or sudden turbulence during descent, which may translate to variations in the vibrations experienced by the platform and introduce varying levels of motion blur that will affect the accuracy of image feature tracking algorithms. Accurate scene structure estimates have been obtained using this system from both real and synthetic descent imagery, allowing for the production of accurate DEMs. While some further work would be required in order to produce DEMs that possess the resolution and accuracy needed to determine slopes and the presence of small objects such as rocks at the levels of accuracy required, this thesis presents a very strong foundation upon which to build and goes a long way towards developing a highly robust and accurate solution

Tracking Meteoroids in the Atmosphere: Fireball Trajectory Analysis

This thesis improves and develops algorithms for fireball trajectory analysis. Stochastic estimators outside the current field of fireball modelling have been applied, from Kalman filters to 3D particle filters. These techniques are fully automated and rigorously incorporate errors, providing a means to routinely analyse fireball data in an unbiased manner

Navigation Requirements Development and Performance Assessment of a Martian Ascent Vehicle

To support development of Martian Ascent Vehicles, analysis tools are needed to support the development of Guidance, Navigation, and Control requirements. This paper presents a focused approach to Navigation analysis to capture development of requirements on initial state knowledge and inertial sensor capabilities. A simulation and analysis framework was used to assess the capability of a range of sensors to operate inertially along a range of launch trajectories. The baseline Martian Ascent Vehicle was used as the input for optimizing a set of trajectories from each launch site. These trajectories were used to perform Monte Carlo analysis dispersing error sensor terms and their effects on integrated vehicle performance. Additionally, this paper provides insight into the use of optical navigation techniques to assess state determination and the potential to use observations of local extraplanetary bodies to estimate state. This paper provides an initial level of performance assessment of navigation components to support continued requirements development of a Martian Ascent Vehicle with applications to both crew and sample return missions

Reverse-Tangent Injection in a Centrifugal Compressor

Injection of working fluid into a centrifugal compressor in the reverse tangent direction has been invented as a way of preventing flow instabilities (stall and surge) or restoring stability when stall or surge has already commenced. The invention applies, in particular, to a centrifugal compressor, the diffuser of which contains vanes that divide the flow into channels oriented partly radially and partly tangentially. In reverse-tangent injection, a stream or jet of the working fluid (the fluid that is compressed) is injected into the vaneless annular region between the blades of the impeller and the vanes of the diffuser. As used here, "reverse" signifies that the injected flow opposes (and thereby reduces) the tangential component of the velocity of the impeller discharge. At the same time, the injected jet acts to increase the radial component of the velocity of the impeller discharge

Kalman Filter Tuning with Bayesian Optimization

Many state estimation algorithms must be tuned given the state space process and observation models, the process and observation noise parameters must be chosen. Conventional tuning approaches rely on heuristic hand-tuning or gradient-based optimization techniques to minimize a performance cost function. However, the relationship between tuned noise values and estimator performance is highly nonlinear and stochastic. Therefore, the tuning solutions can easily get trapped in local minima, which can lead to poor choices of noise parameters and suboptimal estimator performance. This paper describes how Bayesian Optimization (BO) can overcome these issues. BO poses optimization as a Bayesian search problem for a stochastic ``black box'' cost function, where the goal is to search the solution space to maximize the probability of improving the current best solution. As such, BO offers a principled approach to optimization-based estimator tuning in the presence of local minima and performance stochasticity. While extended Kalman filters (EKFs) are the main focus of this work, BO can be similarly used to tune other related state space filters. The method presented here uses performance metrics derived from normalized innovation squared (NIS) filter residuals obtained via sensor data, which renders knowledge of ground-truth states unnecessary. The robustness, accuracy, and reliability of BO-based tuning is illustrated on practical nonlinear state estimation problems,losed-loop aero-robotic control

Model Predictive Control Applications to Spacecraft Rendezvous and Small Bodies Exploration

The overarching goal of this thesis is the design of model predictive control algorithms for spacecraft proximity operations. These include, but it is not limited to, spacecraft rendezvous, hovering phases or orbiting in the vicinity of small bodies. The main motivation behind this research is the increasing demand of autonomy, understood as the spacecraft capability to compute its own control plan, in current and future space operations. This push for autonomy is fostered by the recent introduction of disruptive technologies changing the traditional concept of space exploration and exploitation. The development of miniaturized satellite platforms and the drastic cost reduction in orbital access have boosted space activity to record levels. In the near future, it is envisioned that numerous artificial objects will simultaneously operate across the Solar System. In that context, human operators will be overwhelmed in the task of tracking and commanding each spacecraft in real time. As a consequence, developing intelligent and robust autonomous systems has been identified by several space agencies as a cornerstone technology. Inspired by the previous facts, this work presents novel controllers to tackle several scenarios related to spacecraft proximity operations. Mastering proximity operations enables a wide variety of space missions such as active debris removal, astronauts transportation, flight-formation applications, space stations resupply and the in-situ exploration of small bodies. Future applications may also include satellite inspection and servicing. This thesis has focused on four scenarios: six-degrees of freedom spacecraft rendezvous; near-rectilinear halo orbits rendezvous; the hovering phase; orbit-attitude station-keeping in the vicinity of a small body. The first problem aims to demonstrate rendezvous capabilities for a lightweight satellite with few thrusters and a reaction wheels array. For near-rectilinear halo orbits rendezvous, the goal is to achieve higher levels of constraints satisfaction than with a stateof- the-art predictive controller. In the hovering phase, the objective is to augment the control accuracy and computational efficiency of a recent global stable controller. The small body exploration aims to demonstrate the positive impact of model-learning in the control accuracy. Although based on model predictive control, the specific approach for each scenario differs. In six-degrees of freedom rendezvous, the attitude flatness property and the transition matrix for Keplerian-based relative are used to obtain a non-linear program. Then, the control loop is closed by linearizing the system around the previous solution. For near-rectilinear halo orbits rendezvous, the constraints are assured to be satisfied in the probabilistic sense by a chance-constrained approach. The disturbances statistical properties are estimated on-line. For the hovering phase problem, an aperiodic event-based predictive controller is designed. It uses a set of trigger rules, defined using reachability concepts, deciding when to execute a single-impulse control. In the small body exploration scenario, a novel learning-based model predictive controller is developed. This works by integrating unscented Kalman filtering and model predictive control. By doing so, the initially unknown small body inhomogeneous gravity field is estimated over time which augments the model predictive control accuracy.El objeto de esta tesis es el dise˜no de algoritmos de control predictivo basado en modelo para operaciones de veh´ıculos espaciales en proximidad. Esto incluye, pero no se limita, a la maniobra de rendezvous, las fases de hovering u orbitar alrededor de cuerpos menores. Esta tesis est´a motivada por la creciente demanda en la autonom´ıa, entendida como la capacidad de un veh´ıculo para calcular su propio plan de control, de las actuales y futuras misiones espaciales. Este inter´es en incrementar la autonom´ıa est´a relacionado con las actuales tecnolog´ıas disruptivas que est´an cambiando el concepto tradicional de exploraci´on y explotaci´on espacial. Estas son el desarrollo de plataformas satelitales miniaturizadas y la dr´astica reducci´on de los costes de puesta en ´orbita. Dichas tecnolog´ıas han impulsado la actividad espacial a niveles de record. En un futuro cercano, se prev´e que un gran n´umero de objetos artificiales operen de manera simult´anea a lo largo del Sistema Solar. Bajo dicho escenario, los operadores terrestres se ver´an desbordados en la tarea de monitorizar y controlar cada sat´elite en tiempo real. Es por ello que el desarrollo de sistemas aut´onomos inteligentes y robustos es considerado una tecnolog´ıa fundamental por diversas agencias espaciales. Debido a lo anterior, este trabajo presenta nuevos resultados en el control de operaciones de veh´ıculos espaciales en proximidad. Dominar dichas operaciones permite llevar a cabo una gran variedad de misiones espaciales como la retirada de basura espacial, transferir astronautas, aplicaciones de vuelo en formaci´on, reabastecer estaciones espaciales y la exploraci ´on de cuerpos menores. Futuras aplicaciones podr´ıan incluir operaciones de inspecci´on y mantenimiento de sat´elites. Esta tesis se centra en cuatro escenarios: rendezvous de sat´elites con seis grados de libertad; rendezvous en ´orbitas halo cuasi-rectil´ıneas; la fase de hovering; el mantenimiento de ´orbita y actitud en las inmendiaciones de un cuerpo menor. El primer caso trata de proveer capacidades de rendezvous para un sat´elite ligero con pocos propulsores y un conjunto de ruedas de reacci´on. Para el rendezvous en ´orbitas halo cuasi-rectil´ıneas, se intenta aumentar el grado de cumplimiento de restricciones con respecto a un controlador predictivo actual. Para la fase de hovering, se mejora la precisi´on y eficiencia computacional de un controlador globalmente estable. En la exploraci´on de un cuerpo menor, se pretende demostrar el mayor grado de precisi´on que se obtiene al aprender el modelo. Siendo la base el control predictivo basado en modelo, el enfoque espec´ıfico difiere para cada escenario. En el rendezvous con seis grados de libertad, se obtiene un programa no-lineal con el uso de la propiedad flatness de la actitud y la matriz de transici´on del movimiento relativo Kepleriano. El bucle de control se cierra linealizando en torno a la soluci´on anterior. Para el rendezvous en ´orbitas halo cuasi-rectil´ıneas, el cumplimiento de restricciones se garantiza probabil´ısticamente mediante la t´ecnica chance-constrained. Las propiedades estad´ısticas de las perturbaciones son estimadas on-line. En la fase de hovering, se usa el control predictivo basado en eventos. Ello consiste en unas reglas de activaci´on, definidas con conceptos de accesibilidad, que deciden la ejecuci´on de un ´unico impulso de control. En la exploraci´on de cuerpos menores, se desarrolla un controlador predictivo basado en el aprendizaje del modelo. Funciona integrando un filtro de Kalman con control predictivo basado en modelo. Con ello, se consigue estimar las inomogeneidades del campo gravitario lo que repercute en una mayor precisi´on del controlador predictivo basado en modelo

Model-based Fault Diagnosis and Fault Accommodation for Space Missions : Application to the Rendezvous Phase of the MSR Mission

The work addressed in this thesis draws expertise from actions undertaken between the EuropeanSpace Agency (ESA), the industry Thales Alenia Space (TAS) and the IMS laboratory (laboratoirede l’Intégration du Matériau au Système) which develop new generations of integrated Guidance, Navigationand Control (GNC) units with fault detection and tolerance capabilities. The reference mission isthe ESA’s Mars Sample Return (MSR) mission. The presented work focuses on the terminal rendezvoussequence of the MSR mission which corresponds to the last few hundred meters until the capture. Thechaser vehicle is the MSR Orbiter, while the passive target is a diameter spherical container. The objectiveat control level is a capture achievement with an accuracy better than a few centimeter. The research workaddressed in this thesis is concerned by the development of model-based Fault Detection and Isolation(FDI) and Fault Tolerant Control (FTC) approaches that could significantly increase the operational andfunctional autonomy of the chaser during rendezvous, and more generally, of spacecraft involved in deepspace missions. Since redundancy exist in the sensors and since the reaction wheels are not used duringthe rendezvous phase, the work presented in this thesis focuses only on the thruster-based propulsionsystem. The investigated faults have been defined in accordance with ESA and TAS requirements andfollowing their experiences. The presented FDI/FTC approaches relies on hardware redundancy in sensors,control redirection and control re-allocation methods and a hierarchical FDI including signal-basedapproaches at sensor level, model-based approaches for thruster fault detection/isolation and trajectorysafety monitoring. Carefully selected performance and reliability indices together with Monte Carlo simulationcampaigns, using a high-fidelity industrial simulator, demonstrate the viability of the proposedapproaches.Les travaux de recherche traités dans cette thèse s’appuient sur l’expertise des actionsmenées entre l’Agence spatiale européenne (ESA), l’industrie Thales Alenia Space (TAS) et le laboratoirede l’Intégration du Matériau au Système (IMS) qui développent de nouvelles générations d’unités intégréesde guidage, navigation et pilotage (GNC) avec une fonction de détection des défauts et de tolérance desdéfauts. La mission de référence retenue dans cette thèse est la mission de retour d’échantillons martiens(Mars Sample Return, MSR) de l’ESA. Ce travail se concentre sur la séquence terminale du rendez-vous dela mission MSR qui correspond aux dernières centaines de mètres jusqu’à la capture. Le véhicule chasseurest l’orbiteur MSR (chasseur), alors que la cible passive est un conteneur sphérique. L’objectif au niveaude contrôle est de réaliser la capture avec une précision inférieure à quelques centimètres. Les travaux derecherche traités dans cette thèse s’intéressent au développement des approches sur base de modèle de détectionet d’isolation des défauts (FDI) et de commande tolérante aux défaillances (FTC), qui pourraientaugmenter d’une manière significative l’autonomie opérationnelle et fonctionnelle du chasseur pendant lerendez-vous et, d’une manière plus générale, d’un vaisseau spatial impliqué dans des missions située dansl’espace lointain. Dès lors que la redondance existe dans les capteurs et que les roues de réaction ne sontpas utilisées durant la phase de rendez-vous, le travail présenté dans cette thèse est orienté seulementvers les systèmes de propulsion par tuyères. Les défaillances examinées ont été définies conformément auxexigences de l’ESA et de TAS et suivant leurs expériences. Les approches FDI/FTC présentées s’appuientsur la redondance de capteurs, la redirection de contrôle et sur les méthodes de réallocation de contrôle,ainsi que le FDI hiérarchique, y compris les approches à base de signaux au niveau de capteurs, les approchesà base de modèle de détection/localisation de défauts de propulseur et la surveillance de sécuritéde trajectoire. Utilisant un simulateur industriel de haute-fidélité, les indices de performance et de fiabilitéFDI, qui ont été soigneusement choisis accompagnés des campagnes de simulation de robustesse/sensibilitéMonte Carlo, démontrent la viabilité des approches proposées

A Comprehensive Introduction of Visual-Inertial Navigation

In this article, a tutorial introduction to visual-inertial navigation(VIN) is presented. Visual and inertial perception are two complementary sensing modalities. Cameras and inertial measurement units (IMU) are the corresponding sensors for these two modalities. The low cost and light weight of camera-IMU sensor combinations make them ubiquitous in robotic navigation. Visual-inertial Navigation is a state estimation problem, that estimates the ego-motion and local environment of the sensor platform. This paper presents visual-inertial navigation in the classical state estimation framework, first illustrating the estimation problem in terms of state variables and system models, including related quantities representations (Parameterizations), IMU dynamic and camera measurement models, and corresponding general probabilistic graphical models (Factor Graph). Secondly, we investigate the existing model-based estimation methodologies, these involve filter-based and optimization-based frameworks and related on-manifold operations. We also discuss the calibration of some relevant parameters, also initialization of state of interest in optimization-based frameworks. Then the evaluation and improvement of VIN in terms of accuracy, efficiency, and robustness are discussed. Finally, we briefly mention the recent development of learning-based methods that may become alternatives to traditional model-based methods.Comment: 35 pages, 10 figure

Autonomous vision-based terrain-relative navigation for planetary exploration

Abstract: The interest of major space agencies in the world for vision sensors in their mission designs has been increasing over the years. Indeed, cameras offer an efficient solution to address the ever-increasing requirements in performance. In addition, these sensors are multipurpose, lightweight, proven and a low-cost technology. Several researchers in vision sensing for space application currently focuse on the navigation system for autonomous pin-point planetary landing and for sample and return missions to small bodies. In fact, without a Global Positioning System (GPS) or radio beacon around celestial bodies, high-accuracy navigation around them is a complex task. Most of the navigation systems are based only on accurate initialization of the states and on the integration of the acceleration and the angular rate measurements from an Inertial Measurement Unit (IMU). This strategy can track very accurately sudden motions of short duration, but their estimate diverges in time and leads normally to high landing error. In order to improve navigation accuracy, many authors have proposed to fuse those IMU measurements with vision measurements using state estimators, such as Kalman filters. The first proposed vision-based navigation approach relies on feature tracking between sequences of images taken in real time during orbiting and/or landing operations. In that case, image features are image pixels that have a high probability of being recognized between images taken from different camera locations. By detecting and tracking these features through a sequence of images, the relative motion of the spacecraft can be determined. This technique, referred to as Terrain-Relative Relative Navigation (TRRN), relies on relatively simple, robust and well-developed image processing techniques. It allows the determination of the relative motion (velocity) of the spacecraft. Despite the fact that this technology has been demonstrated with space qualified hardware, its gain in accuracy remains limited since the spacecraft absolute position is not observable from the vision measurements. The vision-based navigation techniques currently studied consist in identifying features and in mapping them into an on-board cartographic database indexed by an absolute coordinate system, thereby providing absolute position determination. This technique, referred to as Terrain-Relative Absolute Navigation (TRAN), relies on very complex Image Processing Software (IPS) having an obvious lack of robustness. In fact, these software depend often on the spacecraft attitude and position, they are sensitive to illumination conditions (the elevation and azimuth of the Sun when the geo-referenced database is built must be similar to the ones present during mission), they are greatly influenced by the image noise and finally they hardly manage multiple varieties of terrain seen during the same mission (the spacecraft can fly over plain zone as well as mountainous regions, the images may contain old craters with noisy rims as well as young crater with clean rims and so on). At this moment, no real-time hardware-in-the-loop experiment has been conducted to demonstrate the applicability of this technology to space mission. The main objective of the current study is to develop autonomous vision-based navigation algorithms that provide absolute position and surface-relative velocity during the proximity operations of a planetary mission (orbiting phase and landing phase) using a combined approach of TRRN and TRAN technologies. The contributions of the study are: (1) reference mission definition, (2) advancements in the TRAN theory (image processing as well as state estimation) and (3) practical implementation of vision-based navigation.Résumé: L’intérêt des principales agences spatiales envers les technologies basées sur la vision artificielle ne cesse de croître. En effet, les caméras offrent une solution efficace pour répondre aux exigences de performance, toujours plus élevées, des missions spatiales. De surcroît, ces capteurs sont multi-usages, légers, éprouvés et peu coûteux. Plusieurs chercheurs dans le domaine de la vision artificielle se concentrent actuellement sur les systèmes autonomes pour l’atterrissage de précision sur des planètes et sur les missions d’échantillonnage sur des astéroïdes. En effet, sans système de positionnement global « Global Positioning System (GPS) » ou de balises radio autour de ces corps célestes, la navigation de précision est une tâche très complexe. La plupart des systèmes de navigation sont basés seulement sur l’intégration des mesures provenant d’une centrale inertielle. Cette stratégie peut être utilisée pour suivre les mouvements du véhicule spatial seulement sur une courte durée, car les données estimées divergent rapidement. Dans le but d’améliorer la précision de la navigation, plusieurs auteurs ont proposé de fusionner les mesures provenant de la centrale inertielle avec des mesures d’images du terrain. Les premiers algorithmes de navigation utilisant l’imagerie du terrain qui ont été proposés reposent sur l’extraction et le suivi de traits caractéristiques dans une séquence d’images prises en temps réel pendant les phases d’orbite et/ou d’atterrissage de la mission. Dans ce cas, les traits caractéristiques de l’image correspondent à des pixels ayant une forte probabilité d’être reconnus entre des images prises avec différentes positions de caméra. En détectant et en suivant ces traits caractéristiques, le déplacement relatif du véhicule (la vitesse) peut être déterminé. Ces techniques, nommées navigation relative, utilisent des algorithmes de traitement d’images robustes, faciles à implémenter et bien développés. Bien que cette technologie a été éprouvée sur du matériel de qualité spatiale, le gain en précision demeure limité étant donné que la position absolue du véhicule n’est pas observable dans les mesures extraites de l’image. Les techniques de navigation basées sur la vision artificielle actuellement étudiées consistent à identifier des traits caractéristiques dans l’image pour les apparier avec ceux contenus dans une base de données géo-référencées de manière à fournir une mesure de position absolue au filtre de navigation. Cependant, cette technique, nommée navigation absolue, implique l’utilisation d’algorithmes de traitement d’images très complexes souffrant pour le moment des problèmes de robustesse. En effet, ces algorithmes dépendent souvent de la position et de l’attitude du véhicule. Ils sont très sensibles aux conditions d’illuminations (l’élévation et l’azimut du Soleil présents lorsque la base de données géo-référencée est construite doit être similaire à ceux observés pendant la mission). Ils sont grandement influencés par le bruit dans l’image et enfin ils supportent mal les multiples variétés de terrain rencontrées pendant la même mission (le véhicule peut survoler autant des zones de plaine que des régions montagneuses, les images peuvent contenir des vieux cratères avec des contours flous aussi bien que des cratères jeunes avec des contours bien définis, etc.). De plus, actuellement, aucune expérimentation en temps réel et sur du matériel de qualité spatiale n’a été réalisée pour démontrer l’applicabilité de cette technologie pour les missions spatiales. Par conséquent, l’objectif principal de ce projet de recherche est de développer un système de navigation autonome par imagerie du terrain qui fournit la position absolue et la vitesse relative au terrain d’un véhicule spatial pendant les opérations à basse altitude sur une planète. Les contributions de ce travail sont : (1) la définition d’une mission de référence, (2) l’avancement de la théorie de la navigation par imagerie du terrain (algorithmes de traitement d’images et estimation d’états) et (3) implémentation pratique de cette technologie