Safe Spacecraft Rendezvous and Proximity Operations via Reachability Analysis

The rapid expansion of the utilization of space by nations and industry has presented new challenges and opportunities to operate efficiently and responsibly. Reachability analysis is the process of computing the set of states that can be reached given all admissible controls and can be a valuable component in an autonomous mission planning system if conducted efficiently. In the current research, reachability analysis is used with several relative motion models to show that all ranges of orbits can be computed in milliseconds, and that it is a feasible approach for on-board autonomous mission planning. Reachability analysis is then combined with an Artificial Potential Function (APF) derived guidance control law to conduct safe spacecraft rendezvous between a deputy in a Natural Motion Circumnavigation (NMC) relative orbit around a chief while avoiding obstacles. While the APF employed in this research requires improvements for trajectory computation, this research demonstrates the feasibility of combining reachability analysis with an APF for safe, on-board, autonomous mission planning

Reachability Verification Based Reliability Assessment for Deep Reinforcement Learning Controlled Robotics and Autonomous Systems

Deep Reinforcement Learning (DRL) has achieved impressive performance in robotics and autonomous systems (RASs). A key impediment to its deployment in real-life operations is the spuriously unsafe DRL policies--unexplored states may lead the agent to make wrong decisions that may cause hazards, especially in applications where end-to-end controllers of the RAS were trained by DRL. In this paper, we propose a novel quantitative reliability assessment framework for DRL-controlled RASs, leveraging verification evidence generated from formal reliability analysis of neural networks. A two-level verification framework is introduced to check the safety property with respect to inaccurate observations that are due to, e.g., environmental noises and state changes. Reachability verification tools are leveraged at the local level to generate safety evidence of trajectories, while at the global level, we quantify the overall reliability as an aggregated metric of local safety evidence, according to an operational profile. The effectiveness of the proposed verification framework is demonstrated and validated via experiments on real RASs.Comment: Submitted, under revie

Mind the gap: Robotic Mission Planning Meets Software Engineering

In the context of robotic software, the selection of an appropriate planner is one of the most crucial software engineering decisions. Robot planners aim at computing plans (i.e., blueprint of actions) to accomplish a complex mission. While many planners have been proposed in the robotics literature, they are usually evaluated on showcase examples, making hard to understand whether they can be effectively (re)used for realising complex missions, with heterogeneous robots, and in real-world scenarios. In this paper we propose ENFORCE, a framework which allows wrapping FM-based planners into comprehensive software engineering tools, and considers complex robotic missions. ENFORCE relies on (i) realistic maps (e.g, fire escape maps) that describe the environment in which the robots are deployed; (ii) temporal logic for mission specification; and (iii) Uppaal model checker to compute plans that satisfy mission specifications. We evaluated ENFORCE by analyzing how it supports computing plans in real case scenarios, and by evaluating the generated plans in simulated and real environments. The results show that while ENFORCE is adequate for handling single-robot applications, the state explosion still represents a major barrier for reusing existing planners in multi-robot applications

Development of a Reachability Analysis Algorithm for Space Applications

In the last decades developments in space technology paved the way to more challenging missions like asteroid mining, space tourism and human expansion into the Solar System. These missions require difficult tasks such as real-time capable guidance schemes for re-entry, landing on celestial bodies and implementation of large angle maneuvers for spacecraft. There is a need for an analysis tool to increase the robustness and success of these missions. Reachability analysis contributes to this requirement by obtaining the set of all achievable states for a dynamical system starting from an initial condition with given admissible control inputs of the system. In this study, an optimal control based reachability analysis algorithm is developed for evaluating the performance of the guidance and control methods for space missions considering the desired performance index. The developed method considers a soft-landing problem for a Moon mission as the case study, and attainable area of the lander as the performance index. The method computes feasible trajectories for the lunar lander between the point where the terminal landing maneuver starts and points that constitutes the candidate landing region. The candidate landing region is discretized by equidistant points on a two dimensional plane, i.e. in downrange and crossrange coordinates, and for each grid point a distance function is defined. This distance function acts as an objective function for a related optimal control problem (OCP). Each infinite dimensional OCP is transcribed into a finite dimensional Nonlinear Programming Problem (NLP) by using Pseudo-Spectral Methods (PSM). The NLPs are solved using available tools to obtain feasible trajectories and approximated reachable sets with information about the states of the dynamical system at the grid points. The proposed method approximates reachable sets of the lander with propellant-to-reach and time-to-reach cost by solution of NLPs. A polynomial-based Apollo guidance scheme is used to compare the results for the developed method. The coefficients that define the position of the lander are obtained by solving a series of explicit equations for the given initial and final states. A model inversion based PD controller is designed to track the generated trajectory. Feasible solutions that satisfy safe landing conditions are filtered and the results are compared for the two different approaches. Finally, the uncertainties which are characterized by initial state error and system parameters are also considered. A multivariate trajectory interpolation tool is used to interpolate RS with different initial states. A Riccati equation-based controller is designed to track the previously obtained reference trajectories within presence of the uncertainties. Monte Carlo (MC) simulations are carried out to obtain safe attainable landing area of the lunar lander as probability maps. The same uncertainty set is used to verify these probability maps by propagating the uncertainties using unscented transform. The developed tool analyzes the different guidance and control methods, for the attainable landing area of the lander, under various landing scenarios, with different dynamical models and controller parameters. Numerous quality metrics are used to compare the change of characteristics of the attainable landing area and performance of the guidance and control methods, and selected design parameters

AUTONOMOUS SPACECRAFT RENDEZVOUS WITH A TUMBLING OBJECT: APPLIED REACHABILITY ANALYSIS AND GUIDANCE AND CONTROL STRATEGIES

Rendezvous and proximity operations are an essential component of both military and commercial space missions and are rising in complexity. This dissertation presents an applied reachability analysis and develops a computationally feasible autonomous guidance algorithm for the purpose of spacecraft rendezvous and proximity maneuvers around a tumbling object. Recent advancements enable the use of more sophisticated, computation-based algorithms, instead of traditional control methods. These algorithms are desirable for autonomous applications due to their ability to optimize performance and explicitly handle constraints (e.g., safety, control limits). In an autonomous setting, however, some important questions must be answered before an algorithm implementation can be realized. First, the feasibility of a maneuver is addressed by analyzing the fundamental spacecraft relative dynamics. Particularly, a set of initial relative states is computed and visualized from which the desired rendezvous state can be reached (i.e., backward reachability analysis). Second, with the knowledge that a maneuver is feasible, the Model Predictive Control (MPC) framework is utilized to design a stabilizing feedback control law that optimizes performance and incorporates constraints such as control saturation limits and collision avoidance. The MPC algorithm offers a computationally efficient guidance strategy that could potentially be implemented in real-time on-board a spacecraft.http://archive.org/details/autonomousspacec1094560364Major, United States Air ForceApproved for public release; distribution is unlimited