Computing fast search heuristics for physics-based mobile robot motion planning

Mobile robots are increasingly being employed to assist responders in search and rescue missions. Robots have to navigate in dangerous areas such as collapsed buildings and hazardous sites, which can be inaccessible to humans. Tele-operating the robots can be stressing for the human operators, which are also overloaded with mission tasks and coordination overhead, so it is important to provide the robot with some degree of autonomy, to lighten up the task for the human operator and also to ensure robot safety. Moving robots around requires reasoning, including interpretation of the environment, spatial reasoning, planning of actions (motion), and execution. This is particularly challenging when the environment is unstructured, and the terrain is \textit{harsh}, i.e. not flat and cluttered with obstacles. Approaches reducing the problem to a 2D path planning problem fall short, and many of those who reason about the problem in 3D don't do it in a complete and exhaustive manner. The approach proposed in this thesis is to use rigid body simulation to obtain a more truthful model of the reality, i.e. of the interaction between the robot and the environment. Such a simulation obeys the laws of physics, takes into account the geometry of the environment, the geometry of the robot, and any dynamic constraints that may be in place. The physics-based motion planning approach by itself is also highly intractable due to the computational load required to perform state propagation combined with the exponential blowup of planning; additionally, there are more technical limitations that disallow us to use things such as state sampling or state steering, which are known to be effective in solving the problem in simpler domains. The proposed solution to this problem is to compute heuristics that can bias the search towards the goal, so as to quickly converge towards the solution. With such a model, the search space is a rich space, which can only contain states which are physically reachable by the robot, and also tells us enough information about the safety of the robot itself. The overall result is that by using this framework the robot engineer has a simpler job of encoding the \textit{domain knowledge} which now consists only of providing the robot geometric model plus any constraints

Informed scenario-based RRT* for aircraft trajectory planning under ensemble forecasting of thunderstorms

Thunderstorms represent a major hazard for flights, as they compromise the safety of both the airframe and the passengers. To address trajectory planning under thunderstorms, three variants of the scenario-based rapidly exploring random trees (SB-RRTs) are proposed. During an iterative process, the so-called SB-RRT, the SB-RRT* and the Informed SB-RRT* find safe trajectories by meeting a user-defined safety threshold. Additionally, the last two techniques converge to solutions of minimum flight length. Through parallelization on graphical processing units the required computational times are reduced substantially to become compatible with near real-time operation. The proposed methods are tested considering a kinematic model of an aircraft flying between two waypoints at constant flight level and airspeed; the test scenario is based on a realistic weather forecast and assumed to be described by an ensemble of equally likely members. Lastly, the influence of the number of scenarios, safety margin and iterations on the results is analyzed. Results show that the SB-RRTs are able to find safe and, in two of the algorithms, closeto- optimum solutions.This work has received funding from (1) the Spanish Government (Project RTI2018-098471-B-C32) and (2) the SESAR Joint Undertaking under the European Union’s Horizon 2020 research and innovation programme under grant agreement No 783287

Aircraft Trajectory Planning Considering Ensemble Forecasting of Thunderstorms

Mención Internacional en el título de doctorConvective weather poses a major threat that compromises the safe operation of flights while inducing delay and cost. The aircraft trajectory planning problem under thunderstorm evolution is addressed in this thesis, proposing two novel heuristic approaches that incorporate uncertainties in the evolution of convective cells. In this context, two additional challenges are faced. On the one hand, studies have demonstrated that given the computational power available nowadays, the best way to characterize weather uncertainties is through ensemble forecasting products, hence compatibility with them is crucial. On the other hand, for the algorithms to be used during a flight, they must be fast and deliver results in a few seconds. As a first methodology, three variants of the Scenario-Based Rapidly-Exploring Random Trees (SB-RRTs) are proposed. Each of them builds a tree to explore the free airspace during an iterative and random process. The so-called SB-RRT, the SB-RRT∗ and the Informed SB-RRT∗ find point-to-point safe trajectories by meeting a user-defined safety threshold. Additionally, the last two techniques converge to solutions of minimum flight length. In a second instance, the Augmented Random Search (ARS) algorithm is used to sample trajectories from a directed graph and deform them iteratively in the search for an optimal path. The aim of such deformations is to adapt the initial graph to the unsafe set and its possible changes. In the end, the ARS determines the population of trajectories that, on average, minimizes a combination of flight time, time in storms, and fuel consumption Both methodologies are tested considering a dynamic model of an aircraft flying between two waypoints at a constant flight level. Test scenarios consist of realistic weather forecasts described by an ensemble of equiprobable members. Moreover, the influence of relevant parameters, such as the maximum number of iterations, safety margin (in SB-RRTs) or relative weights between objectives (in ARS) is analyzed. Since both algorithms and their convergence processes are random, sensitivity analyses are conducted to show that after enough iterations the results match. Finally, through parallelization on graphical processing units, the required computational times are reduced substantially to become compatible with near real-time operation. In either case, results show that the suggested approaches are able to avoid dangerous and uncertain stormy regions, minimize objectives such as time of flight, flown distance or fuel consumption and operate in less than 10 seconds.Los fenómenos convectivos representan una gran amenaza que compromete la seguridad de los vuelos, a la vez que incrementa los retrasos y costes. En esta tesis se aborda el problema de la planificación de vuelos bajo la influencia de tormentas, proponiendo dos nuevos métodos heurísticos que incorporan incertidumbre en la evolución de las células convectivas. En este contexto, se intentará dar respuesta a dos desafíos adicionales. Por un lado, hay estudios que demuestran que, con los recursos computacionales disponibles hoy en día, la mejor manera de caracterizar la incertidumbre meteorológica es mediante productos de tipo “ensemble”. Por tanto, la compatibilidad con ellos es crucial. Por otro lado, para poder emplear los algoritmos durante el vuelo, deben de ser rápidos y obtener resultados en pocos segundos. Como primera aproximación, se proponen tres variantes de los “Scenario-Based Rapidly-Exploring Random Trees” (SB-RRTs). Cada uno de ellos crea un árbol que explora el espacio seguro durante un proceso iterativo y aleatorio. Los denominados SB-RRT, SB-RRT∗ e Informed SB-RRT∗ calculan trayectorias entre dos puntos respetando un margen de seguridad impuesto por el usuario. Además, los dos últimos métodos convergen en soluciones de mínima distancia de vuelo. En segundo lugar, el algoritmo “Augmented Random Search” (ARS) se utiliza para muestrear trajectorias de un grafo dirigido y deformarlas iterativamente en busca del camino óptimo. El fin de tales deformaciones es adaptar el grafo inicial a las zonas peligrosas y a los cambios que puedan sufrir. Finalmente, el ARS calcula aquella población de trayectorias que, de media, minimiza una combinación del tiempo de vuelo, el tiempo en zonas tormentosas y el consumo de combustible. Ambas metodologías se testean considerando un modelo de avión volando punto a punto a altitud constante. Los casos de prueba se basan en datos meteorológicos realistas formados por un grupo de predicciones equiprobables. Además, se analiza la influencia de los parámetros más importantes como el máximo número de iteraciones, el margen de seguridad (en SB-RRTs) o los pesos relativos de cada objetivo (en ARS). Como ambos algoritmos y sus procesos de convergencia son aleatorios, se realizan análisis de sensibilidad para mostrar que, tras suficientes iteraciones, los resultados coinciden. Por último, mediante técnicas de paralelización en procesadores gráficos, se reducen enormemente los tiempos de cálculo, siendo compatibles con una operación en tiempo casi-real. En ambos casos los resultados muestran que los algoritmos son capaces de evitar zonas inciertas de tormenta, minimizar objetivos como el tiempo de vuelo, la distancia recorrida o el consumo de combustible, en menos de 10 segundos de ejecución.Programa de Doctorado en Ingeniería Aeroespacial por la Universidad Carlos III de MadridPresidente: Ernesto Staffetti Giammaria.- Secretario: Alfonso Valenzuela Romero.- Vocal: Valentin Polishchu

Efficient Motion and Inspection Planning for Medical Robots with Theoretical Guarantees

Medical robots enable faster and safer patient care. Continuum medical robots (e.g., steerable needles) have great potential to accomplish procedures with less damage to patients compared to conventional instruments (e.g., reducing puncturing and cutting of tissues). Due to their complexity and degrees of freedom, such robots are often harder and less intuitive for physicians to operate directly. Automating robot-assisted medical procedures can enable physicians and patients to harness the full potential of medical robots in terms of safety, efficiency, accuracy, and precision.Motion planning methods compute motions for a robot that satisfy various constraints and accomplish a specific task, e.g., plan motions for a mobile robot to move to a target spot while avoiding obstacles. Inspection planning is the task of planning motions for a robot to inspect a set of points of interest, and it has applications in domains such as industrial, field, and medical robotics. With motion and inspection planning, medical robots would be able to automatically accomplish tasks like biopsy and endoscopy while minimizing safety risks and damage to the patient. Computing a motion or inspection plan can be computationally hard since we have to consider application-specific constraints, which come from the robotic system due to the mechanical properties of the robot or come from the environment, such as the requirement to avoid critical anatomical structures during the procedure.I develop motion and inspection planning algorithms that focus on efficiency and effectiveness. Given the same computing power, higher efficiency would shorten the procedure time, thus reducing costs and improving patient outcomes. Additionally, for the automation of medical procedures to be clinically accepted, it is critical from a patient care, safety, and regulatory perspective to certify the correctness and effectiveness of the algorithms involved in procedure automation. Therefore, I focus on providing theoretical guarantees to certify the performance of planners. More specifically, it is important to certify if a planner is able to find a plan if one exists (i.e., completeness) and if a planner is able to find a globally optimal plan according to a given metric (i.e., optimality).Doctor of Philosoph

Generation of whole-body motion for humanoid robots with the complete dynamics

Cette thèse propose une solution au problème de la génération de mouvements pour les robots humanoïdes. Le cadre qui est proposé dans cette thèse génère des mouvements corps-complet en utilisant la dynamique inverse avec l'espace des tâches et en satisfaisant toutes les contraintes de contact. La spécification des mouvements se fait à travers objectifs dans l'espace des tâches et la grande redondance du système est gérée avec une pile de tâches où les tâches moins prioritaires sont atteintes seulement si elles n'interfèrent pas avec celles de plus haute priorité. À cette fin, un QP hiérarchique est utilisé, avec l'avantage d'être en mesure de préciser tâches d'égalité ou d'inégalité à tous les niveaux de la hiérarchie. La capacité de traiter plusieurs contacts non-coplanaires est montrée par des mouvements où le robot s'assoit sur une chaise et monte une échelle. Le cadre générique de génération de mouvements est ensuite appliqué à des études de cas à l'aide de HRP-2 et Romeo. Les mouvements complexes et similaires à l'humain sont obtenus en utilisant l'imitation du mouvement humain où le mouvement acquis passe par un processus cinématique et dynamique. Pour faire face à la nature instantanée de la dynamique inverse, un générateur de cycle de marche est utilisé comme entrée pour la pile de tâches qui effectue une correction locale de la position des pieds sur la base des points de contact permettant de marcher sur un terrain accidenté. La vision stéréo est également introduite pour aider dans le processus de marche. Pour une récupération rapide d'équilibre, le capture point est utilisé comme une tâche contrôlée dans une région désirée de l'espace. En outre, la génération de mouvements est présentée pour CHIMP, qui a besoin d'un traitement particulier.This thesis aims at providing a solution to the problem of motion generation for humanoid robots. The proposed framework generates whole-body motion using the complete robot dynamics in the task space satisfying contact constraints. This approach is known as operational-space inverse-dynamics control. The specification of the movements is done through objectives in the task space, and the high redundancy of the system is handled with a prioritized stack of tasks where lower priority tasks are only achieved if they do not interfere with higher priority ones. To this end, a hierarchical quadratic program is used, with the advantage of being able to specify tasks as equalities or inequalities at any level of the hierarchy. Motions where the robot sits down in an armchair and climbs a ladder show the capability to handle multiple non-coplanar contacts. The generic motion generation framework is then applied to some case studies using HRP-2 and Romeo. Complex and human-like movements are achieved using human motion imitation where the acquired motion passes through a kinematic and then dynamic retargeting processes. To deal with the instantaneous nature of inverse dynamics, a walking pattern generator is used as an input for the stack of tasks which makes a local correction of the feet position based on the contact points allowing to walk on non-planar surfaces. Visual feedback is also introduced to aid in the walking process. Alternatively, for a fast balance recovery, the capture point is introduced in the framework as a task and it is controlled within a desired region of space. Also, motion generation is presented for CHIMP which is a robot that needs a particular treatment