Study of Control Strategies for Robot Ball Catching

La tesi riguarda lo studio di un possibile scenario per la cattura di una palla con un braccio robotico usando tecnologie disponibili e considerando due problemi principali: studiare differenti strategie di controllo per il braccio robotico al fine di catturare la palla (controllo predittivo e prospettivo); implementare un simulatore in ROS che simula il robot reale, includendo un sistema di visione per riconoscere e tracciare la palla usando il sensore Microsoft Kinect, con diverse simulazion

Visual guidance of unmanned aerial manipulators

The ability to fly has greatly expanded the possibilities for robots to perform surveillance, inspection or map generation tasks. Yet it was only in recent years that research in aerial robotics was mature enough to allow active interactions with the environment. The robots responsible for these interactions are called aerial manipulators and usually combine a multirotor platform and one or more robotic arms. The main objective of this thesis is to formalize the concept of aerial manipulator and present guidance methods, using visual information, to provide them with autonomous functionalities. A key competence to control an aerial manipulator is the ability to localize it in the environment. Traditionally, this localization has required external infrastructure of sensors (e.g., GPS or IR cameras), restricting the real applications. Furthermore, localization methods with on-board sensors, exported from other robotics fields such as simultaneous localization and mapping (SLAM), require large computational units becoming a handicap in vehicles where size, load, and power consumption are important restrictions. In this regard, this thesis proposes a method to estimate the state of the vehicle (i.e., position, orientation, velocity and acceleration) by means of on-board, low-cost, light-weight and high-rate sensors. With the physical complexity of these robots, it is required to use advanced control techniques during navigation. Thanks to their redundancy on degrees-of-freedom, they offer the possibility to accomplish not only with mobility requirements but with other tasks simultaneously and hierarchically, prioritizing them depending on their impact to the overall mission success. In this work we present such control laws and define a number of these tasks to drive the vehicle using visual information, guarantee the robot integrity during flight, and improve the platform stability or increase arm operability. The main contributions of this research work are threefold: (1) Present a localization technique to allow autonomous navigation, this method is specifically designed for aerial platforms with size, load and computational burden restrictions. (2) Obtain control commands to drive the vehicle using visual information (visual servo). (3) Integrate the visual servo commands into a hierarchical control law by exploiting the redundancy of the robot to accomplish secondary tasks during flight. These tasks are specific for aerial manipulators and they are also provided. All the techniques presented in this document have been validated throughout extensive experimentation with real robotic platforms.La capacitat de volar ha incrementat molt les possibilitats dels robots per a realitzar tasques de vigilància, inspecció o generació de mapes. Tot i això, no és fins fa pocs anys que la recerca en robòtica aèria ha estat prou madura com per començar a permetre interaccions amb l’entorn d’una manera activa. Els robots per a fer-ho s’anomenen manipuladors aeris i habitualment combinen una plataforma multirotor i un braç robòtic. L’objectiu d’aquesta tesi és formalitzar el concepte de manipulador aeri i presentar mètodes de guiatge, utilitzant informació visual, per dotar d’autonomia aquest tipus de vehicles. Una competència clau per controlar un manipulador aeri és la capacitat de localitzar-se en l’entorn. Tradicionalment aquesta localització ha requerit d’infraestructura sensorial externa (GPS, càmeres IR, etc.), limitant així les aplicacions reals. Pel contrari, sistemes de localització exportats d’altres camps de la robòtica basats en sensors a bord, com per exemple mètodes de localització i mapejat simultànis (SLAM), requereixen de gran capacitat de còmput, característica que penalitza molt en vehicles on la mida, pes i consum elèctric son grans restriccions. En aquest sentit, aquesta tesi proposa un mètode d’estimació d’estat del robot (posició, velocitat, orientació i acceleració) a partir de sensors instal·lats a bord, de baix cost, baix consum computacional i que proporcionen mesures a alta freqüència. Degut a la complexitat física d’aquests robots, és necessari l’ús de tècniques de control avançades. Gràcies a la seva redundància de graus de llibertat, aquests robots ens ofereixen la possibilitat de complir amb els requeriments de mobilitat i, simultàniament, realitzar tasques de manera jeràrquica, ordenant-les segons l’impacte en l’acompliment de la missió. En aquest treball es presenten aquestes lleis de control, juntament amb la descripció de tasques per tal de guiar visualment el vehicle, garantir la integritat del robot durant el vol, millorar de l’estabilitat del vehicle o augmentar la manipulabilitat del braç. Aquesta tesi es centra en tres aspectes fonamentals: (1) Presentar una tècnica de localització per dotar d’autonomia el robot. Aquest mètode està especialment dissenyat per a plataformes amb restriccions de capacitat computacional, mida i pes. (2) Obtenir les comandes de control necessàries per guiar el vehicle a partir d’informació visual. (3) Integrar aquestes accions dins una estructura de control jeràrquica utilitzant la redundància del robot per complir altres tasques durant el vol. Aquestes tasques son específiques per a manipuladors aeris i també es defineixen en aquest document. Totes les tècniques presentades en aquesta tesi han estat avaluades de manera experimental amb plataformes robòtiques real

Parallel Manipulators

In recent years, parallel kinematics mechanisms have attracted a lot of attention from the academic and industrial communities due to potential applications not only as robot manipulators but also as machine tools. Generally, the criteria used to compare the performance of traditional serial robots and parallel robots are the workspace, the ratio between the payload and the robot mass, accuracy, and dynamic behaviour. In addition to the reduced coupling effect between joints, parallel robots bring the benefits of much higher payload-robot mass ratios, superior accuracy and greater stiffness; qualities which lead to better dynamic performance. The main drawback with parallel robots is the relatively small workspace. A great deal of research on parallel robots has been carried out worldwide, and a large number of parallel mechanism systems have been built for various applications, such as remote handling, machine tools, medical robots, simulators, micro-robots, and humanoid robots. This book opens a window to exceptional research and development work on parallel mechanisms contributed by authors from around the world. Through this window the reader can get a good view of current parallel robot research and applications

An intelligent, free-flying robot

The ground based demonstration of the extensive extravehicular activity (EVA) Retriever, a voice-supervised, intelligent, free flying robot, is designed to evaluate the capability to retrieve objects (astronauts, equipment, and tools) which have accidentally separated from the Space Station. The major objective of the EVA Retriever Project is to design, develop, and evaluate an integrated robotic hardware and on-board software system which autonomously: (1) performs system activation and check-out; (2) searches for and acquires the target; (3) plans and executes a rendezvous while continuously tracking the target; (4) avoids stationary and moving obstacles; (5) reaches for and grapples the target; (6) returns to transfer the object; and (7) returns to base

Motion Planning and Control of Dynamic Humanoid Locomotion

Inspired by human, humanoid robots has the potential to become a general-purpose platform that lives along with human. Due to the technological advances in many field, such as actuation, sensing, control and intelligence, it finally enables humanoid robots to possess human comparable capabilities. However, humanoid locomotion is still a challenging research field. The large number of degree of freedom structure makes the system difficult to coordinate online. The presence of various contact constraints and the hybrid nature of locomotion tasks make the planning a harder problem to solve. Template model anchoring approach has been adopted to bridge the gap between simple model behavior and the whole-body motion of humanoid robot. Control policies are first developed for simple template models like Linear Inverted Pendulum Model (LIPM) or Spring Loaded Inverted Pendulum(SLIP), the result controlled behaviors are then been mapped to the whole-body motion of humanoid robot through optimization-based task-space control strategies. Whole-body humanoid control framework has been verified on various contact situations such as unknown uneven terrain, multi-contact scenarios and moving platform and shows its generality and versatility. For walking motion, existing Model Predictive Control approach based on LIPM has been extended to enable the robot to walk without any reference foot placement anchoring. It is kind of discrete version of \u201cwalking without thinking\u201d. As a result, the robot could achieve versatile locomotion modes such as automatic foot placement with single reference velocity command, reactive stepping under large external disturbances, guided walking with small constant external pushing forces, robust walking on unknown uneven terrain, reactive stepping in place when blocked by external barrier. As an extension of this proposed framework, also to increase the push recovery capability of the humanoid robot, two new configurations have been proposed to enable the robot to perform cross-step motions. For more dynamic hopping and running motion, SLIP model has been chosen as the template model. Different from traditional model-based analytical approach, a data-driven approach has been proposed to encode the dynamics of the this model. A deep neural network is trained offline with a large amount of simulation data based on the SLIP model to learn its dynamics. The trained network is applied online to generate reference foot placements for the humanoid robot. Simulations have been performed to evaluate the effectiveness of the proposed approach in generating bio-inspired and robust running motions. The method proposed based on 2D SLIP model can be generalized to 3D SLIP model and the extension has been briefly mentioned at the end

Modeling and Control of a Flexible Space Robot to Capture a Tumbling Debris

RÉSUMÉ La conquête spatiale des 60 dernières années a généré une grande quantité d’objets à la dérive sur les orbites terrestres. Leur nombre grandissant constitue un danger omniprésent pour l’exploitation des satellites, et requiert aujourd’hui une intervention humaine pour réduire les risques de collision. En effet, l’estimation de leur croissance sur un horizon de 200 ans, connue sous le nom de “syndrôme de Kessler”, montre que l’accès à l’Espace sera grandement menacé si aucune mesure n’est prise pour endiguer cette prolifération. Le scientifique J.-C. Liou de la National Aeronautics and Space Administration (NASA) a montré que la tendance actuelle pourrait être stabilisée, voire inversée, si au moins cinq débris massifs étaient désorbités par an, tels que des satellites en fin de vie ou des étages supérieurs de lanceur. Parmi les nombreux concepts proposés pour cette mission, la robotique s’est imposée comme une des solutions les plus prometteuses grâce aux retours d’expérience des 30 dernières années. La Station Spatiale Internationale (ISS) possède déjà plusieurs bras robotiques opérationnels, et de nombreuses missions ont démontré le potentiel d’un tel système embarqué sur un satellite. Pour deux d’entre elles, des étapes fondamentales ont été validées pour le service en orbite,et s’avèrent être similaires aux problématiques de la désorbitation des débris. Cette thèse se concentre sur l’étape de capture d’un débris en rotation par un bras robotique ayant des segments flexibles. Cette phase comprend la planification de trajectoire et le contrôle du robot spatial, afin de saisir le point cible du débris de la façon la plus délicate possible. La validation des technologies nécessaires à un tel projet est quasiment impossible sur Terre, et requiert des moyens démesurés pour effectuer des essais en orbite. Par conséquent, la modélisation et la simulation de systèmes multi-corps flexibles est traitée en détails, et constitue une forte contribution de la thèse. À l’aide de ces modèles, une validation mixte est proposée par des essais expérimentaux, en reproduisant la cinématique en orbite par des manipulateurs industriels contrôlés par une simulation en temps réel. En résumé, cette thèse est construite autour des trois domaines suivants : la modélisation des robots spatiaux, le design de lois de contrôle, et leur validation sur un cas test. Dans un premier temps, la modélisation de robots spatiaux en condition d’apesanteur est développée pour une forme “en étoile”.----------ABSTRACT After 60 years of intensive satellite launches, the number of drifting objects in Earth orbits is reaching a shifting point, where human intervention is becoming necessary to reduce the threat of collision. Indeed, a 200 year forecast, known as the “Kessler syndrome”, states that space access will be greatly compromised if nothing is done to address the proliferation of these debris. Scientist J.-C. Liou from the National Aeronautics and Space Administration (NASA) has shown that the current trend could be reversed if at least five massive objects, such as dead satellites or rocket upper stages, were de-orbited each year. Among the various technical concepts considered for debris removal, robotics has emerged, over the last 30 years, as one of the most promising solutions. The International Space Station (ISS) already possesses fully operational robotic arms, and other missions have explored the potential of a manipulator embedded onto a satellite. During two of the latter, key capabilities have been demonstrated for on-orbit servicing, and prove to be equally useful for the purpose of debris removal. This thesis focuses on the close range capture of a tumbling debris by a robotic arm with light-weight flexible segments. This phase includes the motion planning and the control of a space robot, in order to smoothly catch a target point on the debris. The validation of such technologies is almost impossible on Earth and leads to prohibitive costs when performed on orbit. Therefore, the modeling and simulation of flexible multi-body systems has been investigated thoroughly, and is likewise a strong contribution of the thesis. Based on these models, an experimental validation is proposed by reproducing the on-orbit kinematics on a test bench made up of two industrial manipulators and driven by a real-time dynamic simulation. In a nutshell, the thesis is built around three main parts: the modeling of a space robot, the design of control laws, and their validation on a test case. The first part is dedicated to the flexible modeling of a space robot in conditions of weightlessness. A “star-shaped” multi-body system is considered, meaning that the rigid base carries various flexible appendages and robotic arms, assumed to be open mechanical chains only. The classic Newton-Euler and Lagrangian algorithms are brought together to account for the flexibility and to compute the dynamics in a numerically efficient way. The modeling step starts with the rigid fixed-base manipulators in order to introduce the notations, then, détails the flexible ones, and ends with the moving-base system to represent the space robots

Proceedings of the NASA Conference on Space Telerobotics, volume 3

The theme of the Conference was man-machine collaboration in space. The Conference provided a forum for researchers and engineers to exchange ideas on the research and development required for application of telerobotics technology to the space systems planned for the 1990s and beyond. The Conference: (1) provided a view of current NASA telerobotic research and development; (2) stimulated technical exchange on man-machine systems, manipulator control, machine sensing, machine intelligence, concurrent computation, and system architectures; and (3) identified important unsolved problems of current interest which can be dealt with by future research

Robot Manipulators

Robot manipulators are developing more in the direction of industrial robots than of human workers. Recently, the applications of robot manipulators are spreading their focus, for example Da Vinci as a medical robot, ASIMO as a humanoid robot and so on. There are many research topics within the field of robot manipulators, e.g. motion planning, cooperation with a human, and fusion with external sensors like vision, haptic and force, etc. Moreover, these include both technical problems in the industry and theoretical problems in the academic fields. This book is a collection of papers presenting the latest research issues from around the world

Modular Robots Morphology Transformation And Task Execution

Self-reconfigurable modular robots are composed of a small set of modules with uniform docking interfaces. Different from conventional robots that are custom-built and optimized for specific tasks, modular robots are able to adapt to many different activities and handle hardware and software failures by rearranging their components. This reconfiguration capability allows these systems to exist in a variety of morphologies, and the introduced flexibility enables self-reconfigurable modular robots to handle a much wider range of tasks, but also complicates the design, control, and planning. This thesis considers a hierarchy framework to deploy modular robots in the real world: the robot first identifies its current morphology, then reconfigures itself into a new morphology if needed, and finally executes either manipulation or locomotion tasks. A reliable system architecture is necessary to handle a large number of modules. The number of possible morphologies constructed by modules increases exponentially as the number of modules grows, and these morphologies usually have many degrees of freedom with complex constraints. In this thesis, hardware platforms and several control methods and planning algorithms are developed to build this hierarchy framework leading to the system-level deployment of modular robots, including a hybrid modular robot (SMORES-EP) and a modular truss robot (VTT). Graph representations of modular robots are introduced as well as several algorithms for morphology identification. Efficient mobile-stylereconfiguration strategies are explored for hybrid modular robots, and a real-time planner based on optimal control is developed to perform dexterous manipulation tasks. For modular truss robots, configuration space is studied and a hybrid planning framework (sampling-based and search-based) is presented to handle reconfiguration activities. A non-impact rolling locomotion planner is then developed to drive an arbitrary truss robot in an environment