GNC architecture solutions for robust operations of a free-floating space manipulator via image based visual servoing

On-orbit servicing often requires the use of robotic arms, and a key asset in this kind of operations is autonomy. In this framework, the use of optical devices is a solution, already analyzed in many researches both for autonomous rendezvous and docking and for the evaluation of the control of the manipulator. In the present paper, simulations for assessing the controller performance are realized in a high-fidelity purposely developed software architecture, in which not only the selected 6 DOF space manipulator is modeled, but also a virtual camera, acquiring in the loop images of the target CAD model imported, is included in the GNC loop. This approach allows to emphasis several problems that would not emerge in simulations with images characterized by easily-identifiable, purposely-created markers. At the scope, a specific GNC architecture is developed, based on finite-state machine logic. According to this approach, two different Image Based Visual Servoing strategies are alternatively performed, commanding only linear or angular velocity of the camera, switching between the two control techniques when the “stack” or “divergence” condition is triggered. In this way a stable and robust accomplishment of the tasks is achieved for many configurations and for different target models

Concurrent image-based visual servoing with adaptive zooming for non-cooperative rendezvous maneuvers

An image-based servo controller for the guidance of a spacecraft during non-cooperative rendezvous is presented in this paper. The controller directly utilizes the visual features from image frames of a target spacecraft for computing both attitude and orbital maneuvers concurrently. The utilization of adaptive optics, such as zooming cameras, is also addressed through developing an invariant-image servo controller. The controller allows for performing rendezvous maneuvers independently from the adjustments of the camera focal length, improving the performance and versatility of maneuvers. The stability of the proposed control scheme is proven analytically in the invariant space, and its viability is explored through numerical simulations

Robotic Manipulation and Capture in Space: A Survey

Space exploration and exploitation depend on the development of on-orbit robotic capabilities for tasks such as servicing of satellites, removing of orbital debris, or construction and maintenance of orbital assets. Manipulation and capture of objects on-orbit are key enablers for these capabilities. This survey addresses fundamental aspects of manipulation and capture, such as the dynamics of space manipulator systems (SMS), i.e., satellites equipped with manipulators, the contact dynamics between manipulator grippers/payloads and targets, and the methods for identifying properties of SMSs and their targets. Also, it presents recent work of sensing pose and system states, of motion planning for capturing a target, and of feedback control methods for SMS during motion or interaction tasks. Finally, the paper reviews major ground testing testbeds for capture operations, and several notable missions and technologies developed for capture of targets on-orbit

High-precision grasping and placing for mobile robots

This work presents a manipulation system for multiple labware in life science laboratories using the H20 mobile robots. The H20 robot is equipped with the Kinect V2 sensor to identify and estimate the position of the required labware on the workbench. The local features recognition based on SURF algorithm is used. The recognition process is performed for the labware to be grasped and for the workbench holder. Different grippers and labware containers are designed to manipulate different weights of labware and to realize a safe transportation

Surrogate: A Body-Dexterous Mobile Manipulation Robot with a Tracked Base

Robotics platforms in accordance with various embodiments of the invention can be utilized to implement highly dexterous robots capable of whole body motion. Robotics platforms in accordance with one embodiment of the invention include: a memory containing a whole body motion application; a spine, where the spine has seven degrees of freedom and comprises a spine actuator and three spine elbow joints that each include two spine joint actuators; at least one limb, where the at least one limb comprises a limb actuator and three limb elbow joints that each include two limb joint actuators; a tracked base; a connecting structure that connects the at least one limb to the spine; a second connecting structure that connects the spine to the tracked base; wherein the processor is configured by the whole body motion application to move the at least one limb and the spine to perform whole body motion

From plain visualisation to vibration sensing: using a camera to control the flexibilities in the ITER remote handling equipment

Thermonuclear fusion is expected to play a key role in the energy market during the second half of this century, reaching 20% of the electricity generation by 2100. For many years, fusion scientists and engineers have been developing the various technologies required to build nuclear power stations allowing a sustained fusion reaction. To the maximum possible extent, maintenance operations in fusion reactors are performed manually by qualified workers in full accordance with the "as low as reasonably achievable" (ALARA) principle. However, the option of hands-on maintenance becomes impractical, difficult or simply impossible in many circumstances, such as high biological dose rates. In this case, maintenance tasks will be performed with remote handling (RH) techniques. The International Thermonuclear Experimental Reactor ITER, to be commissioned in southern France around 2025, will be the first fusion experiment producing more power from fusion than energy necessary to heat the plasma. Its main objective is “to demonstrate the scientific and technological feasibility of fusion power for peaceful purposes”. However ITER represents an unequalled challenge in terms of RH system design, since it will be much more demanding and complex than any other remote maintenance system previously designed. The introduction of man-in-the-loop capabilities in the robotic systems designed for ITER maintenance would provide useful assistance during inspection, i.e. by providing the operator the ability and flexibility to locate and examine unplanned targets, or during handling operations, i.e. by making peg-in-hole tasks easier. Unfortunately, most transmission technologies able to withstand the very specific and extreme environmental conditions existing inside a fusion reactor are based on gears, screws, cables and chains, which make the whole system very flexible and subject to vibrations. This effect is further increased as structural parts of the maintenance equipment are generally lightweight and slender structures due to the size and the arduous accessibility to the reactor. Several methodologies aiming at avoiding or limiting the effects of vibrations on RH system performance have been investigated over the past decade. These methods often rely on the use of vibration sensors such as accelerometers. However, reviewing market shows that there is no commercial off-the-shelf (COTS) accelerometer that meets the very specific requirements for vibration sensing in the ITER in-vessel RH equipment (resilience to high total integrated dose, high sensitivity). The customisation and qualification of existing products or investigation of new concepts might be considered. However, these options would inevitably involve high development costs. While an extensive amount of work has been published on the modelling and control of flexible manipulators in the 1980s and 1990s, the possibility to use vision devices to stabilise an oscillating robotic arm has only been considered very recently and this promising solution has not been discussed at length. In parallel, recent developments on machine vision systems in nuclear environment have been very encouraging. Although they do not deal directly with vibration sensing, they open up new prospects in the use of radiation tolerant cameras. This thesis aims to demonstrate that vibration control of remote maintenance equipment operating in harsh environments such as ITER can be achieved without considering any extra sensor besides the embarked rad-hardened cameras that will inevitably be used to provide real-time visual feedback to the operators. In other words it is proposed to consider the radiation-tolerant vision devices as full sensors providing quantitative data that can be processed by the control scheme and not only as plain video feedback providing qualitative information. The work conducted within the present thesis has confirmed that methods based on the tracking of visual features from an unknown environment are effective candidates for the real-time control of vibrations. Oscillations induced at the end effector are estimated by exploiting a simple physical model of the manipulator. Using a camera mounted in an eye-in-hand configuration, this model is adjusted using direct measurement of the tip oscillations with respect to the static environment. The primary contribution of this thesis consists of implementing a markerless tracker to determine the velocity of a tip-mounted camera in an untrimmed environment in order to stabilise an oscillating long-reach robotic arm. In particular, this method implies modifying an existing online interaction matrix estimator to make it self-adjustable and deriving a multimode dynamic model of a flexible rotating beam. An innovative vision-based method using sinusoidal regression to sense low-frequency oscillations is also proposed and tested. Finally, the problem of online estimation of the image capture delay for visual servoing applications with high dynamics is addressed and an original approach based on the concept of cross-correlation is presented and experimentally validated

Automation strategies for sample preparation in life science applications

Automation is broadly applied in life science field, with robots playing critical roles. In this dissertation, a platform based on a Yaskawa industrial dual-arm robot (CSDA10F) is presented, which is to automate the sample preparation processes and to integrate analytical instruments. A user-friendly interface has been provided by integrating the platform with SAMI Workstation EX Software. For automating the sample preparation processes, the robot needs to use various commercial tools, including pipette, syringe, microplate, vial, thermo shaker, ultrasonic machine and so on

Modeling and Control of a Flexible Space Robot to Capture a Tumbling Debris

RÉSUMÉ La conquête spatiale des 60 dernières années a généré une grande quantité d’objets à la dérive sur les orbites terrestres. Leur nombre grandissant constitue un danger omniprésent pour l’exploitation des satellites, et requiert aujourd’hui une intervention humaine pour réduire les risques de collision. En effet, l’estimation de leur croissance sur un horizon de 200 ans, connue sous le nom de “syndrôme de Kessler”, montre que l’accès à l’Espace sera grandement menacé si aucune mesure n’est prise pour endiguer cette prolifération. Le scientifique J.-C. Liou de la National Aeronautics and Space Administration (NASA) a montré que la tendance actuelle pourrait être stabilisée, voire inversée, si au moins cinq débris massifs étaient désorbités par an, tels que des satellites en fin de vie ou des étages supérieurs de lanceur. Parmi les nombreux concepts proposés pour cette mission, la robotique s’est imposée comme une des solutions les plus prometteuses grâce aux retours d’expérience des 30 dernières années. La Station Spatiale Internationale (ISS) possède déjà plusieurs bras robotiques opérationnels, et de nombreuses missions ont démontré le potentiel d’un tel système embarqué sur un satellite. Pour deux d’entre elles, des étapes fondamentales ont été validées pour le service en orbite,et s’avèrent être similaires aux problématiques de la désorbitation des débris. Cette thèse se concentre sur l’étape de capture d’un débris en rotation par un bras robotique ayant des segments flexibles. Cette phase comprend la planification de trajectoire et le contrôle du robot spatial, afin de saisir le point cible du débris de la façon la plus délicate possible. La validation des technologies nécessaires à un tel projet est quasiment impossible sur Terre, et requiert des moyens démesurés pour effectuer des essais en orbite. Par conséquent, la modélisation et la simulation de systèmes multi-corps flexibles est traitée en détails, et constitue une forte contribution de la thèse. À l’aide de ces modèles, une validation mixte est proposée par des essais expérimentaux, en reproduisant la cinématique en orbite par des manipulateurs industriels contrôlés par une simulation en temps réel. En résumé, cette thèse est construite autour des trois domaines suivants : la modélisation des robots spatiaux, le design de lois de contrôle, et leur validation sur un cas test. Dans un premier temps, la modélisation de robots spatiaux en condition d’apesanteur est développée pour une forme “en étoile”.----------ABSTRACT After 60 years of intensive satellite launches, the number of drifting objects in Earth orbits is reaching a shifting point, where human intervention is becoming necessary to reduce the threat of collision. Indeed, a 200 year forecast, known as the “Kessler syndrome”, states that space access will be greatly compromised if nothing is done to address the proliferation of these debris. Scientist J.-C. Liou from the National Aeronautics and Space Administration (NASA) has shown that the current trend could be reversed if at least five massive objects, such as dead satellites or rocket upper stages, were de-orbited each year. Among the various technical concepts considered for debris removal, robotics has emerged, over the last 30 years, as one of the most promising solutions. The International Space Station (ISS) already possesses fully operational robotic arms, and other missions have explored the potential of a manipulator embedded onto a satellite. During two of the latter, key capabilities have been demonstrated for on-orbit servicing, and prove to be equally useful for the purpose of debris removal. This thesis focuses on the close range capture of a tumbling debris by a robotic arm with light-weight flexible segments. This phase includes the motion planning and the control of a space robot, in order to smoothly catch a target point on the debris. The validation of such technologies is almost impossible on Earth and leads to prohibitive costs when performed on orbit. Therefore, the modeling and simulation of flexible multi-body systems has been investigated thoroughly, and is likewise a strong contribution of the thesis. Based on these models, an experimental validation is proposed by reproducing the on-orbit kinematics on a test bench made up of two industrial manipulators and driven by a real-time dynamic simulation. In a nutshell, the thesis is built around three main parts: the modeling of a space robot, the design of control laws, and their validation on a test case. The first part is dedicated to the flexible modeling of a space robot in conditions of weightlessness. A “star-shaped” multi-body system is considered, meaning that the rigid base carries various flexible appendages and robotic arms, assumed to be open mechanical chains only. The classic Newton-Euler and Lagrangian algorithms are brought together to account for the flexibility and to compute the dynamics in a numerically efficient way. The modeling step starts with the rigid fixed-base manipulators in order to introduce the notations, then, détails the flexible ones, and ends with the moving-base system to represent the space robots

Advances in Robot Kinematics : Proceedings of the 15th international conference on Advances in Robot Kinematics

International audienceThe motion of mechanisms, kinematics, is one of the most fundamental aspect of robot design, analysis and control but is also relevant to other scientific domains such as biome- chanics, molecular biology, . . . . The series of books on Advances in Robot Kinematics (ARK) report the latest achievement in this field. ARK has a long history as the first book was published in 1991 and since then new issues have been published every 2 years. Each book is the follow-up of a single-track symposium in which the participants exchange their results and opinions in a meeting that bring together the best of world’s researchers and scientists together with young students. Since 1992 the ARK symposia have come under the patronage of the International Federation for the Promotion of Machine Science-IFToMM.This book is the 13th in the series and is the result of peer-review process intended to select the newest and most original achievements in this field. For the first time the articles of this symposium will be published in a green open-access archive to favor free dissemination of the results. However the book will also be o↵ered as a on-demand printed book.The papers proposed in this book show that robot kinematics is an exciting domain with an immense number of research challenges that go well beyond the field of robotics.The last symposium related with this book was organized by the French National Re- search Institute in Computer Science and Control Theory (INRIA) in Grasse, France