Ground verification of the feasibility of telepresent on-orbit servicing

In an ideal case telepresence achieves a state in which a human operator can no longer differentiate between an interaction with a real environment and a technical mediated one. This state is called transparent telepresence. The applicability of telepresence to on-orbit servicing (OOS), i.e., an unmanned servicing operation in space, teleoperated from ground in real time, is verified in this paper. For this purpose, a communication test environment was set up on the ground, which involved the Institute of Astronautics (LRT) ground station in Garching, Germany, and the European Space Agency (ESA) ground station in Redu, Belgium. Both were connected via the geostationary ESA data relay satellite ARTEMIS. Utilizing the data relay satellite, a teleoperation was accomplished in which the human operator as well as the (space) teleoperator was located on the ground. The feasibility of telepresent OOS was evaluated, using an OOS test bed at the Institute of Mechatronics and Robotics at the German Aerospace Center (DLR). The manipulation task was representative for OOS and supported real-time feedback from the haptic-visual workspace. The tests showed that complex manipulation tasks can be fulfilled by utilizing geostationary data relay satellites. For verifying the feasibility of telepresent OOS, different evaluation methods were used. The properties of the space link were measured and related to subjective perceptions of participants, who had to fulfill manipulation tasks. An evaluation of the transparency of the system, including the data relay satellite, was accomplished as well

Robotics and AI-Enabled On-Orbit Operations With Future Generation of Small Satellites

The low-cost and short-lead time of small satellites has led to their use in science-based missions, earth observation, and interplanetary missions. Today, they are also key instruments in orchestrating technological demonstrations for On-Orbit Operations (O 3 ) such as inspection and spacecraft servicing with planned roles in active debris removal and on-orbit assembly. This paper provides an overview of the robotics and autonomous systems (RASs) technologies that enable robotic O 3 on smallsat platforms. Major RAS topics such as sensing & perception, guidance, navigation & control (GN&C) microgravity mobility and mobile manipulation, and autonomy are discussed from the perspective of relevant past and planned missions

On Advanced Mobility Concepts for Intelligent Planetary Surface Exploration

Surface exploration by wheeled rovers on Earth's Moon (the two Lunokhods) and Mars (Nasa's Sojourner and the two MERs) have been followed since many years already very suc-cessfully, specifically concerning operations over long time. However, despite of this success, the explored surface area was very small, having in mind a total driving distance of about 8 km (Spirit) and 21 km (Opportunity) over 6 years of operation. Moreover, ESA will send its ExoMars rover in 2018 to Mars, and NASA its MSL rover probably this year. However, all these rovers are lacking sufficient on-board intelligence in order to overcome longer dis-tances, driving much faster and deciding autonomously on path planning for the best trajec-tory to follow. In order to increase the scientific output of a rover mission it seems very nec-essary to explore much larger surface areas reliably in much less time. This is the main driver for a robotics institute to combine mechatronics functionalities to develop an intelligent mo-bile wheeled rover with four or six wheels, and having specific kinematics and locomotion suspension depending on the operational terrain of the rover to operate. DLR's Robotics and Mechatronics Center has a long tradition in developing advanced components in the field of light-weight motion actuation, intelligent and soft manipulation and skilled hands and tools, perception and cognition, and in increasing the autonomy of any kind of mechatronic systems. The whole design is supported and is based upon detailed modeling, optimization, and simula-tion tasks. We have developed efficient software tools to simulate the rover driveability per-formance on various terrain characteristics such as soft sandy and hard rocky terrains as well as on inclined planes, where wheel and grouser geometry plays a dominant role. Moreover, rover optimization is performed to support the best engineering intuitions, that will optimize structural and geometric parameters, compare various kinematics suspension concepts, and make use of realistic cost functions like mass and consumed energy minimization, static sta-bility, and more. For self-localization and safe navigation through unknown terrain we make use of fast 3D stereo algorithms that were successfully used e.g. in unmanned air vehicle ap-plications and on terrestrial mobile systems. The advanced rover design approach is applica-ble for lunar as well as Martian surface exploration purposes. A first mobility concept ap-proach for a lunar vehicle will be presented

An Approach for Optimizing the On-Orbit Servicing Architecture for the Space-Based Radar Constellation

Satellite systems, once operational, are essentially a consumable item with no capacity to maintain, repair, or upgrade them while on-orbit. In order to avoid having to replace costly space assets, the Defense Advanced Research Projects Agency (DARPA) and Air Force Space Command (AFSPC) are looking to developing programs to provide an on-orbit servicing capability for future satellite systems under development, such as the Space-Based Radar (SBR) system. DARPA and AFSPC are studying on-orbit servicing using the Orbital Express platform as part of an Analysis of Alternatives for the SBR program. Like their satellite clients, on-orbit servicing assets are expected to be resource intensive, and so proper management of these space logistics assets is essential. This research provides a flexible planning tool to determine the optimal on-orbit servicing architecture for a given client satellite constellation and applies it to the proposed SBR constellation. The model uses a generalized network structure with side constraints to efficiently solve this large combinatorial optimization problem. The optimal number and type of servicing vehicles to use is found, along with the associated most efficient routing to meet client satellite demand for two commodities within multiple time windows

Autonomous Visual Servo Robotic Capture of Non-cooperative Target

This doctoral research develops and validates experimentally a vision-based control scheme for the autonomous capture of a non-cooperative target by robotic manipulators for active space debris removal and on-orbit servicing. It is focused on the final capture stage by robotic manipulators after the orbital rendezvous and proximity maneuver being completed. Two challenges have been identified and investigated in this stage: the dynamic estimation of the non-cooperative target and the autonomous visual servo robotic control. First, an integrated algorithm of photogrammetry and extended Kalman filter is proposed for the dynamic estimation of the non-cooperative target because it is unknown in advance. To improve the stability and precision of the algorithm, the extended Kalman filter is enhanced by dynamically correcting the distribution of the process noise of the filter. Second, the concept of incremental kinematic control is proposed to avoid the multiple solutions in solving the inverse kinematics of robotic manipulators. The proposed target motion estimation and visual servo control algorithms are validated experimentally by a custom built visual servo manipulator-target system. Electronic hardware for the robotic manipulator and computer software for the visual servo are custom designed and developed. The experimental results demonstrate the effectiveness and advantages of the proposed vision-based robotic control for the autonomous capture of a non-cooperative target. Furthermore, a preliminary study is conducted for future extension of the robotic control with consideration of flexible joints

Visual Servo Based Space Robotic Docking for Active Space Debris Removal

This thesis developed a 6DOF pose detection algorithm using machine learning capable of providing the orientation and location of an object in various lighting conditions and at different angles, for the purposes of space robotic rendezvous and docking control. The computer vision algorithm was paired with a virtual robotic simulation to test the feasibility of using the proposed algorithm for visual servo. This thesis also developed a method for generating virtual training images and corresponding ground truth data including both location and orientation information. Traditional computer vision techniques struggle to determine the 6DOF pose of an object when certain colors or edges are not found, therefore training a network is an optimal choice. The 6DOF pose detection algorithm was implemented on MATLAB and Python. The robotic simulation was implemented on Simulink and ROS Gazebo. Finally, the generation of training data was done with Python and Blender

Electromyography for teleoperated tasks in weightlessness

The cooperation between robots and astronauts will become a core element of future space missions. This is accompanied by the demand for suitable input devices. An interface based on electromyography (EMG) represents a small, light and wearable device to generate a continuous 3D control signal from voluntarily muscle activation of the operator's arm. We analyzed the influence of microgravity on task performance during a 2D task on a screen. Six subjects performed aiming and tracking tasks in parabolic flights. Three different levels of fixation -- fixed feet using foot straps, semi-free by using a foot rail, and free-floating feet -- were tested to investigate how much user fixation is required to operate via the interface. The user study showed that weightlessness affects the usage of the interface only to a small extent. Success rates between 89% and 96% were reached within all conditions during microgravity. A significant effect between 0G and 1G could not be identified for the test series of fixed and semi-free feet, while free-floating feet showed significantly worse results in fine and gross motion times in 0G compared to ground tests (with success rates of 92% for 0G and 99% for 1G). Further adaptation to the altered proprioception may be needed here. Hence, foot rails as already mounted in the ISS would be sufficient to use the interface in weightlessness. Low impact of microgravity, high success rates, and an easy handling of the system, indicates a high potential of an EMG-based interface for teleoperation in space

Modeling and Control of a Flexible Space Robot to Capture a Tumbling Debris

RÉSUMÉ La conquête spatiale des 60 dernières années a généré une grande quantité d’objets à la dérive sur les orbites terrestres. Leur nombre grandissant constitue un danger omniprésent pour l’exploitation des satellites, et requiert aujourd’hui une intervention humaine pour réduire les risques de collision. En effet, l’estimation de leur croissance sur un horizon de 200 ans, connue sous le nom de “syndrôme de Kessler”, montre que l’accès à l’Espace sera grandement menacé si aucune mesure n’est prise pour endiguer cette prolifération. Le scientifique J.-C. Liou de la National Aeronautics and Space Administration (NASA) a montré que la tendance actuelle pourrait être stabilisée, voire inversée, si au moins cinq débris massifs étaient désorbités par an, tels que des satellites en fin de vie ou des étages supérieurs de lanceur. Parmi les nombreux concepts proposés pour cette mission, la robotique s’est imposée comme une des solutions les plus prometteuses grâce aux retours d’expérience des 30 dernières années. La Station Spatiale Internationale (ISS) possède déjà plusieurs bras robotiques opérationnels, et de nombreuses missions ont démontré le potentiel d’un tel système embarqué sur un satellite. Pour deux d’entre elles, des étapes fondamentales ont été validées pour le service en orbite,et s’avèrent être similaires aux problématiques de la désorbitation des débris. Cette thèse se concentre sur l’étape de capture d’un débris en rotation par un bras robotique ayant des segments flexibles. Cette phase comprend la planification de trajectoire et le contrôle du robot spatial, afin de saisir le point cible du débris de la façon la plus délicate possible. La validation des technologies nécessaires à un tel projet est quasiment impossible sur Terre, et requiert des moyens démesurés pour effectuer des essais en orbite. Par conséquent, la modélisation et la simulation de systèmes multi-corps flexibles est traitée en détails, et constitue une forte contribution de la thèse. À l’aide de ces modèles, une validation mixte est proposée par des essais expérimentaux, en reproduisant la cinématique en orbite par des manipulateurs industriels contrôlés par une simulation en temps réel. En résumé, cette thèse est construite autour des trois domaines suivants : la modélisation des robots spatiaux, le design de lois de contrôle, et leur validation sur un cas test. Dans un premier temps, la modélisation de robots spatiaux en condition d’apesanteur est développée pour une forme “en étoile”.----------ABSTRACT After 60 years of intensive satellite launches, the number of drifting objects in Earth orbits is reaching a shifting point, where human intervention is becoming necessary to reduce the threat of collision. Indeed, a 200 year forecast, known as the “Kessler syndrome”, states that space access will be greatly compromised if nothing is done to address the proliferation of these debris. Scientist J.-C. Liou from the National Aeronautics and Space Administration (NASA) has shown that the current trend could be reversed if at least five massive objects, such as dead satellites or rocket upper stages, were de-orbited each year. Among the various technical concepts considered for debris removal, robotics has emerged, over the last 30 years, as one of the most promising solutions. The International Space Station (ISS) already possesses fully operational robotic arms, and other missions have explored the potential of a manipulator embedded onto a satellite. During two of the latter, key capabilities have been demonstrated for on-orbit servicing, and prove to be equally useful for the purpose of debris removal. This thesis focuses on the close range capture of a tumbling debris by a robotic arm with light-weight flexible segments. This phase includes the motion planning and the control of a space robot, in order to smoothly catch a target point on the debris. The validation of such technologies is almost impossible on Earth and leads to prohibitive costs when performed on orbit. Therefore, the modeling and simulation of flexible multi-body systems has been investigated thoroughly, and is likewise a strong contribution of the thesis. Based on these models, an experimental validation is proposed by reproducing the on-orbit kinematics on a test bench made up of two industrial manipulators and driven by a real-time dynamic simulation. In a nutshell, the thesis is built around three main parts: the modeling of a space robot, the design of control laws, and their validation on a test case. The first part is dedicated to the flexible modeling of a space robot in conditions of weightlessness. A “star-shaped” multi-body system is considered, meaning that the rigid base carries various flexible appendages and robotic arms, assumed to be open mechanical chains only. The classic Newton-Euler and Lagrangian algorithms are brought together to account for the flexibility and to compute the dynamics in a numerically efficient way. The modeling step starts with the rigid fixed-base manipulators in order to introduce the notations, then, détails the flexible ones, and ends with the moving-base system to represent the space robots

Proceedings of the NASA Conference on Space Telerobotics, volume 4

Papers presented at the NASA Conference on Space Telerobotics are compiled. The theme of the conference was man-machine collaboration in space. The conference provided a forum for researchers and engineers to exchange ideas on the research and development required for the application of telerobotic technology to the space systems planned for the 1990's and beyond. Volume 4 contains papers related to the following subject areas: manipulator control; telemanipulation; flight experiments (systems and simulators); sensor-based planning; robot kinematics, dynamics, and control; robot task planning and assembly; and research activities at the NASA Langley Research Center

Aeronautical enginnering: A cumulative index to a continuing bibliography (supplement 312)

This is a cumulative index to the abstracts contained in NASA SP-7037 (301) through NASA SP-7073 (311) of Aeronautical Engineering: A Continuing Bibliography. NASA SP-7037 and its supplements have been compiled by the Center for AeroSpace Information of the National Aeronautics and Space Administration (NASA). This cumulative index includes subject, personal author, corporate source, foreign technology, contract number, report number, and accession number indexes