Designing Distributed, Component-Based Systems for Industrial Robotic Applications

none3noneM. Amoretti; S. Caselli; M. ReggianiM., Amoretti; S., Caselli; Reggiani, Monic

Remote control and motion coordination of mobile robots

As robots destined for personal and professional applications advance towards becoming part of our daily lives, the importance and complexity of the control algorithms which regulate them should not be underestimated. This thesis is related to two fields within robotics which are of major importance in this paradigm shift; namely, telerobotics and cooperative robotics. On the one hand, telerobotic systems support remote or dangerous tasks, whereas, on the other hand, the use of cooperative robotic systems supports distributed tasks and has several advantages with respect to the use of single-robot systems. The use of robotic systems in remote tasks implies in many cases the physical separation of the controller and the robot. This separation is advantageous when carrying out a variety of remote or hazardous tasks, but at the same time constitutes one of the main drawbacks of this type of robotic systems. Namely, as information is being relayed from the controller to the robot and back over the communication network, a time-delay unavoidably appears in the overall control loop. Hence, controller designs which guarantee the stability and performance of the robot even in the presence of the aforementioned time-delay become necessary in order to ensure a safe and reliable completion of the assigned tasks. On the other hand, using a group of robots to carry out a certain assignment, as compared to a single robot, provides several advantages such as an increased flexibility and the ability to complete distributed or more complex tasks. In order to successfully complete their collective task, the robots in the group generally need to coordinate their behavior by mutually exchanging information. When this information exchange takes place over a delay-inducing communication network, the consequences of the resulting time-delay must be taken into account. As a result, it is of great importance to design controllers which allow the group of robots to work together and complete their task in spite of the time-delay affecting their information exchange. The two control problems explained previously are addressed in this thesis. Firstly, the control of wheeled mobile robots over a delay-inducing communication network is considered by studying the remote tracking control problem for a unicycle-type mobile robot with communication delays. The most important issue to consider is that the communication delay in the control loop most probably compromises the performance and stability of the robot. In order to tackle this problem, a state estimator with a predictor-like structure is proposed. The state estimator is based on the notion of anticipating synchronization and, when acting in conjunction with a tracking control law, the resulting control strategy stabilizes the system and mitigates the negative effects of the time-delay. By exploiting existing results on nonlinear cascaded systems with time-delay, the local uniform asymptotic stability of the closed-loop tracking error dynamics is guaranteed up to a maximum admissible time-delay. Ultimately, explicit expressions which illustrate the relationship between the allowable time-delay and the control parameters of the robot are provided. Secondly, the coordination of a group of wheeled mobile robots over a delayinducing communication network is considered by studying the remote motion coordination problem for a group of unicycle-type mobile robots with a delayed information exchange between the robots. Specifically, master-slave and mutual motion coordination are considered. A controller design which allows the robots to maintain motion coordination even in the presence of a time-delay is proposed and the ensuing global stability analysis provides expressions which relate the control parameters of the robot and the allowable time-delay. The thesis places equal emphasis on theoretical developments and experimental results. In order to do so, the proposed control strategies are experimentally validated using the Internet as the communication network and multi-robot platforms located in Eindhoven, The Netherlands and Tokyo, Japan. To summarize, this thesis addresses two related control problems. On the one hand, we consider the tracking control of a wheeled mobile robot over a communication network which induces a time-delay. On the other hand, we focus on the motion coordination of a group of these robots under the consideration that the information exchange between the robots takes place over a delay-inducing communication network

Robot Autonomy for Surgery

Autonomous surgery involves having surgical tasks performed by a robot operating under its own will, with partial or no human involvement. There are several important advantages of automation in surgery, which include increasing precision of care due to sub-millimeter robot control, real-time utilization of biosignals for interventional care, improvements to surgical efficiency and execution, and computer-aided guidance under various medical imaging and sensing modalities. While these methods may displace some tasks of surgical teams and individual surgeons, they also present new capabilities in interventions that are too difficult or go beyond the skills of a human. In this chapter, we provide an overview of robot autonomy in commercial use and in research, and present some of the challenges faced in developing autonomous surgical robots

Scripting human animations in a virtual environment

The current deficiencies of virtual environment (VE) are well known: annoying lag time in drawing the current view, drastically simplified environments to reduce that time lag, low resolution and narrow field of view. Animation scripting is an application of VE technology which can be carried out successfully despite these deficiencies. The final product is a smoothly moving high resolution animation displaying detailed models. In this system, the user is represented by a human computer model with the same body proportions. Using magnetic tracking, the motions of the model's upper torso, head and arms are controlled by the user's movements (18 degrees of freedom). The model's lower torso and global position and orientation are controlled by a spaceball and keypad (12 degrees of freedom). Using this system human motion scripts can be extracted from the user's movements while immersed in a simplified virtual environment. Recorded data is used to define key frames; motion is interpolated between them and post processing adds a more detailed environment. The result is a considerable savings in time and a much more natural-looking movement of a human figure in a smooth and seamless animation

Expert-in-the-Loop Multilateral Telerobotics for Haptics-Enabled Motor Function and Skills Development

Among medical robotics applications are Robotics-Assisted Mirror Rehabilitation Therapy (RAMRT) and Minimally-Invasive Surgical Training (RAMIST) that extensively rely on motor function development. Haptics-enabled expert-in-the-loop motor function development for such applications is made possible through multilateral telerobotic frameworks. While several studies have validated the benefits of haptic interaction with an expert in motor learning, contradictory results have also been reported. This emphasizes the need for further in-depth studies on the nature of human motor learning through haptic guidance and interaction. The objective of this study was to design and evaluate expert-in-the-loop multilateral telerobotic frameworks with stable and human-safe control loops that enable adaptive “hand-over-hand” haptic guidance for RAMRT and RAMIST. The first prerequisite for such frameworks is active involvement of the patient or trainee, which requires the closed-loop system to remain stable in the presence of an adaptable time-varying dominance factor. To this end, a wave-variable controller is proposed in this study for conventional trilateral teleoperation systems such that system stability is guaranteed in the presence of a time-varying dominance factor and communication delay. Similar to other wave-variable approaches, the controller is initially developed for the Velocity-force Domain (VD) based on the well-known passivity assumption on the human arm in VD. The controller can be applied straightforwardly to the Position-force Domain (PD), eliminating position-error accumulation and position drift, provided that passivity of the human arm in PD is addressed. However, the latter has been ignored in the literature. Therefore, in this study, passivity of the human arm in PD is investigated using mathematical analysis, experimentation as well as user studies involving 12 participants and 48 trials. The results, in conjunction with the proposed wave-variables, can be used to guarantee closed-loop PD stability of the supervised trilateral teleoperation system in its classical format. The classic dual-user teleoperation architecture does not, however, fully satisfy the requirements for properly imparting motor function (skills) in RAMRT (RAMIST). Consequently, the next part of this study focuses on designing novel supervised trilateral frameworks for providing motor learning in RAMRT and RAMIST, each customized according to the requirements of the application. The framework proposed for RAMRT includes the following features: a) therapist-in-the-loop mirror therapy; b) haptic feedback to the therapist from the patient side; c) assist-as-needed therapy realized through an adaptive Guidance Virtual Fixture (GVF); and d) real-time task-independent and patient-specific motor-function assessment. Closed-loop stability of the proposed framework is investigated using a combination of the Circle Criterion and the Small-Gain Theorem. The stability analysis addresses the instabilities caused by: a) communication delays between the therapist and the patient, facilitating haptics-enabled tele- or in-home rehabilitation; and b) the integration of the time-varying nonlinear GVF element into the delayed system. The platform is experimentally evaluated on a trilateral rehabilitation setup consisting of two Quanser rehabilitation robots and one Quanser HD2 robot. The framework proposed for RAMIST includes the following features: a) haptics-enabled expert-in-the-loop surgical training; b) adaptive expertise-oriented training, realized through a Fuzzy Interface System, which actively engages the trainees while providing them with appropriate skills-oriented levels of training; and c) task-independent skills assessment. Closed-loop stability of the architecture is analyzed using the Circle Criterion in the presence and absence of haptic feedback of tool-tissue interactions. In addition to the time-varying elements of the system, the stability analysis approach also addresses communication delays, facilitating tele-surgical training. The platform is implemented on a dual-console surgical setup consisting of the classic da Vinci surgical system (Intuitive Surgical, Inc., Sunnyvale, CA), integrated with the da Vinci Research Kit (dVRK) motor controllers, and the dV-Trainer master console (Mimic Technology Inc., Seattle, WA). In order to save on the expert\u27s (therapist\u27s) time, dual-console architectures can also be expanded to accommodate simultaneous training (rehabilitation) for multiple trainees (patients). As the first step in doing this, the last part of this thesis focuses on the development of a multi-master/single-slave telerobotic framework, along with controller design and closed-loop stability analysis in the presence of communication delays. Various parts of this study are supported with a number of experimental implementations and evaluations. The outcomes of this research include multilateral telerobotic testbeds for further studies on the nature of human motor learning and retention through haptic guidance and interaction. They also enable investigation of the impact of communication time delays on supervised haptics-enabled motor function improvement through tele-rehabilitation and mentoring

Ground verification of the feasibility of telepresent on-orbit servicing

In an ideal case telepresence achieves a state in which a human operator can no longer differentiate between an interaction with a real environment and a technical mediated one. This state is called transparent telepresence. The applicability of telepresence to on-orbit servicing (OOS), i.e., an unmanned servicing operation in space, teleoperated from ground in real time, is verified in this paper. For this purpose, a communication test environment was set up on the ground, which involved the Institute of Astronautics (LRT) ground station in Garching, Germany, and the European Space Agency (ESA) ground station in Redu, Belgium. Both were connected via the geostationary ESA data relay satellite ARTEMIS. Utilizing the data relay satellite, a teleoperation was accomplished in which the human operator as well as the (space) teleoperator was located on the ground. The feasibility of telepresent OOS was evaluated, using an OOS test bed at the Institute of Mechatronics and Robotics at the German Aerospace Center (DLR). The manipulation task was representative for OOS and supported real-time feedback from the haptic-visual workspace. The tests showed that complex manipulation tasks can be fulfilled by utilizing geostationary data relay satellites. For verifying the feasibility of telepresent OOS, different evaluation methods were used. The properties of the space link were measured and related to subjective perceptions of participants, who had to fulfill manipulation tasks. An evaluation of the transparency of the system, including the data relay satellite, was accomplished as well