Passivity-Based Control of Human-Robotic Networks with Inter-Robot Communication Delays and Experimental Verification

In this paper, we present experimental studies on a cooperative control system for human-robotic networks with inter-robot communication delays. We first design a cooperative controller to be implemented on each robot so that their motion are synchronized to a reference motion desired by a human operator, and then point out that each robot motion ensures passivity. Inter-robot communication channels are then designed via so-called scattering transformation which is a technique to passify the delayed channel. The resulting robotic network is then connected with human operator based on passivity theory. In order to demonstrate the present control architecture, we build an experimental testbed consisting of multiple robots and a tablet. In particular, we analyze the effects of the communication delays on the human operator's behavior

The Shape of Damping: Optimizing Damping Coefficients to Improve Transparency on Bilateral Telemanipulation

This thesis presents a novel optimization-based passivity control algorithm for hapticenabled bilateral teleoperation systems involving multiple degrees of freedom. In particular, in the context of energy-bounding control, the contribution focuses on the implementation of a passivity layer for an existing time-domain scheme, ensuring optimal transparency of the interaction along subsets of the environment space which are preponderant for the given task, while preserving the energy bounds required for passivity. The involved optimization problem is convex and amenable to real-time implementation. The effectiveness of the proposed design is validated via an experiment performed on a virtual teleoperated environment. The interplay between transparency and stability is a critical aspect in haptic-enabled bilateral teleoperation control. While it is important to present the user with the true impedance of the environment, destabilizing factors such as time delays, stiff environments, and a relaxed grasp on the master device may compromise the stability and safety of the system. Passivity has been exploited as one of the the main tools for providing sufficient conditions for stable teleoperation in several controller design approaches, such as the scattering algorithm, timedomain passivity control, energy bounding algorithm, and passive set position modulation. In this work it is presented an innovative energy-based approach, which builds upon existing time-domain passivity controllers, improving and extending their effectiveness and functionality. The set of damping coefficients are prioritized in each degree of freedom, the resulting transparency presents a realistic force feedback in comparison to the other directions. Thus, the prioritization takes effect using a quadratic programming algorithm to find the optimal values for the damping. Finally, the energy tanks approach on passivity control is a solution used to ensure stability in a system for robotics bilateral manipulation. The bilateral telemanipulation must maintain the principle of passivity in all moments to preserve the system\u2019s stability. This work presents a brief introduction to haptic devices as a master component on the telemanipulation chain; the end effector in the slave side is a representation of an interactive object within an environment having a force sensor as feedback signal. The whole interface is designed into a cross-platform framework named ROS, where the user interacts with the system. Experimental results are presented

Introduction to Surface Avatar: the First Heterogeneous Robotic Team to be Commanded with Scalable Autonomy from the ISS

Robotics is vital to the continued development toward Lunar and Martian exploration, in-situ resource utilization, and surface infrastructure construction. Large-scale extra-terrestrial missions will require teams of robots with different, complementary capabilities, together with a powerful, intuitive user interface for effective commanding. We introduce Surface Avatar, the newest ISS-to-Earth telerobotic experiment series, to be conducted in 2022-2024. Spearheaded by DLR, together with ESA, Surface Avatar builds on expertise on commanding robots with different levels of autonomy from our past telerobotic experiments: Kontur-2, Haptics, Interact, SUPVIS Justin, and Analog-1. A team of four heterogeneous robots in a multi-site analog environment at DLR are at the command of a crew member on the ISS. The team has a humanoid robot for dexterous object handling, construction and maintenance; a rover for long traverses and sample acquisition; a quadrupedal robot for scouting and exploring difficult terrains; and a lander with robotic arm for component delivery and sample stowage. The crew's command terminal is multimodal, with an intuitive graphical user interface, 3-DOF joystick, and 7-DOF input device with force-feedback. The autonomy of any robot can be scaled up and down depending on the task and the astronaut's preference: acting as an avatar of the crew in haptically-coupled telepresence, or receiving task-level commands like an intelligent co-worker. Through crew performing collaborative tasks in exploration and construction scenarios, we hope to gain insight into how to optimally command robots in a future space mission. This paper presents findings from the first preliminary session in June 2022, and discusses the way forward in the planned experiment sessions

Time domain passivity control for delayed teleoperation

Tesis Doctoral para la obtención del Título de Grado de Doctor. x, 204 p. : il., diagr. Fecha de defensa de la Tesis Doctoral: 9 de julio de 2014. Calificación: Sobresaliente cum laudemTelepresence combines dierent sensorial modalities, including vision and touch, to produce a feeling of being present in a remote location. The key element to successfully implement a telepresence system and thus to allow telemanipulation of a remote environment is force feedback. In a telemanipulation, mechanical energy is conveyed from the human operator to the manipulated object found in the remote environment. In general, energy is a property of all physical objects, fundamental to their mutual interactions in which the energy can be transferred among the objects and can change form but cannot be created or destroyed. In this thesis, we exploit this fundamental principle to derive a novel bilateral control mechanism that allows to design stable teleoperation systems with any conceivable communication architecture. The rationale starts from the fact that the mechanical energy injected by a human operator into the system must be conveyed to the remote environment and vice versa. As will be seen, setting energy as a control variable allows a more general treatment of the system than the more conventional setting of specic system variables, as can be position, velocity or force. Through the Time Delay Power Network (TDPN) concept, the issue of dening the energy ows involved in a teleoperation system is solved with independence of the communication architecture. In particular, communication time delays are found to be a source of virtual energy. This fact is observed with delays starting from 1 millisecond. Since this energy is intrinsically added, the resulting teleoperation system can be non-passive and thus become unstable. The Time Delay Power Networks are found to be carriers of the desired exchanged energy but also generators of virtual energy due to the time delay. Once these networks are identied, the Time Domain Passivity Control approach for TDPNs is proposed as a control mechanism to ensure system passivity and therefore, system stability. The proposed method is based on the simple fact that this intrinsically added energy due to the communication must be transformed into dissipation. Then the system becomes closer to the desired one, where only the energy injected from one side of the system is conveyed to the other one. The resulting system presents two qualities: On one hand, system stability is guaranteed through passivity, independently from the chosen control architecture and communication channel; on the other, performance is maximized in terms of energy transfer delity. The proposed methods are sustained with a set of experimental implementations using dierent control architectures and communication delays ranging from 2 to 900 milliseconds. An experiment that includes a communication Space link based on the geostationary satellite ASTRA concludes this thesisPeer Reviewe

A Stable and Transparent Framework for Adaptive Shared Control of Robots

In mixed-initiative haptic shared control of robots, humans and automatic control system work in parallel. The commands to the robot are a weighted sum of forces from these two agents. This thesis develops control methods to improve the force feedback performance for mixed-initiative shared teleoperation and to adapt the control authority between human and automatic control system in a stable manner even in the presence of communication delays. All methods are validated on real robotic hardware

Development of a cognitive robotic system for simple surgical tasks

The introduction of robotic surgery within the operating rooms has significantly improved the quality of many surgical procedures. Recently, the research on medical robotic systems focused on increasing the level of autonomy in order to give them the possibility to carry out simple surgical actions autonomously. This paper reports on the development of technologies for introducing automation within the surgical workflow. The results have been obtained during the ongoing FP7 European funded project Intelligent Surgical Robotics (I-SUR). The main goal of the project is to demonstrate that autonomous robotic surgical systems can carry out simple surgical tasks effectively and without major intervention by surgeons. To fulfil this goal, we have developed innovative solutions (both in terms of technologies and algorithms) for the following aspects: fabrication of soft organ models starting from CT images, surgical planning and execution of movement of robot arms in contact with a deformable environment, designing a surgical interface minimizing the cognitive load of the surgeon supervising the actions, intra-operative sensing and reasoning to detect normal transitions and unexpected events. All these technologies have been integrated using a component-based software architecture to control a novel robot designed to perform the surgical actions under study. In this work we provide an overview of our system and report on preliminary results of the automatic execution of needle insertion for the cryoablation of kidney tumours

Adaptive Control for Haptics with Time-Delay

Abstract-This paper presents an adaptive haptic control for a one degree-of-freedom surgical device. The control addresses the problem of hitting a solid object too hard in the presence of time delay. The proposed control runs in the inner-loop, with no time delay, and follows commanded forces from the outer loop. A Lyapunov-stable backstepping-with-tuning-functions design provides a way to ensure smooth forces are applied that guarantee stability in the presence of unmodeled environmental stiffness. The method naturally becomes a velocity-tracking system when no forces are measured, without need for a switching control law. Experiments using a Phantom hand controller interacting with simulated environment show that collision forces are substantially reduced. The overshoot during a puncture, when moving from a stiff environment to free space, is not worse than with other designs