The Shape of Damping: Optimizing Damping Coefficients to Improve Transparency on Bilateral Telemanipulation

This thesis presents a novel optimization-based passivity control algorithm for hapticenabled bilateral teleoperation systems involving multiple degrees of freedom. In particular, in the context of energy-bounding control, the contribution focuses on the implementation of a passivity layer for an existing time-domain scheme, ensuring optimal transparency of the interaction along subsets of the environment space which are preponderant for the given task, while preserving the energy bounds required for passivity. The involved optimization problem is convex and amenable to real-time implementation. The effectiveness of the proposed design is validated via an experiment performed on a virtual teleoperated environment. The interplay between transparency and stability is a critical aspect in haptic-enabled bilateral teleoperation control. While it is important to present the user with the true impedance of the environment, destabilizing factors such as time delays, stiff environments, and a relaxed grasp on the master device may compromise the stability and safety of the system. Passivity has been exploited as one of the the main tools for providing sufficient conditions for stable teleoperation in several controller design approaches, such as the scattering algorithm, timedomain passivity control, energy bounding algorithm, and passive set position modulation. In this work it is presented an innovative energy-based approach, which builds upon existing time-domain passivity controllers, improving and extending their effectiveness and functionality. The set of damping coefficients are prioritized in each degree of freedom, the resulting transparency presents a realistic force feedback in comparison to the other directions. Thus, the prioritization takes effect using a quadratic programming algorithm to find the optimal values for the damping. Finally, the energy tanks approach on passivity control is a solution used to ensure stability in a system for robotics bilateral manipulation. The bilateral telemanipulation must maintain the principle of passivity in all moments to preserve the system\u2019s stability. This work presents a brief introduction to haptic devices as a master component on the telemanipulation chain; the end effector in the slave side is a representation of an interactive object within an environment having a force sensor as feedback signal. The whole interface is designed into a cross-platform framework named ROS, where the user interacts with the system. Experimental results are presented

Network Representation and Passivity of Delayed Teleoperation Systems

The paper proposes a general network based analysis and design guidelines for teleoperation systems. The electrical domain is appealing because it enjoys proficient analysis and design tools and allows a one step higher abstraction element, the network. Thus, in order to analyze the system by means of network elements the mechanical system must be first modeled as an electric circuit. Only then power ports become apparent and networks can be defined. This kind of analysis has been previously performed in systems with well defined causalities, specially in the communication channel. Indeed, a communication channel exchanging flow-like and effort-like signals, as for instance velocity and computed force, has a well defined causality and can thus be directly mapped as a two-port electrical network. However, this is only one of the many possible system architectures. This paper investigates how other architectures, including those with ambiguous causalities, can be modeled by means of networks, even in the lack of flow or effort being transmitted, and how they can be made passive for any communication channel characteristic (delay, package-loss and jitter). The methods are exposed in the form of design guidelines sustained with an example and validated with experimental results

Predictive input delay compensation for motion control systems

This paper presents an analytical approach for the prediction of future motion to be used in input delay compensation of time-delayed motion control systems. The method makes use of the current and previous input values given to a nominally behaving system in order to realize the prediction of the future motion of that system. The generation of the future input is made through an integration which is realized in discrete time setting. Once the future input signal is created, it is used as the reference input of the remote system to enforce an input time delayed system, conduct a delay-free motion. Following the theoretical formulation, the proposed method is tested in experiments and the validity of the approach is verified

Model following control with discrete time SMC for time-delayed bilateral control systems

This paper proposes a new algorithm based on model following control to recover the uncompensated slave disturbance on time delayed motion control systems having contact with environment. In the previous works, a modified Communication Disturbance Observer (CDOB) was shown to be successful in ensuring position tracking in free motion under varying time delay. However, experiments show that due to the imperfections in slave plant Disturbance Observer (DOB) when there is rapid change of external force on the slave side, as in the case of environment contact, position tracking is degraded. This paper first analyzes the effect of environment contact for motion control systems with disturbance observers. Following this analysis, a model following controller scheme is proposed to restore the ideal motion on the slave system. A virtual plant is introduced which accepts the current from the master side and determines what the position output would be if there was no environment. Based on the error bet ween actual system and model system, a discrete time sliding mode controller is designed which enforces the real slave system to track the virtual slave output. In other words, convergence of slave position to the master position is achieved even though there is contact with environment. Experimental verification of the proposed control scheme also shows the improvement in slave position tracking under contact forces

Multilateral teleoperation over communication time delay using the time-domain passivity approach

A general framework to stabilize multilateral teleoperation system over a communication time delay based on the well-known time-domain passivity approach (TDPA) is proposed. The uniqueness of this framework is that it is independent of the amount of communication time delay, the multilateral control architecture, and the number of masters and slaves. The multilateral system was first decoupled into subsystems with respect to each terminal by identifying the input signals' contributions to the output terminals, which was not straightforward due to the coupled nature of the multilateral teleoperation system. The decoupled subsystems were then converted into an electrical circuit using a mechanical-electrical analogy. Time-delay power network (TDPN) was introduced to clarify active energy sources from the time delay and passivity observer/passivity controller (PO/PC) was utilized to dissipate those active energies. A less-conservative method compared with prior work was proposed to guarantee the stability. Experiments with a trilateral teleoperation system and with a multilateral teleoperation system with a dual master and dual slave were conducted to validate the proposed framework

Expert-in-the-Loop Multilateral Telerobotics for Haptics-Enabled Motor Function and Skills Development

Among medical robotics applications are Robotics-Assisted Mirror Rehabilitation Therapy (RAMRT) and Minimally-Invasive Surgical Training (RAMIST) that extensively rely on motor function development. Haptics-enabled expert-in-the-loop motor function development for such applications is made possible through multilateral telerobotic frameworks. While several studies have validated the benefits of haptic interaction with an expert in motor learning, contradictory results have also been reported. This emphasizes the need for further in-depth studies on the nature of human motor learning through haptic guidance and interaction. The objective of this study was to design and evaluate expert-in-the-loop multilateral telerobotic frameworks with stable and human-safe control loops that enable adaptive “hand-over-hand” haptic guidance for RAMRT and RAMIST. The first prerequisite for such frameworks is active involvement of the patient or trainee, which requires the closed-loop system to remain stable in the presence of an adaptable time-varying dominance factor. To this end, a wave-variable controller is proposed in this study for conventional trilateral teleoperation systems such that system stability is guaranteed in the presence of a time-varying dominance factor and communication delay. Similar to other wave-variable approaches, the controller is initially developed for the Velocity-force Domain (VD) based on the well-known passivity assumption on the human arm in VD. The controller can be applied straightforwardly to the Position-force Domain (PD), eliminating position-error accumulation and position drift, provided that passivity of the human arm in PD is addressed. However, the latter has been ignored in the literature. Therefore, in this study, passivity of the human arm in PD is investigated using mathematical analysis, experimentation as well as user studies involving 12 participants and 48 trials. The results, in conjunction with the proposed wave-variables, can be used to guarantee closed-loop PD stability of the supervised trilateral teleoperation system in its classical format. The classic dual-user teleoperation architecture does not, however, fully satisfy the requirements for properly imparting motor function (skills) in RAMRT (RAMIST). Consequently, the next part of this study focuses on designing novel supervised trilateral frameworks for providing motor learning in RAMRT and RAMIST, each customized according to the requirements of the application. The framework proposed for RAMRT includes the following features: a) therapist-in-the-loop mirror therapy; b) haptic feedback to the therapist from the patient side; c) assist-as-needed therapy realized through an adaptive Guidance Virtual Fixture (GVF); and d) real-time task-independent and patient-specific motor-function assessment. Closed-loop stability of the proposed framework is investigated using a combination of the Circle Criterion and the Small-Gain Theorem. The stability analysis addresses the instabilities caused by: a) communication delays between the therapist and the patient, facilitating haptics-enabled tele- or in-home rehabilitation; and b) the integration of the time-varying nonlinear GVF element into the delayed system. The platform is experimentally evaluated on a trilateral rehabilitation setup consisting of two Quanser rehabilitation robots and one Quanser HD2 robot. The framework proposed for RAMIST includes the following features: a) haptics-enabled expert-in-the-loop surgical training; b) adaptive expertise-oriented training, realized through a Fuzzy Interface System, which actively engages the trainees while providing them with appropriate skills-oriented levels of training; and c) task-independent skills assessment. Closed-loop stability of the architecture is analyzed using the Circle Criterion in the presence and absence of haptic feedback of tool-tissue interactions. In addition to the time-varying elements of the system, the stability analysis approach also addresses communication delays, facilitating tele-surgical training. The platform is implemented on a dual-console surgical setup consisting of the classic da Vinci surgical system (Intuitive Surgical, Inc., Sunnyvale, CA), integrated with the da Vinci Research Kit (dVRK) motor controllers, and the dV-Trainer master console (Mimic Technology Inc., Seattle, WA). In order to save on the expert\u27s (therapist\u27s) time, dual-console architectures can also be expanded to accommodate simultaneous training (rehabilitation) for multiple trainees (patients). As the first step in doing this, the last part of this thesis focuses on the development of a multi-master/single-slave telerobotic framework, along with controller design and closed-loop stability analysis in the presence of communication delays. Various parts of this study are supported with a number of experimental implementations and evaluations. The outcomes of this research include multilateral telerobotic testbeds for further studies on the nature of human motor learning and retention through haptic guidance and interaction. They also enable investigation of the impact of communication time delays on supervised haptics-enabled motor function improvement through tele-rehabilitation and mentoring

Stabilization and control of teleoperation systems with time delays

A control scheme for teleoperation systems with time delay is developed based on the concept of passivity. This control method requires neither detailed knowledge of the manipulator systems nor the mathematical models of the environments, and it is applicable for any time delays. The main contribution of this method is that it is less conservative than the traditional passivity based method. In this method, the passivity controller only operates when the system loses passivity, while in a traditional passivity formulation, the controller works at all times during operation and thus adversely affect the performance of the system.;Using the proposed control scheme, a sub-system is defined that is composed of the communication channel, slave robot and the manipulated environment. This sub system is treated as a one-port network component, and passivity theory is applied to this component to assure stability. The energy flowing into the one-port network, in the form of the control command and the force feedback, is monitored. A passivity regulator is activated to maintain the passivity of the network by modifying the feedback force to the master, and thus adjust the energy exchange between the master and the communication channel.;When this method is applied, only the information at the interface between the master manipulator and the communication channel is collected and observed, there is no need for accurate or detailed knowledge of the structure or timing of the communication channel. The method can make the system lossless regardless of the feedback force, the coordinating force controlling the slave joint motions or the contact force. The approach can stabilize the system regardless of the time delay, discontinuities with environmental contact, or discretization of the physical plant. It will pose no problem when the environmental contact force is directly fed back. The results of this work show that it is advantageous to use the measured environmental force as the feedback, providing superior performance for free motion and more realistic haptic feedback for the operator from the remote environment.;Simulation and experimental results are presented to verify the proposed control scheme