Delay compensation for nonlinear teleoperators using predictor observers

This paper presents a delay compensation technique for nonlinear teleoperators by developing a predictor type sliding mode observer (SMO) that estimates future states of the slave operator. Predicted states are then used in control formulation. In the proposed scheme, disturbance observers (DOB) are also utilized to linearize nonlinear dynamics of the master and slave operators. It is shown that utilization of disturbance observers and predictor observer allow simple PD controllers to be used to provide stable position tracking for bilateral teleoperation. Proposed approach is verified with simulations where it is compared with two state-of-the-art methods. Successful experimental results with a bilateral teleoperation system consisting of a pair of pantograph robots also validates the proposed method

Control of Cooperative Haptics-Enabled Teleoperation Systems with Application to Minimally Invasive Surgery

Robot-Assisted Minimally Invasive Surgical (RAMIS) systems frequently have a structure of cooperative teleoperator systems where multiple master-slave pairs are used to collaboratively execute a task. Although multiple studies indicate that haptic feedback improves the realism of tool-tissue interaction to the surgeon and leads to better performance for surgical procedures, current telesurgical systems typically do not provide force feedback, mainly because of the inherent stability issues. The research presented in this thesis is directed towards the development of control algorithms for force reflecting cooperative surgical teleoperator systems with improved stability and transparency characteristics. In the case of cooperative force reflecting teleoperation over networks, conventional passivity based approaches may have limited applicability due to potentially non-passive slave-slave interactions and irregular communication delays imposed by the network. In this thesis, an alternative small gain framework for the design of cooperative network-based force reflecting teleoperator systems is developed. Using the small gain framework, control algorithms for cooperative force-reflecting teleoperator systems are designed that guarantee stability in the presence of multiple network-induced communication constraints. Furthermore, the design conservatism typically associated with the small-gain approach is eliminated by using the Projection-Based Force Reflection (PBFR) algorithms. Stability results are established for networked cooperative teleoperator systems under different types of force reflection algorithms in the presence of irregular communication delays. The proposed control approach is consequently implemented on a dual-arm (two masters/two slaves) robotic MIS testbed. The testbed consists of two Haptic Wand devices as masters and two PA10-7C robots as the slave manipulators equipped with da Vinci laparoscopic surgical instruments. The performance of the proposed control approach is evaluated in three different cooperative surgical tasks, which are knot tightening, pegboard transfer, and object manipulation. The experimental results obtained indicate that the PBFR algorithms demonstrate statistically significant performance improvement in comparison with the conventional direct force reflection algorithms. One possible shortcoming of using PBFR algorithms is that implementation of these algorithms may lead to attenuation of the high-frequency component of the contact force which is important, in particular, for haptic perception of stiff surfaces. In this thesis, a solution to this problem is proposed which is based on the idea of separating the different frequency bands in the force reflection signal and consequently applying the projection-based principle to the low-frequency component, while reflecting the high-frequency component directly. The experimental results demonstrate that substantial improvement in transient fidelity of the force feedback is achieved using the proposed method without negative effects on the stability of the system

Stabilization and control of teleoperation systems with time delays

A control scheme for teleoperation systems with time delay is developed based on the concept of passivity. This control method requires neither detailed knowledge of the manipulator systems nor the mathematical models of the environments, and it is applicable for any time delays. The main contribution of this method is that it is less conservative than the traditional passivity based method. In this method, the passivity controller only operates when the system loses passivity, while in a traditional passivity formulation, the controller works at all times during operation and thus adversely affect the performance of the system.;Using the proposed control scheme, a sub-system is defined that is composed of the communication channel, slave robot and the manipulated environment. This sub system is treated as a one-port network component, and passivity theory is applied to this component to assure stability. The energy flowing into the one-port network, in the form of the control command and the force feedback, is monitored. A passivity regulator is activated to maintain the passivity of the network by modifying the feedback force to the master, and thus adjust the energy exchange between the master and the communication channel.;When this method is applied, only the information at the interface between the master manipulator and the communication channel is collected and observed, there is no need for accurate or detailed knowledge of the structure or timing of the communication channel. The method can make the system lossless regardless of the feedback force, the coordinating force controlling the slave joint motions or the contact force. The approach can stabilize the system regardless of the time delay, discontinuities with environmental contact, or discretization of the physical plant. It will pose no problem when the environmental contact force is directly fed back. The results of this work show that it is advantageous to use the measured environmental force as the feedback, providing superior performance for free motion and more realistic haptic feedback for the operator from the remote environment.;Simulation and experimental results are presented to verify the proposed control scheme

Predictive input delay compensation for motion control systems

This paper presents an analytical approach for the prediction of future motion to be used in input delay compensation of time-delayed motion control systems. The method makes use of the current and previous input values given to a nominally behaving system in order to realize the prediction of the future motion of that system. The generation of the future input is made through an integration which is realized in discrete time setting. Once the future input signal is created, it is used as the reference input of the remote system to enforce an input time delayed system, conduct a delay-free motion. Following the theoretical formulation, the proposed method is tested in experiments and the validity of the approach is verified

Model following control with discrete time SMC for time-delayed bilateral control systems

This paper proposes a new algorithm based on model following control to recover the uncompensated slave disturbance on time delayed motion control systems having contact with environment. In the previous works, a modified Communication Disturbance Observer (CDOB) was shown to be successful in ensuring position tracking in free motion under varying time delay. However, experiments show that due to the imperfections in slave plant Disturbance Observer (DOB) when there is rapid change of external force on the slave side, as in the case of environment contact, position tracking is degraded. This paper first analyzes the effect of environment contact for motion control systems with disturbance observers. Following this analysis, a model following controller scheme is proposed to restore the ideal motion on the slave system. A virtual plant is introduced which accepts the current from the master side and determines what the position output would be if there was no environment. Based on the error bet ween actual system and model system, a discrete time sliding mode controller is designed which enforces the real slave system to track the virtual slave output. In other words, convergence of slave position to the master position is achieved even though there is contact with environment. Experimental verification of the proposed control scheme also shows the improvement in slave position tracking under contact forces

Novel observers for compensation of communication delay in bilateral control systems

The problem of communication delay in bilateral or teleoperation systems is even more emphasized with the use of the internet for communication, which may give rise to loss of transparency and even instability. To address the problem, numerous methods have been proposed. This study is among the few recent studies taking a disturbance observer approach to the problem of time delay, and introduces a novel sliding-mode observer to overcome specifically the effects of communication delay in the feedback loop. The observer operates in combination with a PD+ controller which controls the system dynamics, while also compensating load torque uncertainties on the slave side. To this aim, an EKF based load estimation algorithm is performed on the slave side. The performance of this approach is tested with computer simulations for the teleoperation of a 1-DOF robotic arm. The simulations reveal an acceptable amount of accuracy and transparency between the estimated slave and actual slave position under both constant and random measurement delay and variable and step-type load variations on the slave side, motivating the use of the approach for internet-based bilateral control systems

Efficient Transport Protocol for Networked Haptics Applications

The performance of haptic application is highly sensitive to communication delays and losses of data. It implies several constraints in developing networked haptic applications. This paper describes a new internet protocol called Efficient Transport Protocol (ETP), which aims at developing distributed interactive applications. TCP and UDP are transport protocols commonly used in any kind of networked communication, but they are not focused on real time application. This new protocol is focused on reducing roundtrip time (RTT) and inter packet gap (IPG). ETP is, therefore, optimized for interactive applications which are based on processes that are continuously exchanging data.ETP protocol is based on a state machine that decides the best strategies for optimizing RTT and IPG. Experiments have been carried out in order to compare this new protocol and UDP