A Wave Variable Approach with Multiple Channel Architecture for Teleoperated System

© 2013 IEEE. Performance of teleoperation can be greatly influenced by time delay in the process of tele-manipulation with respect to accuracy and transparency. Wave variable is an effective algorithm to achieve a good stable capability. However, some traditional wave variable methods may decrease the performance of transparency and suffer the impacts of wave reflection. To deal with the problem of stability and transparency in teleoperation, in this paper, a novel wave variable method with four channel is presented to achieve stable tracking in position and force. In addition, the proposed method can achieve the distortion compensation and reduce the impacts of wave reflection. The simulation experimental results verified the tracking performance of the proposed method

Position referenced force augmentation in teleoperated hydraulic manipulators operating under delayed and lossy networks: a pilot study.

Position error between motions of the master and slave end-effectors is inevitable as it originates from hard-to-avoid imperfections in controller design and model uncertainty. Moreover, when a slave manipulator is controlled through a delayed and lossy communication channel, the error between the desired motion originating from the master device and the actual movement of the slave manipulator end-effector is further exacerbated. This paper introduces a force feedback scheme to alleviate this problem by simply guiding the operator to slow down the haptic device motion and, in turn, allows the slave manipulator to follow the desired trajectory closely. Using this scheme, the master haptic device generates a force, which is proportional to the position error at the slave end-effector, and opposite to the operator's intended motion at the master site. Indeed, this force is a signal or cue to the operator for reducing the hand speed when position error, due to delayed and lossy network, appears at the slave site. Effectiveness of the proposed scheme is validated by performing experiments on a hydraulic telemanipulator setup developed for performing live-line maintenance. Experiments are conducted when the system operates under both dedicated and wireless networks. Results show that the scheme performs well in reducing the position error between the haptic device and the slave end-effector. Specifically, by utilizing the proposed force, the mean position error, for the case presented here, reduces by at least 92% as compared to the condition without the proposed force augmentation scheme. The scheme is easy to implement, as the only required on-line measurement is the angular displacement of the slave manipulator joints

Experimental Evaluation of Novel Master-Slave Configurations for Position Control under Random Network Delay and Variable Load for Teleoperation

This paper proposes two novel master-slave configurations that provide improvements in both control and communication aspects of teleoperation systems to achieve an overall improved performance in position control. The proposed novel master-slave configurations integrate modular control and communication approaches, consisting of a delay regulator to address problems related to variable network delay common to such systems, and a model tracking control that runs on the slave side for the compensation of uncertainties and model mismatch on the slave side. One of the configurations uses a sliding mode observer and the other one uses a modified Smith predictor scheme on the master side to ensure position transparency between the master and slave, while reference tracking of the slave is ensured by a proportional-differentiator type controller in both configurations. Experiments conducted for the networked position control of a single-link arm under system uncertainties and randomly varying network delays demonstrate significant performance improvements with both configurations over the past literature

Delay compensation in bilateral teleoperation using predictor observers

Destabilization and performance degradation problems caused by the time delay in communication channel is a serious problem in bilateral teleoperation. In particular, variability of the delay due to limited bandwidth, long distance or congestion in transmission problems has been a real challenge in bilateral teleoperation research since the internet communication has become prevalent. Many existing delay compensation techniques are designed for linear teleoperator systems. In order to implement them on real bilateral systems, the nonlinear dynamics of the robots must first be linearized. For this purpose feedback linearization is usually employed. In this thesis, the delay compensation problem is tackled in an observer framework by designing two observers. Integration of a disturbance observer to the slave side implies a linearized slave dynamics with nominal parameters. Disturbance observer estimates the total disturbance (nonlinear terms, parametric uncertainties and external disturbances) on the slave system. A second observer is designed at the master side to predict states of the slave. This observer can be designed using a variety of linear or nonlinear methods. In order to have finite-time convergence, a sliding mode observer is designed at the master side. It is shown that this observer predicts the future positions and/or velocities of the slave and use of such predictions in the computation of a simple PD control law implies stable operation for the bilateral system. Since the disturbance observer increases the robustness of the slave system, the performance of the resulting bilateral system is quite satisfactory. Force reflecting bilateral teleoperation is also considered in this thesis. Integrating the proposed observer based delay compensation technique into the well known four-channel control architecture not only stable but also transparent bilateral teleoperation is achieved. Simulations with bilateral systems consisting of 2 DOF scara robots and pantograph robots, and experiments with bilateral systems consisting of a pair of single link robots and a pair of pantograph robots validate the proposed method

Network Latency in Teleoperation of Connected and Autonomous Vehicles:A Review of Trends, Challenges, and Mitigation Strategies

With remarkable advancements in the development of connected and autonomous vehicles (CAVs), the integration of teleoperation has become crucial for improving safety and operational efficiency. However, teleoperation faces substantial challenges, with network latency being a critical factor influencing its performance. This survey paper explores the impact of network latency along with state-of-the-art mitigation/compensation approaches. It examines cascading effects on teleoperation communication links (i.e., uplink and downlink) and how delays in data transmission affect the real-time perception and decision-making of operators. By elucidating the challenges and available mitigation strategies, the paper offers valuable insights for researchers, engineers, and practitioners working towards the seamless integration of teleoperation in the evolving landscape of CAVs

Multilateral teleoperation over communication time delay using the time-domain passivity approach

A general framework to stabilize multilateral teleoperation system over a communication time delay based on the well-known time-domain passivity approach (TDPA) is proposed. The uniqueness of this framework is that it is independent of the amount of communication time delay, the multilateral control architecture, and the number of masters and slaves. The multilateral system was first decoupled into subsystems with respect to each terminal by identifying the input signals' contributions to the output terminals, which was not straightforward due to the coupled nature of the multilateral teleoperation system. The decoupled subsystems were then converted into an electrical circuit using a mechanical-electrical analogy. Time-delay power network (TDPN) was introduced to clarify active energy sources from the time delay and passivity observer/passivity controller (PO/PC) was utilized to dissipate those active energies. A less-conservative method compared with prior work was proposed to guarantee the stability. Experiments with a trilateral teleoperation system and with a multilateral teleoperation system with a dual master and dual slave were conducted to validate the proposed framework

An observer based approach to force reflecting bilateral teleoperation

Bilateral teleoperation systems are an active area of research with possible applications in healthcare, remote surveillance and military, space and underwater operations, allowing human operators to manipulate remote systems and feel environment forces to achieve telepresence. The physical distance between the local and remote systems introduces delay to the exchanged signals between the two and cause instability in the bilateral teleoperation. With the advent of the internet, possible applications of bilateral teleoperation systems have proliferated, growing the interest and amount of research in the field. The delay compensation method for stable and force reflecting teleoperation proposed in this thesis is based on utilization of three different types of observers: A novel predictor observer that estimates the undelayed states of the remote system based on a nominal model, disturbance observers that eliminate internal and external disturbances and linearize the nonlinear dynamics of the two systems, and reaction torque observers that estimate the net external forces on the two systems. The controller for the remote system is placed at the local site, along with the predictor observer and the control input is sent to the remote system through the communication channel. Force reflection is achieved using a modified version of the 4-channel architecture where control input and position of the remote system and the environment force estimations are exchanged between the two systems. Performance of the proposed method is tested with Matlab/Simulink simulations and compared to two other methods in the literature. Real-time experiments under variable communication delay are also performed where the delay is both artificially created using Matlab/Simulink blocks and obtained via the internet by bouncing signals off a remote computer outside the Sabancı University campus. Both the simulations and experiments are executed on a pair of 1-DOF robot arms and a pair of 2-DOF pantograph robots. The results show that stable and force reflecting teleoperation is achieved with successful tracking performances of the remote system

Posture-Dependent Projection-Based Force Reflection Algorithms for Bilateral Teleoperators

It was previously established that the projection-based force reflection (PBFR) algorithms improve the overall stability of a force reflecting teleoperation system. The idea behind the PBFR algorithms is to identify the component of the reflected force which is compensated by interaction with the operator\u27s hand, and subsequently attenuate the residual component of the reflected force. If there is no a priori information regarding the behaviour of the human operator, the PBFR gain is selected equal to sufficiently small constant in order to guarantee stability for a wide range of human operator responses. Small PBRF gains, however, may deteriorate the transparency of a teleoperator system. In this thesis, a new method for selecting the PBFR gain is introduced which depends on human postures. Using an online human posture estimation, the introduced posture-dependent PBFR algorithm has been applied to a teleoperation system with force feedback. It is experimentally demonstrated that the developed method for selection of the PBFR gain based on human postures improves the transparency of the teleoperator system while the stability is preserved. Finally, preliminary results that deal with an extension of the developed methods towards a more realistic model of the human arm with 4 degrees of freedom and three dimensional movements are presented

Haptic Effects of Surgical Teleoperator Flexibility

Minimally invasive surgery systems typically involve thin and cable-driven surgical instruments. This introduces link and joint flexibility in the slave robot of a master-slave teleoperation system, reducing the effective stiffness of the slave and the transparency of teleoperation. In this paper, we analyze transparency under slave link and joint flexibility (tool flexibility). We also evaluate the added benefits of using extra sensors at the tip of the flexible robot. It is shown that tip velocity (or position) feedback improves free-space position tracking performance in the presence of robot flexibility. Also, when the interaction forces with an environment are measured by a force sensor and fed back to the user’s hand, tip velocity feedback improves hard-contact force tracking performance. During a hard contact task, tip velocity feedback can also eliminate the transmission of robot flexibility to the user’s hand. Parts of this research have previously been published as M. Tavakoli, R.D. Howe, The Effect of Joint Elasticity on Bilateral Teleoperation, In Proceedings of the 2007 IEEE/RSJ International Conference on Intelligent Robots & Systems, pp. 1618-1623, San Diego, CA, 2007, and as M. Tavakoli, R.D. Howe, Haptic Implications of Tool Flexibility in Surgical Teleoperation, In Proceedings of the 16th Symposium on Haptic Interfaces for Virtual Environments & Teleoperator Systems, pp. 377-378, Reno, NV, March 2008.Engineering and Applied Science