Delay compensation for nonlinear teleoperators using predictor observers

This paper presents a delay compensation technique for nonlinear teleoperators by developing a predictor type sliding mode observer (SMO) that estimates future states of the slave operator. Predicted states are then used in control formulation. In the proposed scheme, disturbance observers (DOB) are also utilized to linearize nonlinear dynamics of the master and slave operators. It is shown that utilization of disturbance observers and predictor observer allow simple PD controllers to be used to provide stable position tracking for bilateral teleoperation. Proposed approach is verified with simulations where it is compared with two state-of-the-art methods. Successful experimental results with a bilateral teleoperation system consisting of a pair of pantograph robots also validates the proposed method

Teleoperation of passivity-based model reference robust control over the internet

This dissertation offers a survey of a known theoretical approach and novel experimental results in establishing a live communication medium through the internet to host a virtual communication environment for use in Passivity-Based Model Reference Robust Control systems with delays. The controller which is used as a carrier to support a robust communication between input-to-state stability is designed as a control strategy that passively compensates for position errors that arise during contact tasks and strives to achieve delay-independent stability for controlling of aircrafts or other mobile objects. Furthermore the controller is used for nonlinear systems, coordination of multiple agents, bilateral teleoperation, and collision avoidance thus maintaining a communication link with an upper bound of constant delay is crucial for robustness and stability of the overall system. For utilizing such framework an elucidation can be formulated by preparing site survey for analyzing not only the geographical distances separating the nodes in which the teleoperation will occur but also the communication parameters that define the virtual topography that the data will travel through. This survey will first define the feasibility of the overall operation since the teleoperation will be used to sustain a delay based controller over the internet thus obtaining a hypothetical upper bound for the delay via site survey is crucial not only for the communication system but also the delay is required for the design of the passivity-based model reference robust control. Following delay calculation and measurement via site survey, bandwidth tests for unidirectional and bidirectional communication is inspected to ensure that the speed is viable to maintain a real-time connection. Furthermore from obtaining the results it becomes crucial to measure the consistency of the delay throughout a sampled period to guarantee that the upper bound is not breached at any point within the communication to jeopardize the robustness of the controller. Following delay analysis a geographical and topological overview of the communication is also briefly examined via a trace-route to understand the underlying nodes and their contribution to the delay and round-trip consistency. To accommodate the communication channel for the controller the input and output data from both nodes need to be encapsulated within a transmission control protocol via a multithreaded design of a robust program within the C language. The program will construct a multithreaded client-server relationship in which the control data is transmitted. For added stability and higher level of security the channel is then encapsulated via an internet protocol security by utilizing a protocol suite for protecting the communication by authentication and encrypting each packet of the session using negotiation of cryptographic keys during each session

Network Latency in Teleoperation of Connected and Autonomous Vehicles:A Review of Trends, Challenges, and Mitigation Strategies

With remarkable advancements in the development of connected and autonomous vehicles (CAVs), the integration of teleoperation has become crucial for improving safety and operational efficiency. However, teleoperation faces substantial challenges, with network latency being a critical factor influencing its performance. This survey paper explores the impact of network latency along with state-of-the-art mitigation/compensation approaches. It examines cascading effects on teleoperation communication links (i.e., uplink and downlink) and how delays in data transmission affect the real-time perception and decision-making of operators. By elucidating the challenges and available mitigation strategies, the paper offers valuable insights for researchers, engineers, and practitioners working towards the seamless integration of teleoperation in the evolving landscape of CAVs

Stabilization and control of teleoperation systems with time delays

A control scheme for teleoperation systems with time delay is developed based on the concept of passivity. This control method requires neither detailed knowledge of the manipulator systems nor the mathematical models of the environments, and it is applicable for any time delays. The main contribution of this method is that it is less conservative than the traditional passivity based method. In this method, the passivity controller only operates when the system loses passivity, while in a traditional passivity formulation, the controller works at all times during operation and thus adversely affect the performance of the system.;Using the proposed control scheme, a sub-system is defined that is composed of the communication channel, slave robot and the manipulated environment. This sub system is treated as a one-port network component, and passivity theory is applied to this component to assure stability. The energy flowing into the one-port network, in the form of the control command and the force feedback, is monitored. A passivity regulator is activated to maintain the passivity of the network by modifying the feedback force to the master, and thus adjust the energy exchange between the master and the communication channel.;When this method is applied, only the information at the interface between the master manipulator and the communication channel is collected and observed, there is no need for accurate or detailed knowledge of the structure or timing of the communication channel. The method can make the system lossless regardless of the feedback force, the coordinating force controlling the slave joint motions or the contact force. The approach can stabilize the system regardless of the time delay, discontinuities with environmental contact, or discretization of the physical plant. It will pose no problem when the environmental contact force is directly fed back. The results of this work show that it is advantageous to use the measured environmental force as the feedback, providing superior performance for free motion and more realistic haptic feedback for the operator from the remote environment.;Simulation and experimental results are presented to verify the proposed control scheme

Robust adaptive synchronisation of a single-master multi-slave teleoperation system over delayed communication

Considering communication delays in networked multi-robot teleoperation systems, this paper proposes a new control strategy for synchronisation and stability purposes. A single-master and multi-slave (SMMS) networked robotic teleoperation system is considered. Based on a sliding surface combined with a smooth filtering and estimation methodology, a robust adaptive control is developed to guarantee the synchronisation and stability of the system in the presence of network-induced time-varying delays. Extensive simulation studies demonstrate the effectiveness of the developed control scheme

Efficient Transport Protocol for Networked Haptics Applications

The performance of haptic application is highly sensitive to communication delays and losses of data. It implies several constraints in developing networked haptic applications. This paper describes a new internet protocol called Efficient Transport Protocol (ETP), which aims at developing distributed interactive applications. TCP and UDP are transport protocols commonly used in any kind of networked communication, but they are not focused on real time application. This new protocol is focused on reducing roundtrip time (RTT) and inter packet gap (IPG). ETP is, therefore, optimized for interactive applications which are based on processes that are continuously exchanging data.ETP protocol is based on a state machine that decides the best strategies for optimizing RTT and IPG. Experiments have been carried out in order to compare this new protocol and UDP

A Novel Predictor Based Framework to Improve Mobility of High Speed Teleoperated Unmanned Ground Vehicles

Teleoperated Unmanned Ground Vehicles (UGVs) have been widely used in applications when driver safety, mission eciency or mission cost is a major concern. One major challenge with teleoperating a UGV is that communication delays can significantly affect the mobility performance of the vehicle and make teleoperated driving tasks very challenging especially at high speeds. In this dissertation, a predictor based framework with predictors in a new form and a blended architecture are developed to compensate effects of delays through signal prediction, thereby improving vehicle mobility performance. The novelty of the framework is that minimal information about the governing equations of the system is required to compensate delays and, thus, the prediction is robust to modeling errors. This dissertation first investigates a model-free solution and develops a predictor that does not require information about the vehicle dynamics or human operators' motion for prediction. Compared to the existing model-free methods, neither assumptions about the particular way the vehicle moves, nor knowledge about the noise characteristics that drive the existing predictive filters are needed. Its stability and performance are studied and a predictor design procedure is presented. Secondly, a blended architecture is developed to blend the outputs of the model-free predictor with those of a steering feedforward loop that relies on minimal information about vehicle lateral response. Better prediction accuracy is observed based on open-loop virtual testing with the blended architecture compared to using either the model-free predictors or the model-based feedforward loop alone. The mobility performance of teleoperated vehicles with delays and the predictor based framework are evaluated in this dissertation with human-in-the-loop experiments using both simulated and physical vehicles in teleoperation mode. Predictor based framework is shown to provide a statistically significant improvement in vehicle mobility and drivability in the experiments performed.PHDMechanical EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttps://deepblue.lib.umich.edu/bitstream/2027.42/146026/1/zhengys_1.pd