A Tele-Operated Display With a Predictive Display Algorithm

Tele-operated display systems with head mounted displays (HMD) are becoming popular as visual feedback systems for tele-operation systems. However, the users are suffered from time-varying bidirectional delays caused by the latency and limited bandwidth of wireless communication networks. Here, we develop a tele-operated display system and a predictive display algorithm allowing comfortable use of HMDs by operators of tele-operation systems. Inspired by the kinematic model of the human head-neck complex, we built a robot neck-camera system to capture the field of view in any desired orientation. To reduce the negative effects of the time-varying bidirectional communication delay and operation delay of the robot neck, we developed a predictive display algorithm based on a kinematic model of the human/robot neck-camera system, and a geometrical model of a camera. Experimental results showed that the system provide predicted images with high frame rate to the user

Teleoperation of passivity-based model reference robust control over the internet

This dissertation offers a survey of a known theoretical approach and novel experimental results in establishing a live communication medium through the internet to host a virtual communication environment for use in Passivity-Based Model Reference Robust Control systems with delays. The controller which is used as a carrier to support a robust communication between input-to-state stability is designed as a control strategy that passively compensates for position errors that arise during contact tasks and strives to achieve delay-independent stability for controlling of aircrafts or other mobile objects. Furthermore the controller is used for nonlinear systems, coordination of multiple agents, bilateral teleoperation, and collision avoidance thus maintaining a communication link with an upper bound of constant delay is crucial for robustness and stability of the overall system. For utilizing such framework an elucidation can be formulated by preparing site survey for analyzing not only the geographical distances separating the nodes in which the teleoperation will occur but also the communication parameters that define the virtual topography that the data will travel through. This survey will first define the feasibility of the overall operation since the teleoperation will be used to sustain a delay based controller over the internet thus obtaining a hypothetical upper bound for the delay via site survey is crucial not only for the communication system but also the delay is required for the design of the passivity-based model reference robust control. Following delay calculation and measurement via site survey, bandwidth tests for unidirectional and bidirectional communication is inspected to ensure that the speed is viable to maintain a real-time connection. Furthermore from obtaining the results it becomes crucial to measure the consistency of the delay throughout a sampled period to guarantee that the upper bound is not breached at any point within the communication to jeopardize the robustness of the controller. Following delay analysis a geographical and topological overview of the communication is also briefly examined via a trace-route to understand the underlying nodes and their contribution to the delay and round-trip consistency. To accommodate the communication channel for the controller the input and output data from both nodes need to be encapsulated within a transmission control protocol via a multithreaded design of a robust program within the C language. The program will construct a multithreaded client-server relationship in which the control data is transmitted. For added stability and higher level of security the channel is then encapsulated via an internet protocol security by utilizing a protocol suite for protecting the communication by authentication and encrypting each packet of the session using negotiation of cryptographic keys during each session

Predictive input delay compensation for motion control systems

This paper presents an analytical approach for the prediction of future motion to be used in input delay compensation of time-delayed motion control systems. The method makes use of the current and previous input values given to a nominally behaving system in order to realize the prediction of the future motion of that system. The generation of the future input is made through an integration which is realized in discrete time setting. Once the future input signal is created, it is used as the reference input of the remote system to enforce an input time delayed system, conduct a delay-free motion. Following the theoretical formulation, the proposed method is tested in experiments and the validity of the approach is verified

Delay compensation for nonlinear teleoperators using predictor observers

This paper presents a delay compensation technique for nonlinear teleoperators by developing a predictor type sliding mode observer (SMO) that estimates future states of the slave operator. Predicted states are then used in control formulation. In the proposed scheme, disturbance observers (DOB) are also utilized to linearize nonlinear dynamics of the master and slave operators. It is shown that utilization of disturbance observers and predictor observer allow simple PD controllers to be used to provide stable position tracking for bilateral teleoperation. Proposed approach is verified with simulations where it is compared with two state-of-the-art methods. Successful experimental results with a bilateral teleoperation system consisting of a pair of pantograph robots also validates the proposed method