Bilateral Teleoperation of Mobile Robot over Delayed Communication Network: Implementation

In a previous paper we proposed a bilateral teleoperation framework of a wheeled mobile robot over communication channel with constant time delay. In this paper we present experimental results. Our goal is to illustrate and validate the properties of the proposed scheme as well as to present practical implementation issues and the adopted solutions. In particular, the bilaterally teleoperated system is passive and the system is stable in the presence of time delay. Internet has been used as the communication channel and a buffer has been implemented to maintain a constant time delay and to handle packet order

Haptic Tele-operation of Wheeled Mobile Robot and Unmanned Aerial Vehicle over the Internet

Teleoperation of ground/aerial vehicle extends operator\u27s ability (e.g. expertise, strength, mobility) into the remote environment, and haptic feedback enhances the human operator\u27s perception of the slave environment. In my thesis, two cases are studied: wheeled mobile robot (MWR) haptic tele-driving over the Internet and unmanned aerial vehicle (UAV) haptic teleoperation over the Internet. We propose novel control frameworks for both dynamic WMR and kinematic WMR in various tele-driving modes, and for a mixed UAV with translational dynamics and attitude kinematics. The recently proposed passive set-position modulation (PSPM) framework is extended to guarantee the passivity and/or stability of the closed-loop system with time-varying/packet-loss in the communication; and proved performance in steady state is shown by theoretical measurements.For UAV teleoperation, we also derive a backstepping trajectory tracking control with robustness analysis. Experimental results for dynamic/kinematic WMR and an indoor quadrotor-type UAV are presented to show the efficacy of the proposed control framework

Method to Estimate Human Inattention in Teleoperation of Mobile Robots

In teleoperation of mobile robots the operator is remotely located. As a result, generally the human perception of the remote environment is distorted affecting the mission negatively. Visual information can be degraded because of video images bandwith, time lags, frame rates, point of view and motion effects among other reasons. Although many researchers have proposed a variety of methods for measuring perception, just a few can be used in control closed loop systems. This paper aims to provide a novel metric to the human visual inattention upon risk for a remotely navigated mobile robot. We present both qualitative and quantitative guidelines for designing the metric in a teleoperation of a mobile robot. The method allows to incorporate the metric in a control closed loop system, and task consists in guiding the robot from an initial point to a final one as quick as possible, considering the constraint of avoiding collisions. Furthermore, a haptic cue based on the metric is proposed in order to help the human to avoid collisions. A system stability analysis considering time varying delays is proposed. Additionally, we present a human in the loop experiment of a teleoperation of a 3D mobile robot simulator in order to remark the advantages of using human factors in the controller.Fil: Penizzotto Bacha, Franco Victor. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico San Juan. Instituto de Automática; ArgentinaFil: Mut, Vicente Antonio. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico San Juan. Instituto de Automática; ArgentinaFil: Slawiñski, Emanuel. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico San Juan. Instituto de Automática; Argentin

Comparison of Semi-autonomous Mobile Robot Control Strategies in Presence of Large Delay Fluctuation

We propose semi-autonomous control strategies to assist in the teleoperation of mobile robots under unstable communication conditions. A short-term autonomous control system is the assistance in the semi-autonomous control strategies, when the teleoperation is compromised. The short-term autonomous control comprises of lateral and longitudinal functions. The lateral control is based on an artificial potential field method where obstacles are repulsive, and a route is attractive. LiDAR-based artificial potential field methods are well studied. We present a novel artificial potential field method based on color and depth images. Benefit of a camera system compared to a LiDAR is that a camera detects color, is cheaper, and does not have moving parts. Moreover, utilization of active sensors is not desired in the particle accelerator environment. A set of experiments with a robot prototype are carried out to validate this system. The experiments are carried out in an environment which mimics the accelerator tunnel environment. The difficulty of the teleoperation is altered with obstacles. Fully manual and autonomous control are compared with the proposed semi-autonomous control strategies. The results show that the teleoperation is improved with autonomous, delay-dependent, and control-dependent assist compared to the fully manual control. Based on the operation time, control-dependent assist performed the best, reducing the time by 12% on the tunnel section with most obstacles. The presented system can be easily applied to common industrial robots operating e.g. in warehouses or factories due to hardware simplicity and light computational demand.Peer reviewe

A study on selecting the method of constructing the information to be exchanged in unlimited-workspace bilateral teleoperation

In this paper, a study on selecting the mapping method for information exchange in unlimitedworkspace teleoperation is presented. In spite the fact that in most of the bilateral teleoperation systems, the master system sends motion demands and receives interaction force from the slave system, the information to be exchanged through the communication line between master and slave is selected to be force in both directions in this study. This approach is expected to ease the navigation of the user when a limited-workspace master system is used to control an unlimited-workspace slave system. As the unlimited-workspace slave system, a virtual flying scalpel is used and human skin is modeled to represent the environment around the slave system. Two methods of constructing force information, or in other words, information mapping between the two systems, are developed and evaluated via user studies. However, one of them comes out to provide acceptable results in the selected unlimited-workspace teleoperation task. Experimental results for the method that provides acceptable results are presented

Supervising Remote Humanoids Across Intermediate Time Delay

The President's Vision for Space Exploration, laid out in 2004, relies heavily upon robotic exploration of the lunar surface in early phases of the program. Prior to the arrival of astronauts on the lunar surface, these robots will be required to be controlled across space and time, posing a considerable challenge for traditional telepresence techniques. Because time delays will be measured in seconds, not minutes as is the case for Mars Exploration, uploading the plan for a day seems excessive. An approach for controlling humanoids under intermediate time delay is presented. This approach uses software running within a ground control cockpit to predict an immersed robot supervisor's motions which the remote humanoid autonomously executes. Initial results are presented

Toward safe and stable time-delayed mobile robot teleoperation through sampling-based path planning

This work proposes a teleoperation architecture for mobile robots in partially unknown environments under the presence of variable time delay. The system is provided with artificial intelligence represented by a probabilistic path planner that, in combination with a prediction module, assists the operator while guaranteeing a collision-free motion. For this purpose, a certain level of autonomy is given to the system. The structure was tested in indoor environments for different kinds of operators. A maximum time delay of 2s was successfully coped with. © 2011 Cambridge University Press

A Novel Predictor Based Framework to Improve Mobility of High Speed Teleoperated Unmanned Ground Vehicles

Teleoperated Unmanned Ground Vehicles (UGVs) have been widely used in applications when driver safety, mission eciency or mission cost is a major concern. One major challenge with teleoperating a UGV is that communication delays can significantly affect the mobility performance of the vehicle and make teleoperated driving tasks very challenging especially at high speeds. In this dissertation, a predictor based framework with predictors in a new form and a blended architecture are developed to compensate effects of delays through signal prediction, thereby improving vehicle mobility performance. The novelty of the framework is that minimal information about the governing equations of the system is required to compensate delays and, thus, the prediction is robust to modeling errors. This dissertation first investigates a model-free solution and develops a predictor that does not require information about the vehicle dynamics or human operators' motion for prediction. Compared to the existing model-free methods, neither assumptions about the particular way the vehicle moves, nor knowledge about the noise characteristics that drive the existing predictive filters are needed. Its stability and performance are studied and a predictor design procedure is presented. Secondly, a blended architecture is developed to blend the outputs of the model-free predictor with those of a steering feedforward loop that relies on minimal information about vehicle lateral response. Better prediction accuracy is observed based on open-loop virtual testing with the blended architecture compared to using either the model-free predictors or the model-based feedforward loop alone. The mobility performance of teleoperated vehicles with delays and the predictor based framework are evaluated in this dissertation with human-in-the-loop experiments using both simulated and physical vehicles in teleoperation mode. Predictor based framework is shown to provide a statistically significant improvement in vehicle mobility and drivability in the experiments performed.PHDMechanical EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttps://deepblue.lib.umich.edu/bitstream/2027.42/146026/1/zhengys_1.pd