Method to Estimate Human Inattention in Teleoperation of Mobile Robots

In teleoperation of mobile robots the operator is remotely located. As a result, generally the human perception of the remote environment is distorted affecting the mission negatively. Visual information can be degraded because of video images bandwith, time lags, frame rates, point of view and motion effects among other reasons. Although many researchers have proposed a variety of methods for measuring perception, just a few can be used in control closed loop systems. This paper aims to provide a novel metric to the human visual inattention upon risk for a remotely navigated mobile robot. We present both qualitative and quantitative guidelines for designing the metric in a teleoperation of a mobile robot. The method allows to incorporate the metric in a control closed loop system, and task consists in guiding the robot from an initial point to a final one as quick as possible, considering the constraint of avoiding collisions. Furthermore, a haptic cue based on the metric is proposed in order to help the human to avoid collisions. A system stability analysis considering time varying delays is proposed. Additionally, we present a human in the loop experiment of a teleoperation of a 3D mobile robot simulator in order to remark the advantages of using human factors in the controller.Fil: Penizzotto Bacha, Franco Victor. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico San Juan. Instituto de Automática; ArgentinaFil: Mut, Vicente Antonio. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico San Juan. Instituto de Automática; ArgentinaFil: Slawiñski, Emanuel. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico San Juan. Instituto de Automática; Argentin

Stable Bilateral Teleoperation Control Method for Biped Robots with Time-Varying Delays

This document proposes a control scheme applied to delayed bilateral teleoperation of the forward and turn speed of a biped robot against asymmetric and time-varying delays. This biped robot is modeled as a hybrid dynamic system because it behaves as a continuous system when the leg moves forward and discrete when the foot touches the ground generating an impulsive response. It is proposed to vary online the damping according to the time delay present in the communication channel, and the walking cycle time using an optimization criterion, to decrease the teleoperation system errors. To accomplish this, a three-phase cascade calibration process is used, and their benefits are evidenced in a comparative simulation study. The first phase is an offline calibration of the inverse dynamic compensation and also the parameters of the bilateral controller. The second phase guarantees the bilateral coordination of the delayed teleoperation system, using the Lyapunov–Krasovskii stability theory, by changing the leader damping and the equivalent follower damping together. The third phase assures a stable walk of the hybrid dynamics by controlling the walking cycle time and the real damping to move the eigenvalues of the Poincaré map, numerically computed, to stable limit cycles and link this result with an equivalent continuous system to join both phases. Additionally, a fictitious force was implemented to detect and avoid possible collisions with obstacles. Finally, an intercontinental teleoperation experiment of an NAO robot via the Internet including force and visual feedback is shown

PD-like controller with impedance for delayed bilateral teleoperation of mobile robots

This paper proposes a control scheme applied to the delayed bilateral teleoperation of mobile robots with force feedback in face of asymmetric and time-varying delays. The scheme is managed by a velocity PD-like control plus impedance and a force feedback based on damping and synchronization error. A fictitious force, depending on the robot motion and its environment, is used to avoid possible collisions. In addition, the stability of the system is analyzed from which simple conditions for the control parameters are established in order to assure stability. Finally, the performance of the delayed teleoperation system is shown through experiments where a human operator drives a mobile robot.Fil: Slawiñski, Emanuel. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico San Juan. Instituto de Automática; ArgentinaFil: García, Sebastián Ernesto. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico San Juan. Instituto de Automática; ArgentinaFil: Salinas, Lucio Rafael. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico San Juan. Instituto de Automática; ArgentinaFil: Mut, Vicente Antonio. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico San Juan. Instituto de Automática; Argentin

Intercontinental Bilateral-by-Phases Teleoperation of a Humanoid Robot

This document proposes a control scheme applied to delayed bilateral-by-phases teleoperation of the locomotion and manipulation of a humanoid robot, where each phase works depending on the decision of the human operator. Besides, balance control, adaptive controller, and force feedback are applied. The implementation is described and the results obtained from experiments of intercontinental teleoperation for a pick and place task with a NAO robot-driven at distance with a haptic device, are shown and summarized.Fil: Moya González, Viviana Isabel. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - San Juan. Instituto de Automática. Universidad Nacional de San Juan. Facultad de Ingeniería. Instituto de Automática; ArgentinaFil: Slawiñski, Emanuel. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - San Juan. Instituto de Automática. Universidad Nacional de San Juan. Facultad de Ingeniería. Instituto de Automática; ArgentinaFil: Mut, Vicente Antonio. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - San Juan. Instituto de Automática. Universidad Nacional de San Juan. Facultad de Ingeniería. Instituto de Automática; ArgentinaFil: Wagner, Bernardo. Leibniz Universitat Hannover; Alemani

Control scheme including prediction and augmented reality for teleoperation of mobile robots

This paper proposes a control scheme for the teleoperation of a mobile robot in presence of time delay. Our proposal uses a compensation of the time delay based on a human operator's model and a simple 3D augmented reality scheme; both are related through a prediction system. Unlike other strategies, the proposed scheme has a model of the human operator inside it, including his decision so that human and robot push in the same direction. The stability of the teleoperation system adding the proposed control scheme is proven concluding how the time delay changes the convergence rate and the convergence ball size. Finally, to illustrate the performance and stability of the proposed control structure, several teleoperation experiments in presence of various delays are shown.Fil: Slawiñski, Emanuel. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - San Juan. Instituto de Automática. Universidad Nacional de San Juan. Facultad de Ingeniería. Instituto de Automática; ArgentinaFil: Mut, Vicente Antonio. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - San Juan. Instituto de Automática. Universidad Nacional de San Juan. Facultad de Ingeniería. Instituto de Automática; Argentin

Delayed Bilateral Teleoperation of the Speed and Turn Angle of a Bipedal Robot

This paper proposes a shared control scheme which aims to achieve a stable control of the speed andturn of a bipedal robot during a delayed bilateral teleoperation. The strategy allows to get a delay-dependent damping value that must be injected to assure a bounded response of the hybrid system,while simultaneously, the human operator receives a force feedback that help him to decrease thesynchronism error. Furthermore, a test where a human operator handles the walking of a simulatedbipedal robot, to follow a curve path in front of varying time delay, is performed and analyzed.Fil: Moya, Viviana. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - San Juan. Instituto de Automática. Universidad Nacional de San Juan. Facultad de Ingeniería. Instituto de Automática; ArgentinaFil: Slawiñski, Emanuel. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - San Juan. Instituto de Automática. Universidad Nacional de San Juan. Facultad de Ingeniería. Instituto de Automática; ArgentinaFil: Mut, Vicente Antonio. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - San Juan. Instituto de Automática. Universidad Nacional de San Juan. Facultad de Ingeniería. Instituto de Automática; Argentin

Pd-like controllers for delayed bilateral teleoperation of manipulators robots

This paper proposes a compensated PD-like controller for delayed bilateral teleoperation of a manipulator robot. The scheme has a PD-like remote controller, a damping into the master, and a compensation strategy. The proposed compensation removes part of potential energy of the user´s command depending on the difference between the situation on the remote site and the situation as perceived by the human operator. In addition, the stability of the delayed teleoperation system is analyzed, and a comparison based on experiments is carried out in order to analyze the advantages of using the proposed compensation. Finally, results of a bilateral teleoperation including the proposed control scheme, where the master and slave exchange information by using a low-cost connection of mobile Internet, are shown.Fil: Slawiñski, Emanuel. Universidad Nacional de San Juan. Facultad de Ingeniería. Instituto de Automática; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Mut, Vicente Antonio. Universidad Nacional de San Juan. Facultad de Ingeniería. Instituto de Automática; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentin

Experiencias en teleoperación bilateral de robots

En este trabajo se presenta el diseño y desarrollo de un sistema aplicado a la teleoperación de robots a través de Internet. Además, se propone un modelo del retardo de tiempo de Internet, el cual se verifica experimentalmente a través de datos reales. Finalmente, se muestran los resultados obtenidos de experiencias en teleoperación utilizando dos robots dispuestos en ciudades diferentes (Roma y Verona, Italia) distantes en 500 Km. y vinculados vía Internet

Teleoperación Trilateral con Retardo de un Robot Móvil

This paper analyzes the stability of a trilateral teleoperation system of a mobile robot. The dynamics of two manipulator-like masters and mobile robot as well as time-varying and asymmetric delays are taken into account. A set of P+d controllers is included into the delayed teleoperation system. From the analysis performed, a procedure to set the control parameters is proposed in order to assure the stability of the whole system. Finally, the theoretical result is verified in practice by means of a simple test about delayed trilateral teleoperation system, where two human operators both collaboratively and simultaneously drive a 3D simulator of a mobile robot to achieve an established task on a remote environment.Este artículo analiza la estabilidad de un sistema de teleoperación trilateral de un robot móvil. La dinámica de dos manipuladores maestros de estructura similar y un robot móvil, asimismo se tienen en cuenta retrasos variables en el tiempo y asimétricos. Un conjunto de controladores P + D se incluyen en el sistema de teleoperación con retardo. A partir del análisis realizado, se propone un procedimiento para establecer los parámetros de control con el fin de asegurar la estabilidad del sistema. Finalmente, el resultado teórico es verificado en la práctica por medio de pruebas sobre el sistema de teleoperación trilateral con retardo donde dos operadores humanos en colaboración y simultáneamente para conducen en un simulador 3D un robot móvil para alcanzar una tarea establecida en un entorno remoto