66 research outputs found

    Method to Estimate Human Inattention in Teleoperation of Mobile Robots

    Get PDF
    In teleoperation of mobile robots the operator is remotely located. As a result, generally the human perception of the remote environment is distorted affecting the mission negatively. Visual information can be degraded because of video images bandwith, time lags, frame rates, point of view and motion effects among other reasons. Although many researchers have proposed a variety of methods for measuring perception, just a few can be used in control closed loop systems. This paper aims to provide a novel metric to the human visual inattention upon risk for a remotely navigated mobile robot. We present both qualitative and quantitative guidelines for designing the metric in a teleoperation of a mobile robot. The method allows to incorporate the metric in a control closed loop system, and task consists in guiding the robot from an initial point to a final one as quick as possible, considering the constraint of avoiding collisions. Furthermore, a haptic cue based on the metric is proposed in order to help the human to avoid collisions. A system stability analysis considering time varying delays is proposed. Additionally, we present a human in the loop experiment of a teleoperation of a 3D mobile robot simulator in order to remark the advantages of using human factors in the controller.Fil: Penizzotto Bacha, Franco Victor. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico San Juan. Instituto de Automática; ArgentinaFil: Mut, Vicente Antonio. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico San Juan. Instituto de Automática; ArgentinaFil: Slawiñski, Emanuel. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico San Juan. Instituto de Automática; Argentin

    Connectivity-Preserving Swarm Teleoperation With A Tree Network

    Full text link
    During swarm teleoperation, the human operator may threaten the distance-dependent inter-robot communications and, with them, the connectivity of the slave swarm. To prevent the harmful component of the human command from disconnecting the swarm network, this paper develops a constructive strategy to dynamically modulate the interconnections of, and the locally injected damping at, all slave robots. By Lyapunov-based set invariance analysis, the explicit law for updating that control gains has been rigorously proven to synchronize the slave swarm while preserving all interaction links in the tree network. By properly limiting the impact of the user command rather than rejecting it entirely, the proposed control law enables the human operator to guide the motion of the slave swarm to the extent to which it does not endanger the connectivity of the swarm network. Experiment results demonstrate that the proposed strategy can maintain the connectivity of the tree network during swarm teleoperation

    Design and evaluation of a graphical user interface for facilitating expert knowledge transfer: a teleoperation case study

    Get PDF
    Nowadays, teleoperation systems are increasingly used for the training of specific skills to carry out complex tasks in dangerous environments. One of the challenges of these systems is to ensure that the time it takes for users to acquire these skills is as short as possible. For this, the user interface must be intuitive and easy to use. This document describes the design and evaluation of a graphical user interface so that a non-expert user could use a teleoperated system intuitively and without excessive training time. To achieve our goal, we use a user-centered design process model. To evaluate the interface, we use our own methodology and the results allow improving its usability.Peer ReviewedPostprint (author's final draft

    On the use of haptic tablets for UGV teleoperation in unstructured environments: system design and evaluation

    Get PDF
    Teleoperation of Unmanned Ground Vehicles (UGVs), particularly for inspection of unstructured and unfamiliar environments still raises important challenges from the point of view of the operator interface. One of these challenges is caused by the fact that all information available to the operator is presented to the operator through a computer interface, providing only a partial view of the robot situation. The majority of existing interfaces provide information using visual, and, less frequently, sound channels. The lack of Situation Awareness (SA), caused by this partial view, may lead to an incorrect and inefficient response to the current UGV state, usually confusing and frustrating the human operator. For instance, the UGV may become stuck in debris while the operator struggles to move the robot, not understanding the cause of the UGV lack of motion. We address this problem by studying the use of haptic feedback to improve operator SA. More precisely, improving SA with respect to the traction state of the UGV, using a haptic tablet for both commanding the robot and conveying traction state to the user by haptic feedback. We report (1) a teleoperating interface, integrating a haptic tablet with an existing UGV teleoperation interface, and (2) the experimental results of a user study designed to evaluate the advantage of this interface in the teleoperation of a UGV, in a search and rescue scenario. Statistically significant results were found supporting the hypothesis that using the haptic tablet elicits a reduction in the time that the UGV spends in states without traction.info:eu-repo/semantics/publishedVersio

    Contributions to shared control and coordination of single and multiple robots

    Get PDF
    L’ensemble des travaux présentés dans cette habilitation traite de l'interface entre un d'un opérateur humain avec un ou plusieurs robots semi-autonomes aussi connu comme le problème du « contrôle partagé ».Le premier chapitre traite de la possibilité de fournir des repères visuels / vestibulaires à un opérateur humain pour la commande à distance de robots mobiles.Le second chapitre aborde le problème, plus classique, de la mise à disposition à l’opérateur d’indices visuels ou de retour haptique pour la commande d’un ou plusieurs robots mobiles (en particulier pour les drones quadri-rotors).Le troisième chapitre se concentre sur certains des défis algorithmiques rencontrés lors de l'élaboration de techniques de coordination multi-robots.Le quatrième chapitre introduit une nouvelle conception mécanique pour un drone quadrirotor sur-actionné avec pour objectif de pouvoir, à terme, avoir 6 degrés de liberté sur une plateforme quadrirotor classique (mais sous-actionné).Enfin, le cinquième chapitre présente une cadre général pour la vision active permettant, en optimisant les mouvements de la caméra, l’optimisation en ligne des performances (en terme de vitesse de convergence et de précision finale) de processus d’estimation « basés vision »

    Using haptic feedback in human swarm interaction

    Get PDF
    A swarm of robots is a large group of individual agents that autonomously coordinate via local control laws. Their emergent behavior allows simple robots to accomplish complex tasks. Since missions may have complex objectives that change dynamically due to environmental and mission changes, human control and influence over the swarm is needed. The field of Human Swarm Interaction (HSI) is young, with few user studies, and even fewer papers focusing on giving non-visual feedback to the operator. The authors will herein present a background of haptics in robotics and swarms and two studies that explore various conditions under which haptic feedback may be useful in HSI. The overall goal of the studies is to explore the effectiveness of haptic feedback in the presence of other visual stimuli about the swarm system. The findings show that giving feedback about nearby obstacles using a haptic device can improve performance, and that a combination of feedback from obstacle forces via the visual and haptic channels provide the best performance

    Velocity control of mini-UAV using a helmet system

    No full text
    International audienceThe usage of a helmet to command a mini-unmanned aerial vehicle (mini-UAV), is a telepresence system that connects the operator to the vehicle. This paper proposes a system which remotely allows the connection of a pilot's head motion and the 3D movements of a mini-UAVs. Two velocity control algorithms have been tested in order to manipulate the system. Results demonstrate that these movements can be used as reference inputs of the controller of the mini-UAV

    Human-Robot Team Interaction Through Wearable Haptics for Cooperative Manipulation

    Get PDF
    The interaction of robot teams and single human in teleoperation scenarios is beneficial in cooperative tasks, for example the manipulation of heavy and large objects in remote or dangerous environments. The main control challenge of the interaction is its asymmetry, arising because robot teams have a relatively high number of controllable degrees of freedom compared to the human operator. Therefore, we propose a control scheme that establishes the interaction on spaces of reduced dimensionality taking into account the low number of human command and feedback signals imposed by haptic devices. We evaluate the suitability of wearable haptic fingertip devices for multi-contact teleoperation in a user study. The results show that the proposed control approach is appropriate for human-robot team interaction and that the wearable haptic fingertip devices provide suitable assistance in cooperative manipulation tasks

    Traction awareness through haptic feedback for the teleoperation of UGVs*

    Get PDF
    Teleoperation of Unmanned Ground Vehicles (UGVs) is dependent on several factors as the human operator is physically detached from the UGV. This paper focuses on situations where a UGV designed for search and rescue loses traction, thus becoming unable to comply with the operator's commands. In such situations, the lack of Situation Awareness (SA) may lead to an incorrect and inefficient response to the current UGV state usually confusing and frustrating the human operator. The exclusive use of visual information to simultaneously perform the main task (e.g. search and rescue) and to be aware of possible impediments to UGV operation, such as loss of traction, becomes a very challenging task for a single human operator. We address the challenge of unburdening the visual channel by using other human senses to provide multimodal feedback in UGV teleoperation. To achieve this goal we present a teleoperation architecture comprising (1) a laser-based traction detector module, to discriminate between traction losses (stuck and sliding) and (2) a haptic interface to convey the detected traction state to the human operator through different types of tactile stimuli provided by three haptic devices (E-Vita, Traction Cylinder and Vibrotactile Glove). We also report the experimental results of a user study to evaluate to what extent this new feedback modality improves the user SA regarding the UGV traction state. Statistically significant results were found supporting the hypothesis that two of the haptic devices improved the comprehension of the traction state of the UGV when comparing to exclusively visual modality.info:eu-repo/semantics/acceptedVersio

    Haptic Feedback Effects on Human Control of a UAV in a Remote Teleoperation Flight Task

    Get PDF
    The remote manual teleoperation of an unmanned aerial vehicle (UAV) by a human operator creates a human-in-the loop system that is of great concern. In a remote teleoperation task, a human pilot must make control decisions based upon sensory information provided by the governed system. Often, this information consists of limited visual feedback provided by onboard cameras that do not provide an operator with an accurate portrayal of their immediate surroundings compromising the safety of the mobile robot. Due to this shortfall, haptic force feedback is often provided to the human in an effort to increase their perceptual awareness of the surrounding world. To investigate the effects of this additional sensory information provided to the human op-erator, we consider two haptic force feedback strategies. They were designed to provide either an attractive force to influence control behavior towards a reference trajectory along a flight path, or a repulsive force directing operators away from obstacles to prevent collision. Subject tests were con-ducted where human operators manually operated a remote UAV through a corridor environment under the conditions of the two strategies. For comparison, the conditions of no haptic feedback and the liner combination of both attractive and repulsive strategies were included in the study. Experi-mental results dictate that haptic force feedback in general (including both attractive and repulsive force feedback) improves the average distance from surrounding obstacles up to 21%. Further statis-tical comparison of repulsive and attractive feedback modalities reveal that even though a repulsive strategy is based directly on obstacles, an attractive strategy towards a reference trajectory is more suitable across all performance metrics. To further examine the effects of haptic aides in a UAV teleoperation task, the behavior of the human system as part of the control loop was also investigated. Through a novel device placed on the end effector of the haptic device, human-haptic interaction forces were captured and further analyzed. With this information, system identification techniques were carried out to determine the plausibility of deriving a human control model for the system. By defining lateral motion as a one-dimensional compensatory tracking task the results show that general human control behavior can be identified where lead compensation in invoked to counteract second-order UAV dynamics
    corecore