A teleoperation framework for mobile robots based on shared control

Mobile robots can complete a task in cooperation with a human partner. In this paper, a hybrid shared control method for a mobile robot with omnidirectional wheels is proposed. A human partner utilizes a six degrees of freedom haptic device and electromyography (EMG) signals sensor to control the mobile robot. A hybrid shared control approach based on EMG and artificial potential field is exploited to avoid obstacles according to the repulsive force and attractive force and to enhance the human perception of the remote environment based on force feedback of the mobile platform. This shared control method enables the human partner to tele-control the mobile robot’s motion and achieve obstacles avoidance synchronously. Compared with conventional shared control methods, this proposed one provides a force feedback based on muscle activation and drives the human partners to update their control intention with predictability. Experimental results demonstrate the enhanced performance of the mobile robots in comparison with the methods in the literature

Measuring the impact of haptic feedback in collaborative robotic scenarios

[EN] In recent years, the interaction of a human operator with teleoperated robotic systems has been much improved. One of the factors influencing this improvement is the addition of force feedback to complement the visual feedback provided by traditional graphical user interfaces. However, the users of these systems performing tasks in isolated and safe environments are often inexperienced and occasional users. In addition, there is no common framework to assess the usability of these systems, due to the heterogeneity of applications and tasks, and therefore, there is a need for new usability assessment methods that are not domain specific. This study addresses this issue by proposing a measure of usability that includes five variables: user efficiency, user effectiveness, mental workload, perceived usefulness, and perceived ease of use. The empirical analysis shows that the integration of haptic feedback improves the usability of these systems for non-expert users, even though the differences are not statistically significant; further, the results suggest that mental workload is higher when haptic feedback is added. The analysis also reveals significant differences between participants depending on gender.SIPublicación en abierto financiada por el Consorcio de Bibliotecas Universitarias de Castilla y León (BUCLE), con cargo al Programa Operativo 2014ES16RFOP009 FEDER 2014-2020 DE CASTILLA Y LEÓN, Actuación:20007-CL - Apoyo Consorcio BUCL

On the use of haptic tablets for UGV teleoperation in unstructured environments: system design and evaluation

Teleoperation of Unmanned Ground Vehicles (UGVs), particularly for inspection of unstructured and unfamiliar environments still raises important challenges from the point of view of the operator interface. One of these challenges is caused by the fact that all information available to the operator is presented to the operator through a computer interface, providing only a partial view of the robot situation. The majority of existing interfaces provide information using visual, and, less frequently, sound channels. The lack of Situation Awareness (SA), caused by this partial view, may lead to an incorrect and inefficient response to the current UGV state, usually confusing and frustrating the human operator. For instance, the UGV may become stuck in debris while the operator struggles to move the robot, not understanding the cause of the UGV lack of motion. We address this problem by studying the use of haptic feedback to improve operator SA. More precisely, improving SA with respect to the traction state of the UGV, using a haptic tablet for both commanding the robot and conveying traction state to the user by haptic feedback. We report (1) a teleoperating interface, integrating a haptic tablet with an existing UGV teleoperation interface, and (2) the experimental results of a user study designed to evaluate the advantage of this interface in the teleoperation of a UGV, in a search and rescue scenario. Statistically significant results were found supporting the hypothesis that using the haptic tablet elicits a reduction in the time that the UGV spends in states without traction.info:eu-repo/semantics/publishedVersio

Using haptic feedback in human swarm interaction

A swarm of robots is a large group of individual agents that autonomously coordinate via local control laws. Their emergent behavior allows simple robots to accomplish complex tasks. Since missions may have complex objectives that change dynamically due to environmental and mission changes, human control and influence over the swarm is needed. The field of Human Swarm Interaction (HSI) is young, with few user studies, and even fewer papers focusing on giving non-visual feedback to the operator. The authors will herein present a background of haptics in robotics and swarms and two studies that explore various conditions under which haptic feedback may be useful in HSI. The overall goal of the studies is to explore the effectiveness of haptic feedback in the presence of other visual stimuli about the swarm system. The findings show that giving feedback about nearby obstacles using a haptic device can improve performance, and that a combination of feedback from obstacle forces via the visual and haptic channels provide the best performance

Trust-Based Control of (Semi)Autonomous Mobile Robotic Systems

Despite great achievements made in (semi)autonomous robotic systems, human participa-tion is still an essential part, especially for decision-making about the autonomy allocation of robots in complex and uncertain environments. However, human decisions may not be optimal due to limited cognitive capacities and subjective human factors. In human-robot interaction (HRI), trust is a major factor that determines humans use of autonomy. Over/under trust may lead to dispro-portionate autonomy allocation, resulting in decreased task performance and/or increased human workload. In this work, we develop automated decision-making aids utilizing computational trust models to help human operators achieve a more effective and unbiased allocation. Our proposed decision aids resemble the way that humans make an autonomy allocation decision, however, are unbiased and aim to reduce human workload, improve the overall performance, and result in higher acceptance by a human. We consider two types of autonomy control schemes for (semi)autonomous mobile robotic systems. The first type is a two-level control scheme which includes switches between either manual or autonomous control modes. For this type, we propose automated decision aids via a computational trust and self-confidence model. We provide analytical tools to investigate the steady-state effects of the proposed autonomy allocation scheme on robot performance and human workload. We also develop an autonomous decision pattern correction algorithm using a nonlinear model predictive control to help the human gradually adapt to a better allocation pattern. The second type is a mixed-initiative bilateral teleoperation control scheme which requires mixing of autonomous and manual control. For this type, we utilize computational two-way trust models. Here, mixed-initiative is enabled by scaling the manual and autonomous control inputs with a function of computational human-to-robot trust. The haptic force feedback cue sent by the robot is dynamically scaled with a function of computational robot-to-human trust to reduce humans physical workload. Using the proposed control schemes, our human-in-the-loop tests show that the trust-based automated decision aids generally improve the overall robot performance and reduce the operator workload compared to a manual allocation scheme. The proposed decision aids are also generally preferred and trusted by the participants. Finally, the trust-based control schemes are extended to the single-operator-multi-robot applications. A theoretical control framework is developed for these applications and the stability and convergence issues under the switching scheme between different robots are addressed via passivity based measures

PD-like controller with impedance for delayed bilateral teleoperation of mobile robots

This paper proposes a control scheme applied to the delayed bilateral teleoperation of mobile robots with force feedback in face of asymmetric and time-varying delays. The scheme is managed by a velocity PD-like control plus impedance and a force feedback based on damping and synchronization error. A fictitious force, depending on the robot motion and its environment, is used to avoid possible collisions. In addition, the stability of the system is analyzed from which simple conditions for the control parameters are established in order to assure stability. Finally, the performance of the delayed teleoperation system is shown through experiments where a human operator drives a mobile robot.Fil: Slawiñski, Emanuel. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico San Juan. Instituto de Automática; ArgentinaFil: García, Sebastián Ernesto. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico San Juan. Instituto de Automática; ArgentinaFil: Salinas, Lucio Rafael. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico San Juan. Instituto de Automática; ArgentinaFil: Mut, Vicente Antonio. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico San Juan. Instituto de Automática; Argentin

Position and Velocity Control for Telemanipulation with Interoperability Protocol

International audienceIn this paper we describe how a generic interoperability teler-obotics protocol can be applied for master-slave robotic systems operating in position-position, position-speed and hybrid control modes. The interoperability protocol allows robust and efficient data exchange for teleoperation systems, however it was not shown how it can fit switching position and rate control modes. Here we propose the general framework of hybrid position and rate control modes with interoperability protocol. Furthermore, we demonstrate experimentally that the framework is suitable for robotics teleoperation systems in which a human-operator can switch between position-position and position-speed master and slave robots' workspace mapping

A Study on Teleoperation of a Mobile Robot Using Haptic Feedback

Abstract. Haptic feedback force is often suggested to complement visual information through the sense of touch to improve efficiency and safety in the teleoperation of mobile robot. The efficiency and safety of teleoperation are strongly dependent upon how haptic feedback is presented to the operator. In this study a haptic feedback scheme for teleoperation of mobile robot is developed and its effectiveness is experimentally verified. Experimental results show that the developed scheme improves the quality of mobile robot teleoperation in terms of improvement in efficiency and safety

A Study on Teleoperation of a Mobile Robot Using Haptic Feedback

Abstract. Haptic feedback force is often suggested to complement visual information through the sense of touch to improve efficiency and safety in the teleoperation of mobile robot. The efficiency and safety of teleoperation are strongly dependent upon how haptic feedback is presented to the operator. In this study a haptic feedback scheme for teleoperation of mobile robot is developed and its effectiveness is experimentally verified. Experimental results show that the developed scheme improves the quality of mobile robot teleoperation in terms of improvement in efficiency and safety