Teleoperation control based on combination of wave variable and neural networks

In this paper, a novel control scheme is developed for a teleoperation system, combining the radial basis function (RBF) neural networks (NNs) and wave variable technique to simultaneously compensate for the effects caused by communication delays and dynamics uncertainties. The teleoperation system is set up with a TouchX joystick as the master device and a simulated Baxter robot arm as the slave robot. The haptic feedback is provided to the human operator to sense the interaction force between the slave robot and the environment when manipulating the stylus of the joystick. To utilize the workspace of the telerobot as much as possible, a matching process is carried out between the master and the slave based on their kinematics models. The closed loop inverse kinematics method and RBF NN approximation technique are seamlessly integrated in the control design. To overcome the potential instability problem in the presence of delayed communication channels, wave variables and their corrections are effectively embedded into the control system, and Lyapunov-based analysis is performed to theoretically establish the closed-loop stability. Comparative experiments have been conducted for a trajectory tracking task, under the different conditions of various communication delays. Experimental results show that in terms of tracking performance and force reflection, the proposed control approach shows superior performance over the conventional methods

Haptic-Guided Teleoperation of a 7-DoF Collaborative Robot Arm With an Identical Twin Master

In this article, we describe two techniques to enable haptic-guided teleoperation using 7-DoF cobot arms as master and slave devices. A shortcoming of using cobots as master-slave systems is the lack of force feedback at the master side. However, recent developments in cobot technologies have brought in affordable, flexible, and safe torque-controlled robot arms, which can be programmed to generate force feedback to mimic the operation of a haptic device. In this article, we use two Franka Emika Panda robot arms as a twin master-slave system to enable haptic-guided teleoperation. We propose a two layer mechanism to implement force feedback due to 1) object interactions in the slave workspace, and 2) virtual forces, e.g. those that can repel from static obstacles in the remote environment or provide task-related guidance forces. We present two different approaches for force rendering and conduct an experimental study to evaluate the performance and usability of these approaches in comparison to teleoperation without haptic guidance. Our results indicate that the proposed joint torque coupling method for rendering task forces improves energy requirements during haptic guided telemanipulation, providing realistic force feedback by accurately matching the slave torque readings at the master side

Advances in Human Robot Interaction for Cloud Robotics applications

In this thesis are analyzed different and innovative techniques for Human Robot Interaction. The focus of this thesis is on the interaction with flying robots. The first part is a preliminary description of the state of the art interactions techniques. Then the first project is Fly4SmartCity, where it is analyzed the interaction between humans (the citizen and the operator) and drones mediated by a cloud robotics platform. Then there is an application of the sliding autonomy paradigm and the analysis of different degrees of autonomy supported by a cloud robotics platform. The last part is dedicated to the most innovative technique for human-drone interaction in the User’s Flying Organizer project (UFO project). This project wants to develop a flying robot able to project information into the environment exploiting concepts of Spatial Augmented Realit

Posture-Dependent Projection-Based Force Reflection Algorithms for Bilateral Teleoperators

It was previously established that the projection-based force reflection (PBFR) algorithms improve the overall stability of a force reflecting teleoperation system. The idea behind the PBFR algorithms is to identify the component of the reflected force which is compensated by interaction with the operator\u27s hand, and subsequently attenuate the residual component of the reflected force. If there is no a priori information regarding the behaviour of the human operator, the PBFR gain is selected equal to sufficiently small constant in order to guarantee stability for a wide range of human operator responses. Small PBRF gains, however, may deteriorate the transparency of a teleoperator system. In this thesis, a new method for selecting the PBFR gain is introduced which depends on human postures. Using an online human posture estimation, the introduced posture-dependent PBFR algorithm has been applied to a teleoperation system with force feedback. It is experimentally demonstrated that the developed method for selection of the PBFR gain based on human postures improves the transparency of the teleoperator system while the stability is preserved. Finally, preliminary results that deal with an extension of the developed methods towards a more realistic model of the human arm with 4 degrees of freedom and three dimensional movements are presented

The LRU Rover for Autonomous Planetary Exploration and its Success in the SpaceBotCamp Challenge

The task of planetary exploration poses many challenges for a robot system, from weight and size constraints to sensors and actuators suitable for extraterrestrial environment conditions. As there is a significant communication delay to other planets, the efficient operation of a robot system requires a high level of autonomy. In this work, we present the Light Weight Rover Unit (LRU), a small and agile rover prototype that we designed for the challenges of planetary exploration. Its locomotion system with individually steered wheels allows for high maneuverability in rough terrain and the application of stereo cameras as its main sensor ensures the applicability to space missions. We implemented software components for self-localization in GPS-denied environments, environment mapping, object search and localization and for the autonomous pickup and assembly of objects with its arm. Additional high-level mission control components facilitate both autonomous behavior and remote monitoring of the system state over a delayed communication link. We successfully demonstrated the autonomous capabilities of our LRU at the SpaceBotCamp challenge, a national robotics contest with focus on autonomous planetary exploration. A robot had to autonomously explore a moon-like rough-terrain environment, locate and collect two objects and assemble them after transport to a third object - which the LRU did on its first try, in half of the time and fully autonomous

Human factors in space telepresence

The problems of interfacing a human with a teleoperation system, for work in space are discussed. Much of the information presented here is the result of experience gained by the M.I.T. Space Systems Laboratory during the past two years of work on the ARAMIS (Automation, Robotics, and Machine Intelligence Systems) project. Many factors impact the design of the man-machine interface for a teleoperator. The effects of each are described in turn. An annotated bibliography gives the key references that were used. No conclusions are presented as a best design, since much depends on the particular application desired, and the relevant technology is swiftly changing

Sampled data systems passivity and discrete port-Hamiltonian systems

In this paper, we present a novel way to approach the interconnection of a continuous and a discrete time physical system first presented in [1][2] [3]. This is done in a way which preserves passivity of the coupled system independently of the sampling time T. This strategy can be used both in the field of telemanipulation, for the implementation of a passive master/slave system on a digital transmission line with varying time delays and possible loss of packets (e.g., the Internet), and in the field of haptics, where the virtual environment should `feel¿ like a physical equivalent system

NASA space station automation: AI-based technology review

Research and Development projects in automation for the Space Station are discussed. Artificial Intelligence (AI) based automation technologies are planned to enhance crew safety through reduced need for EVA, increase crew productivity through the reduction of routine operations, increase space station autonomy, and augment space station capability through the use of teleoperation and robotics. AI technology will also be developed for the servicing of satellites at the Space Station, system monitoring and diagnosis, space manufacturing, and the assembly of large space structures

Delay compensation in bilateral teleoperation using predictor observers

Destabilization and performance degradation problems caused by the time delay in communication channel is a serious problem in bilateral teleoperation. In particular, variability of the delay due to limited bandwidth, long distance or congestion in transmission problems has been a real challenge in bilateral teleoperation research since the internet communication has become prevalent. Many existing delay compensation techniques are designed for linear teleoperator systems. In order to implement them on real bilateral systems, the nonlinear dynamics of the robots must first be linearized. For this purpose feedback linearization is usually employed. In this thesis, the delay compensation problem is tackled in an observer framework by designing two observers. Integration of a disturbance observer to the slave side implies a linearized slave dynamics with nominal parameters. Disturbance observer estimates the total disturbance (nonlinear terms, parametric uncertainties and external disturbances) on the slave system. A second observer is designed at the master side to predict states of the slave. This observer can be designed using a variety of linear or nonlinear methods. In order to have finite-time convergence, a sliding mode observer is designed at the master side. It is shown that this observer predicts the future positions and/or velocities of the slave and use of such predictions in the computation of a simple PD control law implies stable operation for the bilateral system. Since the disturbance observer increases the robustness of the slave system, the performance of the resulting bilateral system is quite satisfactory. Force reflecting bilateral teleoperation is also considered in this thesis. Integrating the proposed observer based delay compensation technique into the well known four-channel control architecture not only stable but also transparent bilateral teleoperation is achieved. Simulations with bilateral systems consisting of 2 DOF scara robots and pantograph robots, and experiments with bilateral systems consisting of a pair of single link robots and a pair of pantograph robots validate the proposed method