Performance evaluation of a six-axis generalized force-reflecting teleoperator

Work in real-time distributed computation and control has culminated in a prototype force-reflecting telemanipulation system having a dissimilar master (cable-driven, force-reflecting hand controller) and a slave (PUMA 560 robot with custom controller), an extremely high sampling rate (1000 Hz), and a low loop computation delay (5 msec). In a series of experiments with this system and five trained test operators covering over 100 hours of teleoperation, performance was measured in a series of generic and application-driven tasks with and without force feedback, and with control shared between teleoperation and local sensor referenced control. Measurements defining task performance included 100-Hz recording of six-axis force/torque information from the slave manipulator wrist, task completion time, and visual observation of predefined task errors. The task consisted of high precision peg-in-hole insertion, electrical connectors, velcro attach-de-attach, and a twist-lock multi-pin connector. Each task was repeated three times under several operating conditions: normal bilateral telemanipulation, forward position control without force feedback, and shared control. In shared control, orientation was locally servo controlled to comply with applied torques, while translation was under operator control. All performance measures improved as capability was added along a spectrum of capabilities ranging from pure position control through force-reflecting teleoperation and shared control. Performance was optimal for the bare-handed operator

ROTEX-TRIIFEX: Proposal for a joint FRG-USA telerobotic flight experiment

The concepts and main elements of a RObot Technology EXperiment (ROTEX) proposed to fly with the next German spacelab mission, D2, are presented. It provides a 1 meter size, six axis robot inside a spacelab rack, equipped with a multisensory gripper (force-torque sensors, an array of range finders, and mini stereo cameras). The robot will perform assembly and servicing tasks in a generic way, and will grasp a floating object. The man machine and supervisory control concepts for teleoperation from the spacelab and from ground are discussed. The predictive estimation schemes for an extensive use of time-delay compensating 3D computer graphics are explained

Graphics simulation and training aids for advanced teleoperation

Graphics displays can be of significant aid in accomplishing a teleoperation task throughout all three phases of off-line task analysis and planning, operator training, and online operation. In the first phase, graphics displays provide substantial aid to investigate work cell layout, motion planning with collision detection and with possible redundancy resolution, and planning for camera views. In the second phase, graphics displays can serve as very useful tools for introductory training of operators before training them on actual hardware. In the third phase, graphics displays can be used for previewing planned motions and monitoring actual motions in any desired viewing angle, or, when communication time delay prevails, for providing predictive graphics overlay on the actual camera view of the remote site to show the non-time-delayed consequences of commanded motions in real time. This paper addresses potential space applications of graphics displays in all three operational phases of advanced teleoperation. Possible applications are illustrated with techniques developed and demonstrated in the Advanced Teleoperation Laboratory at JPL. The examples described include task analysis and planning of a simulated Solar Maximum Satellite Repair task, a novel force-reflecting teleoperation simulator for operator training, and preview and predictive displays for on-line operations

Performance evaluation of a 6 axis high fidelity generalized force reflecting teleoperator

A few of the results of a major study of over 100 hours of experimental teleoperation are presented. Force and torque data recorded from the robot wrist is a rich source of information on the performance of tasks. Performance measures can be computed for whole tasks, or for specific task segments. As a general principle, the performance increases as manipulation capability is increased although the effects may depend on task and performance measure. This study has laid the groundwork for much future work. Further reports will detail additional results which could not be presented here due to lack of space as well as follow-on experiments investigating manipulation under time delay and shared control conditions

The Shape of Damping: Optimizing Damping Coefficients to Improve Transparency on Bilateral Telemanipulation

This thesis presents a novel optimization-based passivity control algorithm for hapticenabled bilateral teleoperation systems involving multiple degrees of freedom. In particular, in the context of energy-bounding control, the contribution focuses on the implementation of a passivity layer for an existing time-domain scheme, ensuring optimal transparency of the interaction along subsets of the environment space which are preponderant for the given task, while preserving the energy bounds required for passivity. The involved optimization problem is convex and amenable to real-time implementation. The effectiveness of the proposed design is validated via an experiment performed on a virtual teleoperated environment. The interplay between transparency and stability is a critical aspect in haptic-enabled bilateral teleoperation control. While it is important to present the user with the true impedance of the environment, destabilizing factors such as time delays, stiff environments, and a relaxed grasp on the master device may compromise the stability and safety of the system. Passivity has been exploited as one of the the main tools for providing sufficient conditions for stable teleoperation in several controller design approaches, such as the scattering algorithm, timedomain passivity control, energy bounding algorithm, and passive set position modulation. In this work it is presented an innovative energy-based approach, which builds upon existing time-domain passivity controllers, improving and extending their effectiveness and functionality. The set of damping coefficients are prioritized in each degree of freedom, the resulting transparency presents a realistic force feedback in comparison to the other directions. Thus, the prioritization takes effect using a quadratic programming algorithm to find the optimal values for the damping. Finally, the energy tanks approach on passivity control is a solution used to ensure stability in a system for robotics bilateral manipulation. The bilateral telemanipulation must maintain the principle of passivity in all moments to preserve the system\u2019s stability. This work presents a brief introduction to haptic devices as a master component on the telemanipulation chain; the end effector in the slave side is a representation of an interactive object within an environment having a force sensor as feedback signal. The whole interface is designed into a cross-platform framework named ROS, where the user interacts with the system. Experimental results are presented

Force reflection with compliance control

Two types of systems for force-reflecting control, which enables high force-reflection gain, are presented: position-error-based force reflection and low-pass-filtered force reflection. Both of the systems are combined with shared compliance control. In the position-error-based class, the position error between the commanded and the actual position of a compliantly controlled robot is used to provide force reflection. In the low-pass-filtered force reflection class, the low-pass-filtered output of the compliance control is used to provide force reflection. The increase in force reflection gain can be more than 10-fold as compared to a conventional high-bandwidth pure force reflection system, when high compliance values are used for the compliance control

Tele-autonomous systems: New methods for projecting and coordinating intelligent action at a distance

There is a growing need for humans to perform complex remote operations and to extend the intelligence and experience of experts to distant applications. It is asserted that a blending of human intelligence, modern information technology, remote control, and intelligent autonomous systems is required, and have coined the term tele-autonomous technology, or tele-automation, for methods producing intelligent action at a distance. Tele-automation goes beyond autonomous control by blending in human intelligence. It goes beyond tele-operation by incorporating as much autonomy as possible and/or reasonable. A new approach is discussed for solving one of the fundamental problems facing tele-autonomous systems: The need to overcome time delays due to telemetry and signal propagation. New concepts are introduced called time and position clutches, that allow the time and position frames between the local user control and the remote device being controlled, to be desynchronized respectively. The design and implementation of these mechanisms are described in detail. It is demonstrated that these mechanisms lead to substantial telemanipulation performance improvements, including the result of improvements even in the absence of time delays. The new controls also yield a simple protocol for control handoffs of manipulation tasks between local operators and remote systems

Miniature Telerobots in Space Applications

Ground controlled telerobots can be used to reduce astronaut workload while retaining much of the human capabilities of planning, execution, and error recovery for specific tasks. Miniature robots can be used for delicate and time consuming tasks such as biological experiment servicing without incurring the significant mass and power penalties associated with larger robot systems. However, questions remain regarding the technical and economic effectiveness of such mini-telerobotic systems. This paper address some of these open issues and the details of two projects which will provide some of the needed answers. The Microtrex project is a joint University of Washington/NASA project which plans on flying a miniature robot as a Space Shuttle experiment to evaluate the effects of microgravity on ground-controlled manipulation while subject to variable time-delay communications. A related project involving the University of Washington and Boeing Defense and Space will evaluate the effectiveness f using a minirobot to service biological experiments in a space station experiment 'glove-box' rack mock-up, again while subject to realistic communications constraints

Robotic experiment with a force reflecting handcontroller onboard MIR space station

During the French CASSIOPEE mission that will fly onboard MIR space station in 1996, ergonomic evaluations of a force reflecting handcontroller will be performed on a simulated robotic task. This handcontroller is a part of the COGNILAB payload that will be used also for experiments in neurophysiology. The purpose of the robotic experiment is the validation of a new control and design concept that would enhance the task performances for telemanipulating space robots. Besides the handcontroller and its control unit, the experimental system includes a simulator of the slave robot dynamics for both free and constrained motions, a flat display screen and a seat with special fixtures for holding the astronaut

Whole-Body Bilateral Teleoperation of a Redundant Aerial Manipulator

Attaching a robotic manipulator to a flying base allows for significant improvements in the reachability and versatility of manipulation tasks. In order to explore such systems while taking advantage of human capabilities in terms of perception and cognition, bilateral teleoperation arises as a reasonable solution. However, since most telemanipulation tasks require visual feedback in addition to the haptic one, real-time (task-dependent) positioning of a video camera, which is usually attached to the flying base, becomes an additional objective to be fulfilled. Since the flying base is part of the kinematic structure of the robot, if proper care is not taken, moving the video camera could undesirably disturb the end-effector motion. For that reason, the necessity of controlling the base position in the null space of the manipulation task arises. In order to provide the operator with meaningful information about the limits of the allowed motions in the null space, this paper presents a novel haptic concept called Null-Space Wall. In addition, a framework to allow stable bilateral teleoperation of both tasks is presented. Numerical simulation data confirm that the proposed framework is able to keep the system passive while allowing the operator to perform time-delayed telemanipulation and command the base to a task-dependent optimal pose.Comment: to be published in 2020 IEEE International Conference on Robotics and Automation (ICRA