Review of Teleoperator Research

A predictor display to overcome time lag problems with remote control systems is discussed. The video picture is a (necessarily) time-delayed picture from the remote location, generated as a coherent frame (snapshot) so that all picture elements in a single scan are delayed the same. The computer-generated graphics is a line drawing of the present configuration of the manipulator arm, vehicle or other device. The latter is generated by using the same control signals which are sent to the remote manipulator (device) to drive a computer model of it. The computer model is drawn on the video display in exactly the same location as where it will actually be after a one-way time delay and where it will be seen to be on the video after one round-trip time delay. If one waits at least one round-trip delay without moving, both the graphics model and the video picture of the manipulator (device) are seen to coincide. The predictor technque proved to work well and was shown for time delays in the 1-3 second range to reduce completion times for a variety of manipulation tasks by 50-150 percent reliably

MIT research in telerobotics

Ongoing MIT research in telerobotics (vehicles capable of some autonomous sensing and manipulating, having some remote supervisory control by people) and teleoperation (vehicles for sensing and manipulating which are fully controlled remotely by people) is discussed. The current efforts mix human and artificial intelligence/control. The idea of adjustable impedance at either end of pure master-slave teleoperation, and simultaneous coordinated control of teleoperator/telerobotic systems which have more than six degrees of freedom (e.g., a combined vehicle and arm, each with five or six DOF) are discussed. A new cable-controlled parallel link arm which offers many advantages over conventional arms for space is briefly described. Predictor displays to compensate for time delay in teleoperator loops, the use of state estimation to help human control decisions in space, and ongoing research in supervisory command language are covered. Finally, efforts to build a human flyable real-time dynamic computer-graphic telerobot simulator are described. These projects represent most, but not all, of the telerobotics research in our laboratory, supported by JPL, NASA Ames and NOAA

Video framerate, resolution and grayscale tradeoffs for undersea telemanipulator

The product of Frame Rate (F) in frames per second, Resolution (R) in total pixels and grayscale in bits (G) equals the transmission band rate in bits per second. Thus for a fixed channel capacity there are tradeoffs between F, R and G in the actual sampling of the picture for a particular manual control task in the present case remote undersea manipulation. A manipulator was used in the MASTER/SLAVE mode to study these tradeoffs. Images were systematically degraded from 28 frames per second, 128 x 128 pixels and 16 levels (4 bits) grayscale, with various FRG combinations constructed from a real-time digitized (charge-injection) video camera. It was found that frame rate, resolution and grayscale could be independently reduced without preventing the operator from accomplishing his/her task. Threshold points were found beyond which degradation would prevent any successful performance. A general conclusion is that a well trained operator can perform familiar remote manipulator tasks with a considerably degrade picture, down to 50 K bits/ sec

Experimental evaluation of the concept of supevisory manipulation

A computer-controlled teleoperator system which is based on task-referenced sensor-aided control has been developed to study supervisory manipulation. This system, called SUPERMAN, is capable of performing complicated tasks in real-time by utilizing the operator for high-level functions related to the unpredictable portions of a task, while the subordinate machine performs the more well-defined subtasks under human supervison. To determine whether supervisory control schemes such as these offer any advantage over manual control under real-time conditions, a number of experiments involving both simple and complicated tasks were performed. Six representative tasks were chosen for the study: (1) obtaining a tool from a rack, (2) returning the tool to the rack, (3) removing a nut, (4) placing samples in a storage bin, (5) opening and closing a valve, and (6) digging with a shovel. The experiments were performed under simulated conditions using four forms of manual control (i.e., switch rate, joystick rate, master-slave position control, and master-slave with force feedback), as well as supervisory control. Through these experiments the effectiveness and quality of control were evaluated on the basis of the time required to complete each portion of the task and the type and number of errors which occurred

A model for dynamic allocation of human attention among multiple tasks

The problem of multi-task attention allocation with special reference to aircraft piloting is discussed with the experimental paradigm used to characterize this situation and the experimental results obtained in the first phase of the research. A qualitative description of an approach to mathematical modeling, and some results obtained with it are also presented to indicate what aspects of the model are most promising. Two appendices are given which (1) discuss the model in relation to graph theory and optimization and (2) specify the optimization algorithm of the model

Two-D results on human operator perception

The application of multidimensional scaling methodology in human factors engineering is presented. The nonorthogonality of internally perceived task variables is exhibited for first and second order plants with both dependent and independent task variables. Directions of operator preference are shown for actual performance, pilot opinion rating, and subjective measures of fatigue, adaptability, and system recognition. Improvement of performance in second order systems is exhibited by the use of bang-bang feedback information. Dissimilarity measures for system comparison are suggested in order to account for human operator rotations and subjective sense of time

Measuring Workload Differences Between Short-term Memory and Long-term Memory Scenarios in a Simulated Flight Environment

Four highly experienced Air Force pilots each flew four simulated flight scenarios. Two scenarios required a great deal of aircraft maneuvering. The other two scenarios involved less maneuvering, but required remembering a number of items. All scenarios were designed to be equaly challenging. Pilot's Subjective Ratings for Activity-level, Complexity, Difficulty, Stress, and Workload were higher for the manuevering scenarios than the memory scenarios. At a moderate workload level, keeping the pilots active resulted in better aircraft control. When required to monitor and remember items, aircraft control tended to decrease. Pilots tended to weigh information about the spatial positioning and performance of their aircraft more heavily than other items