Skip to main content
Article thumbnail
Location of Repository

Haptic communication for remote mobile and manipulator robot operations in hazardous environments

By M Counsell


Nuclear decommissioning involves the use of remotely deployed mobile vehicles\ud and manipulators controlled via teleoperation systems. Manipulators are used for\ud tooling and sorting tasks, and mobile vehicles are used to locate a manipulator\ud near to the area that it is to be operated upon and also to carry a camera into a\ud remote area for monitoring and assessment purposes.\ud Teleoperations in hazardous environments are often hampered by a lack of visual\ud information. Direct line of sight is often only available through small, thick\ud windows, which often become discoloured and less transparent over time. Ideal\ud camera locations are generally not possible, which can lead to areas of the cell not\ud being visible, or at least difficult to see. Damage to the mobile, manipulator, tool\ud or environment can be very expensive and dangerous.\ud Despite the advances in the recent years of autonomous systems, the nuclear\ud industry prefers generally to ensure that there is a human in the loop. This is due\ud to the safety critical nature of the industry. Haptic interfaces provide a means\ud of allowing an operator to control aspects of a task that would be difficult or\ud impossible to control with impoverished visual feedback alone. Manipulator endeffector\ud force control and mobile vehicle collision avoidance are examples of such\ud tasks.\ud Haptic communication has been integrated with both a Schilling Titan II manipulator\ud teleoperation system and Cybermotion K2A mobile vehicle teleoperation\ud system. The manipulator research was carried out using a real manipulator\ud whereas the mobile research was carried out in simulation. Novel haptic communication\ud generation algorithms have been developed. Experiments have been\ud conducted using both the mobile and the manipulator to assess the performance\ud gains offered by haptic communication.\ud The results of the mobile vehicle experiments show that haptic feedback offered\ud performance improvements in systems where the operator is solely responsible for\ud control of the vehicle. However in systems where the operator is assisted by semi\ud autonomous behaviour that can perform obstacle avoidance, the advantages of\ud haptic feedback were more subtle.\ud The results from the manipulator experiments served to support the results from\ud the mobile vehicle experiments since they also show that haptic feedback does not\ud always improve operator performance. Instead, performance gains rely heavily on\ud the nature of the task, other system feedback channels and operator assistance\ud features. The tasks performed with the manipulator were peg insertion, grinding\ud and drilling

Topics: T1, HE, TA, built_and_human_env, other
OAI identifier:

Suggested articles


  1. (1987). A comparison of position and rate control for telemanipulators with consideration of manipulator system dynamics.
  2. (1992). A force-reflecting teleoperated hand system for the study of tactile sensing in precision manipulation. Pages 1321–1326 of: International conference on robotics and automation.
  3. (1991). A global performance index for the kinematic optimization of robotic manipulators.
  4. (1999). A haptically enhanced scrollbar: Force-feedback as a means of reducing the problems associated with scrolling. In: First phantom users research symposium.
  5. (1993). A high performance parallel input device. Pages 272–281 of: Telemanipulator technology and space telerobotics,
  6. (1988). A human factors evaluation of teleoperation hand controllers. Pages 291–296 of:
  7. (1989). A master-slave manipulator for excavation and construction tasks. Pages 333–337 of: Robotics and autonomous systems 4.
  8. (1994). A multi-modal mouse with tactile and force feedback.
  9. (2002). A nonlinear tracking controller for a haptic interface steer-by-wire systems. Pages 3112–3117 of:
  10. (1992). A portable dextrous master with force feedback. Presence: Teleoperators and virtual environments,
  11. (1986). A robust layered control system for a mobile robot. Robotics and automation,
  12. (1997). A study of operator-induced instabilities in a tactual virtual environment.
  13. (1995). A theoretical and experimental investigation into the factors affecting the z-width of a haptic display.
  14. (1987). A unified approach for motion and force control of robot manipulators: The operational space formulation.
  15. (1989). A virtual environment system for the study of human arm tremor.
  16. (1997). A virtual reality-based system for hand diagnosis and rehabilitation. Presence: Teleoperators and virtual environments,
  17. (1996). A virtual simulation environment for learning epidural anaesthesia. Medicine meets virtual reality iv: Health care in the information age,
  18. (1995). Achieving transparency for teleoperator systems under position and rate control.
  19. (1996). Advanced robotics and intelligent machines.
  20. (1991). Advanced robotics redundancy and optimization.
  21. (1996). Advanced teleoperation testbed- a system you can see through.
  22. (1993). Application of force feedback to heavy duty hydraulic machines. Pages 375–381 of: Robotics and automation conference.
  23. (1985). Applied linear regression.
  24. (1999). Comparing haptic effects in a gui. In: First phantom users research symposium.
  25. (1997). Computerised hand diagnostic/rehabilitation system using a force feedback glove. In: Medicine meets virtual reality.
  26. (1995). Coordinated and force-feedback control of hydraulic excavators. Pages 181–194 of: Fourth international symposium on experimental robotics.
  27. (1996). Design and evaluation of a high-performance haptic interface. Pages 321–327 of: Robotica,
  28. (1989). Design of a multiple degree of freedom, force reflective hand master/slave with a high mobility wrist. In: Third topical meeting on robotics and remote systems.
  29. (1997). Design of an anthropomorphic haptic interface for the human arm. In: Robotics research, the 8th international symposium.
  30. (1988). Development of a general purpose hand controller for advanced teleoperation. Pages 277–290 of: International symposium on teleoperation and control.
  31. (1965). Development of servo manipulators for high energy accelerator requirements. Pages 29–35 of: 13th conf. on remote systems technology.
  32. (1998). Dextrous exploration of a virtual world for improved prototyping. Pages 298–303 of: International conference on robotics and automation.
  33. (1998). Dynamic models for haptic rendering systems. Pages 523–532 of: Advances in robot kinematics,
  34. (1994). Electric motors and control techniques. TAB Books, a division of McGraw-Hill Inc.
  35. (1996). Electric motors and their controls.
  36. (1954). Electronically controlled manipulator.
  37. (1993). End-effector motion capabilities of serial manipulators. The international journal of robotics research,
  38. (1997). Evaluation of impedance and teleoperation control of a hydraulic mini-excavator. Pages 187–198 of: Experimental robotics v: The fifth international symposium.
  39. (1984). Experimental remote handling systems. Pages 117–121 of: National topical meeting on robotics and remote handling in hostile environments.
  40. (1994). Factors affecting the z-width of a haptic display. Pages 3205–3210 of: International conference on robotics and automation.
  41. (1992). Fitts’ law as a research and design tool in human-computer interaction.
  42. (1989). Force display performs better than visual display in a simple 6-d docking task. Pages 1462–1466 of: International conference on robotics and automation.
  43. (1995). Force feedback in a stationary driving simulator. Pages 1711–1716 of:
  44. (2002). Force Feedback Pro.
  45. (1998). Fundamental limits of performance for force reflecting teleoperation. The international journal of robotics research,
  46. (1952). Fundamental of general-purpose remote manipulators.
  47. (1999). Haptic communication for manipulator tooling operations in hazardous environments. Pages 222–233 of: Telemanipulator and telepresence technologies vi,
  48. (1999). Haptic communication for remote mobile manipulator robot operations. In: American nuclear society, 8th international topical meeting on robotics and remote systems (proc. on cdrom, session 15: Human machine interfaces,
  49. (1998). Haptic communication for telerobotic applications. Presented at “Advanced Robotics: Beyond
  50. (1998). Haptic display for object grasping and manipulation in virtual environment.
  51. (1998). Haptic feedback in the training of veterinary students. In: First international workshop on usability evaluation for virtual environments.
  52. (2000). Haptic graphs for blind computer users. Pages 102–107 of: 1st workshop on haptic human-computer interaction.
  53. (1997). Haptic interaction in virtual environments.
  54. (1998). Haptic manipulation of virtual mechanisms from mechanical cad designs. Pages 375– 380 of: International conference on robotics and automation.
  55. (1998). High-bandwidth force and impedance control for industrial robots.
  56. (1987). Historical perspective and state of the art in robot force control. The international journal of robotic research,
  57. (1998). Human factors in haptic interfaces.
  58. (1973). Human performance.
  59. (1980). Immediate perceptual response to intersensory discrepancy.
  60. (1990). Influence of the mechanical properties of a manipulandum on human operator dynamics.
  61. (1996). Integration of a manipulator system with a mobile vehicle to perform multiple tasks in a hazardous environment. Pages 242–248 of: Remote techniques for hazardous environments.
  62. (1986). Introduction to robotics, mechanics and control.
  63. (1986). Inverse kinematics solutions with singularity robustness for robot manipulator control. ASME journal of dynamic systems, measurement, and control,
  64. (1993). Kinematic design of serial link manipulators from task specifications. The international journal of robotics research,
  65. (1999). Manipulator performance evaluation using fitts’ tapping task. In: 8th topical meeting on robotics and remote systems.
  66. (1964). Manipulator systems development at anl. Pages 117–136 of: 12th conference on remote systems technology.
  67. (1988). Manual control of telemanipulators. Pages 263–276 of: International symposium on teleoperation and control.
  68. (1997). Many hands make light work? an investigation into behaviourally controlled co-operant autonomous mobile robots. Pages 413–420 of: International conference on, autonomous agents.
  69. (1988). Measuring operator skill and teleoperator performance. Pages 277–290 of: International symposium on teleoperation and control.
  70. (1997). Minimum effort inverse kinematics for redundant manipulators.
  71. (1989). Motor schema-based mobile robot navigation.
  72. (1996). Movement characteristics using a mouse with tactile and force feedback. International journal of human computer studies,
  73. (1996). Multi-modal virtual reality: Input/output devices, system integration and human factors. International journal of human-computer interaction (IJHCI), special issue on humanvirtual environment interaction,
  74. (2000). Multimodal feedback cues to aid veterinary training simulations. Pages 45–49 of: 1st workshop on haptic human-computer interaction.
  75. (1993). On the use of discrete proprioceptive-tactile warning signals during manual control - the steering wheel as an active control device.
  76. (1994). Passivity of a class of sampled-data systems: Application to haptic interfaces. Pages 3236–3240 of: American control conference.
  77. (1995). Pen-based force display for precision manipulation in virtual environments. Pages 217–224 of: Virtual reality annual international symposium.
  78. (1991). Performance evaluation of a six axis generalized force reflecting teleoperator.
  79. (1990). Performance measures of teleoperation using an exoskeleton device. Pages 552–557 of: International conference on robotics and automation.
  80. (1989). Power steering system with travelling condition judgement function. SAE society of automotive engineers,
  81. (1990). Project grope - haptic displays for scientific visualisation.
  82. (2000). Putting the feel in ’look and feel’. Pages 415–422 of: Chi
  83. (1999). Real-time collision avoidance for position-controlled manipulators.
  84. (1993). Real-time collision avoidance for redundant manipulators. In:
  85. (1986). Real-time obstacle avoidance for manipulators and mobile robots.
  86. (1969). Resolved motion rate control of manipulators and human prostheses.
  87. (1977). Sm-229 - a new compact servo master-slave manipulator. Pages 169–173 of: 25th conference on remote systems technology.
  88. (1993). Some of what one needs to know about using head-mounted displays to improve teleoperator performance.
  89. (1992). Specification and design of input devices for teleoperation. Pages 540–545 of: International conference on robotics and automation.
  90. (1999). Statistics, an introduction.
  91. (1984). Stress and fatigue in human performance.
  92. (1997). Surgery simulation with visual and haptic feedback. Pages 311–316 of: Robotics research, the 8th international symposium.
  93. (1992). Task performance with a dextrous teleoperated hand system.
  94. (1997). Tele-robotic/autonomous control using controlshell. In: 7th topical meeting on robotics and remote systems.
  95. (1994). Teleoperator performance with varying force and visual feedback. Human factors,
  96. (1984). The advancement of remote systems technology: Past perspectives and future plans. Pages 11–24 of: National topical meeting on robotics and remote handling in hostile environments.
  97. (1961). The anl model 3 master-slave electric manipulator -it’s design and use in a cave. Pages 121–142 of: The 9th conference on hot labour equipment.
  98. (1994). The design of artificial realities to improve learning newtonian mechanics. Pages 34–41 of: East-west international conference on multimedia, hypermedia, and virtual reality.
  99. (2000). The effective combinations of haptic and audio textural information.
  100. (1997). The haptic display of complex graphical environments. Pages 345–352 of: Computer graphics.
  101. (1954). The information capacity of the human motor system in controlling the amplitude of movement.
  102. (1973). The manipulator as a means of extending our dextrous capabilities to larger and smaller scales. Pages 47–50 of: 21st conference on remote systems technology.
  103. (1994). The phantom haptic interface: A device for probing virtual objects. Pages 295–302 of: International mechanical engineering expositions and congress.
  104. (1908). The relation of strength of stimulus to rapidity of habit-formation. doi
  105. (1964). Through-the-wall master-slave manipulator with indexing for forward and backward movement. Pages 67–72 of: 12th conference on remote systems technology.
  106. (1977). Two measures of performance in a peg-in-hole manipulation task with force feedback.
  107. (1992). Universal joints and driveshafts, analysis, design, applications.
  108. (1999). Virtual environment for developing electronic power steering and steer-by-wire systerns.
  109. (1997). Virtual reality and medicine: Technology and applications. In: Industrial virtual reality.
  110. (1996). Virtual reality and robotics in medicine.
  111. (1997). Virtual reality training simulation for palpation of subsurface tumors.
  112. (1964). Vision and touch: an experimentally created conflict between the two senses.
  113. (1991). Visual factors affecting human operator performance with a head-mounted display. SAE society of automotive engineers.
  114. (1999). What you feel must be what you see: Adding tactile feedback to the trackpoint. Pages 383–390 of: Human-computer interaction,

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.