Augmenting Graphical User Interfaces with Haptic Assistance for Motion-Impaired Operators

Haptic assistance is an emerging field of research that is designed to improve human-computer interaction (HCI) by reducing error rates and targeting times through the use of force feedback. Haptic feedback has previously been investigated to assist motion-impaired computer users, however, limitations such as target distracters have hampered its integration with graphical user interfaces (GUIs). In this paper two new haptic assistive techniques are presented that utilise the 3DOF capabilities of the Phantom Omni. These are referred to as deformable haptic cones and deformable virtual switches. The assistance is designed specifically to enable motion-impaired operators to use existing GUIs more effectively. Experiment 1 investigates the performance benefits of the new haptic techniques when used in conjunction with the densely populated Windows on-screen keyboard (OSK). Experiment 2 utilises the ISO 9241-9 point-and-click task to investigate the effects of target size and shape. The results of the study prove that the newly proposed techniques improve interaction rates and can be integrated with existing software without many of the drawbacks of traditional haptic assistance. Deformable haptic cones and deformable virtual switches were shown to reduce the mean number of missed-clicks by at least 75% and reduce targeting times by at least 25%

Development Of Sensory Mode Interaction In Haptic System

A haptic device enables interaction between human and computer, which also give response due to the force applied by the user movements. The aim of this project is to design and develop a simple haptic device to analyze on the concept of sensory-mode interaction by using strain gauge sensor

Haptic interaction with a virtual 3D model: A multimodal interactive system for 3D solar system

Haptic interaction has become more and more important in interactive technology. In current human-computer interaction, haptic interaction has been considered as an important additional interactive method. The benefits of haptic interaction mainly include high efficiency, accuracy and naturalness. In this thesis, a multimodal interactive system was implemented based on a large volume 3D model of the solar system. This multimodal interactive system included two subsystems which separately used traditional computer interactive devices, a mouse and a keyboard, as well as a new haptic interaction device. These two interactive subsystems contained many relevant interactive functions for the user to interact with the model of the solar system and the models of celestial bodies inside it. In addition, the interactive methods for a large volume 3D model were studied in this research. Finally, a user study was employed to demonstrate the benefits of haptic interaction in a multimodal interactive system, and also the methods for improving current haptic technology had been discussed. To sum up, the work of the thesis includes a theoretical discussion, the implementation of a multimodal interactive system and a user study, which focuses on the research for haptic interaction in the field of human-computer interaction. Asiasanat: Haptic interaction, virtual 3D model, multimodal interactive system, human-computer interactio

HAPTICS IN ROBOTICS AND AUTOMOTIVE SYSTEMS

Haptics is the science of applying touch (tactile) sensation and control to interaction with computer applications. The devices used to interact with computer applications are known as haptic interfaces. These devices sense some form of human movement, be it finger, head, hand or body movement and receive feedback from computer applications in form of felt sensations to the limbs or other parts of the human body. Examples of haptic interfaces range from force feedback joysticks/controllers in video game consoles to tele-operative surgery. This thesis deals with haptic interfaces involving hand movements. The first experiment involves using the end effector of a robotic manipulator as an interactive device to aid patients with deficits in the upper extremities in passive resistance therapy using novel path planning. The second experiment involves the application of haptic technology to the human-vehicle interface in a steer-by-wire transportation system using adaptive control

DEVELOPMENT OF SENSORY-MODE INTERACTION IN HAPTIC SYSTEM

This final report is an overview for Final Year Project titled "Development of sensory-mode interaction in haptic system". A haptic device enables interaction between human and computer, which also give response due to the force applied by the user movements. The aim of this project is to design and develop a simple haptic device to analyze on the concept of sensory-mode interaction by using strain gauge sensor. Current application of haptic technology has been widely used in robotics, teleoperators, simulators, and video game controller. However, most of the application of existing haptic device are expensive, sophisticated, and require high level of technology. Therefore, due to the complexity of the system, a simple haptic device is designed after analyzing literature review on the related work. The device also will enable user to obtain the tactile feedback when exerting force to the interface. In order to perform the virtual measurement, a Graphical User Interface (GUI) is developed using Lab View software. The hardware device will interact directly with the computer via communication board. Hence, whenever the user applies force on the device, the force value will transfer to the computer for further conversion and calculation. User can acquire data and the output value generated will be displayed on the screen of computer. The overall summary about this project is to produce a simple haptic device using the stain gauge sensor, and the amount force exerted by user can be measured and monitor via the Lab View Software

A human-in-the-loop haptic interaction with subjective evaluation

To date, one of the challenges in Human-Computer Interaction (HCI) is fully immersive multisensory remote physical interaction technologies. The applications of haptic perception in HCI can enrich the interaction details and effectively improve the immersion and realism of interaction. In the human-in-the-loop haptic interaction system, the quality of experience (QoE) of the human operator plays an essential role. However, QoE in haptic interaction is still in its infancy. Based on the typical application scenarios of haptic operation, the paper constructs a haptic-visual interaction framework and analyzes the QoE influencing factors. Through subjective evaluation experiments, the paper establishes a haptic interaction database that can provide a research basis for further exploring the relationship between various influencing factors and interactive QoE

Mobile Location Based Services: Non-visual Feedback Using Haptics

Haptics is a feedback technology that takes advantage of the human sense of touch by applying forces, vibrations, and/or motions to a haptic-enabled device such as a mobile phone. Historically, human-computer interaction has been visual, text and images on the screen. In this paper, we discuss our Haptic Interaction Model which describes the integration of haptic feedback into Mobile Location Based Services such as knowledge discovery, pedestrian navigation and notification systems. A knowledge discovery system called the Haptic GeoWand is a low interaction system that allows users to query geo-tagged data around them by using a point-and-scan technique with their mobile device. Haptic Pedestrian is a navigation system for walkers. Four prototypes have been developed classified according to the user‟s guidance requirements, the user type (based on spatial skills), and overall system complexity. Haptic Alert is a notification system that provides spatial information to the users of public transport. In all these systems, haptic feedback is used to convey information about location, orientation, density and distance by use of the vibration alarm with varying frequencies and patterns to help understand the physical environment. User trials have elicited positive response from the users. Haptics integrated into a multi-modal navigation system and other mobile location based services provides more usable, less distracting but more effective interaction than conventional systems