Vibrotactile pedals : provision of haptic feedback to support economical driving

The use of haptic feedback is currently an underused modality in the driving environment, especially with respect to vehicle manufacturers. This exploratory study evaluates the effects of a vibrotactile (or haptic) accelerator pedal on car driving performance and perceived workload using a driving simulator. A stimulus was triggered when the driver exceeded a 50% throttle threshold, past which is deemed excessive for economical driving. Results showed significant decreases in mean acceleration values, and maximum and excess throttle use when the haptic pedal was active as compared to a baseline condition. As well as the positive changes to driver behaviour, subjective workload decreased when driving with the haptic pedal as compared to when drivers were simply asked to drive economically. The literature suggests that the haptic processing channel offers a largely untapped resource in the driving environment, and could provide information without overloading the other attentional resource pools used in driving

Evaluating Multimodal Driver Displays of Varying Urgency

Previous studies have evaluated Audio, Visual and Tactile warnings for drivers, highlighting the importance of conveying the appropriate level of urgency through the signals. However, these modalities have never been combined exhaustively with different urgency levels and tested while using a driving simulator. This paper describes two experiments investigating all multimodal combinations of such warnings along three different levels of designed urgency. The warnings were first evaluated in terms of perceived urgency and perceived annoyance in the context of a driving simulator. The results showed that the perceived urgency matched the designed urgency of the warnings. More urgent warnings were also rated as more annoying but the effect of annoyance was lower compared to urgency. The warnings were then tested for recognition time when presented during a simulated driving task. It was found that warnings of high urgency induced quicker and more accurate responses than warnings of medium and of low urgency. In both studies, the number of modalities used in warnings (one, two or three) affected both subjective and objective responses. More modalities led to higher ratings of urgency and annoyance, with annoyance having a lower effect compared to urgency. More modalities also led to quicker responses. These results provide implications for multimodal warning design and reveal how modalities and modality combinations can influence participant responses during a simulated driving task

Dynamic vibrotactile signals for forward collision avoidance warning systems

OBJECTIVE: Four experiments were conducted in order to assess the effectiveness of dynamic vibrotactile collision-warning signals in potentially enhancing safe driving. BACKGROUND: Auditory neuroscience research has demonstrated that auditory signals that move toward a person are more salient than those that move away. If this looming effect were found to extend to the tactile modality, then it could be utilized in the context of in-car warning signal design. METHOD: The effectiveness of various vibrotactile warning signals was assessed using a simulated car-following task. The vibrotactile warning signals consisted of dynamic toward-/away-from-torso cues (Experiment 1), dynamic versus static vibrotactile cues (Experiment 2), looming-intensity- and constant-intensity-toward-torso cues (Experiment 3), and static cues presented on the hands or on the waist, having either a low or high vibration intensity (Experiment 4). RESULTS: Braking reaction times (BRTs) were significantly faster for toward-torso as compared to away-from-torso cues (Experiments 1 and 2) and static cues (Experiment 2). This difference could not have been attributed to differential responses to signals delivered to different body parts (i.e., the waist vs. hands; Experiment 4). Embedding a looming-intensity signal into the toward-torso signal did not result in any additional BRT benefits (Experiment 3). CONCLUSION: Dynamic vibrotactile cues that feel as though they are approaching the torso can be used to communicate information concerning external events, resulting in a significantly faster reaction time to potential collisions. APPLICATION: Dynamic vibrotactile warning signals that move toward the body offer great potential for the design of future in-car collision-warning system

Somatic ABC's: A Theoretical Framework for Designing, Developing and Evaluating the Building Blocks of Touch-Based Information Delivery

abstract: Situations of sensory overload are steadily becoming more frequent as the ubiquity of technology approaches reality--particularly with the advent of socio-communicative smartphone applications, and pervasive, high speed wireless networks. Although the ease of accessing information has improved our communication effectiveness and efficiency, our visual and auditory modalities--those modalities that today's computerized devices and displays largely engage--have become overloaded, creating possibilities for distractions, delays and high cognitive load; which in turn can lead to a loss of situational awareness, increasing chances for life threatening situations such as texting while driving. Surprisingly, alternative modalities for information delivery have seen little exploration. Touch, in particular, is a promising candidate given that it is our largest sensory organ with impressive spatial and temporal acuity. Although some approaches have been proposed for touch-based information delivery, they are not without limitations including high learning curves, limited applicability and/or limited expression. This is largely due to the lack of a versatile, comprehensive design theory--specifically, a theory that addresses the design of touch-based building blocks for expandable, efficient, rich and robust touch languages that are easy to learn and use. Moreover, beyond design, there is a lack of implementation and evaluation theories for such languages. To overcome these limitations, a unified, theoretical framework, inspired by natural, spoken language, is proposed called Somatic ABC's for Articulating (designing), Building (developing) and Confirming (evaluating) touch-based languages. To evaluate the usefulness of Somatic ABC's, its design, implementation and evaluation theories were applied to create communication languages for two very unique application areas: audio described movies and motor learning. These applications were chosen as they presented opportunities for complementing communication by offloading information, typically conveyed visually and/or aurally, to the skin. For both studies, it was found that Somatic ABC's aided the design, development and evaluation of rich somatic languages with distinct and natural communication units.Dissertation/ThesisPh.D. Computer Science 201

Examining the sense of agency in human-computer interaction

Humans are agents, we feel that we control the course of events on our everyday life. This refers to the Sense of Agency (SoA). This experience is not only crucial in our daily life, but also in our interaction with technology. When we manipulate a user interface (e.g., computer, smartphone, etc.), we expect that the system responds to our input commands with feedback, as we desire to feel that we are in charge of the interaction. If this interplay elicits a SoA, then the user will perceive an instinctive feeling of “I am controlling this”. Although research in Human-Computer Interaction (HCI) pursuits the design of intuitive and responsive systems, most of the current studies have been focussed mainly on interaction techniques (e.g., software-hardware) and User Experience (UX) (e.g., comfort, usability, etc.), and very little has been investigated in terms of the SoA i.e., the conscious experience of being in control regarding the interaction. In this thesis, we present an experimental exploration of the role of the SoA in interaction paradigms typical of HCI. After two chapters of introduction and related work, we describe a series of studies that explore agency implication in interaction with systems through human senses such as vision, audio, touch and smell. Chapter 3 explores the SoA in mid-air haptic interaction through touchless actions. Then, Chapter 4 examines agency modulation through smell and its application for olfactory interfaces. Chapter 5 describes two novel timing techniques based on auditory and haptic cues that provide alternative timing methods to the traditional Libet clock. Finally, we conclude with a discussion chapter that highlights the importance of our SoA during interactions with technology as well as the implications of the results found, in the design of user interfaces

Vibrotactile Feedback for Brain-Computer Interface Operation

To be correctly mastered, brain-computer interfaces (BCIs) need an uninterrupted flow of feedback to the user. This feedback is usually delivered through the visual channel. Our aim was to explore the benefits of vibrotactile feedback during users' training and control of EEG-based BCI applications. A protocol for delivering vibrotactile feedback, including specific hardware and software arrangements, was specified. In three studies with 33 subjects (including 3 with spinal cord injury), we compared vibrotactile and visual feedback, addressing: (I) the feasibility of subjects' training to master their EEG rhythms using tactile feedback; (II) the compatibility of this form of feedback in presence of a visual distracter; (III) the performance in presence of a complex visual task on the same (visual) or different (tactile) sensory channel. The stimulation protocol we developed supports a general usage of the tactors; preliminary experimentations. All studies indicated that the vibrotactile channel can function as a valuable feedback modality with reliability comparable to the classical visual feedback. Advantages of using a vibrotactile feedback emerged when the visual channel was highly loaded by a complex task. In all experiments, vibrotactile feedback felt, after some training, more natural for both controls and SCI users

Haptic Mediation through Artificial Intelligence: Magnetorheological Fluid as Vibrotactile Signal Mediator

challenges in creating reliable vibrotactile feedback within noisy environments can be addressed by developing a dynamic actuation platform. This research proposes the use of an AI-driven dynamically adaptive process to generate, mediate and verify tactile signals created for surface-based interaction. Our approach looks at vibrotactile feedback from a holistic point of view and targets creating reliable end-to-end communication across devices and environments.acceptedVersionPeer reviewe