To “Sketch-a-Scratch”

A surface can be harsh and raspy, or smooth and silky, and everything in between. We are used to sense these features with our fingertips as well as with our eyes and ears: the exploration of a surface is a multisensory experience. Tools, too, are often employed in the interaction with surfaces, since they augment our manipulation capabilities. “Sketch-a-Scratch” is a tool for the multisensory exploration and sketching of surface textures. The user’s actions drive a physical sound model of real materials’ response to interactions such as scraping, rubbing or rolling. Moreover, different input signals can be converted into 2D visual surface profiles, thus enabling to experience them visually, aurally and haptically

Hap-Pro: a wearable haptic device for proprioceptive feedback

Objective: Myolectric hand prostheses have reached a considerable technological level and gained an increasing attention in assistive robotics. However, their abandonment rate remains high, with unintuitive control and lack of sensory feedback being major causes. Among the different types of sensory information, proprioception, e.g. information on hand aperture, is crucial to successfully perform everyday actions. Despite the many attempts in literature to restore and convey this type of feedback, much remains to be done to close the action-perception loop in prosthetic devices. Methods: With this as motivation, in this work we introduce HapPro, a wearable, non-invasive haptic device that can convey proprioceptive information for a prosthetic hand. The device was used with an under-actuated, simple to control anthropomorphic robotic hand, providing information on the level of hand aperture by mapping it to the position of a wheel that can run on the user's forearm. Tests with 43 able bodied subjects and one amputee subject were conducted in order to quantify the effectiveness of HapPro as a feedback device. Results: HapPro provided a good level of accuracy for item discrimination. Participants also reported the device to be intuitive and effective in conveying proprioceptive cues. Similar results were obtained in the proof-of-concept experiment with an amputee subject. Conclusions: Results show that HapPro is able to convey information on the opening of a prosthetic hand in a non-invasive way. Significance: Using this device for proprioceptive feedback could improve usability of myoelectric prostheses, potentially reducing abandonment and increasing quality of life for their users

A Review of Non-Invasive Haptic Feedback stimulation Techniques for Upper Extremity Prostheses

A sense of touch is essential for amputees to reintegrate into their social and work life. The design of the next generation of the prostheses will have the ability to effectively convey the tactile information between the amputee and the artificial limbs. This work reviews non-invasive haptic feedback stimulation techniques to convey the tactile information from the prosthetic hand to the amputee’s brain. Various types of actuators that been used to stimulate the patient’s residual limb for different types of artificial prostheses in previous studies have been reviewed in terms of functionality, effectiveness, wearability and comfort. The non-invasive hybrid feedback stimulation system was found to be better in terms of the stimulus identification rate of the haptic prostheses’ users. It can be conclude that integrating hybrid haptic feedback stimulation system with the upper limb prostheses leads to improving its acceptance among users

A Novel Method for Vibrotactile Proprioceptive Feedback Using Spatial Encoding and Gaussian Interpolation

Objective: The bidirectional communication between the user and the prosthesis is an important requirement when developing prosthetic hands. Proprioceptive feedback is fundamental to perceiving prosthesis movement without the need for constant visual attention. We propose a novel solution to encode wrist rotation using a vibromotor array and Gaussian interpolation of vibration intensity. The approach generates tactile sensation that smoothly rotates around the forearm congruently with prosthetic wrist rotation. The performance of this scheme was systematically assessed for a range of parameter values (number of motors and Gaussian standard deviation). Methods: Fifteen able-bodied subjects and one individual with congenital limb deficiency used vibrational feedback to control the virtual hand in the target-achievement test. Performance was assessed by end-point error and efficiency as well as subjective impressions. Results: The results showed a preference for smooth feedback and a higher number of motors (8 and 6 versus 4). With 8 and 6 motors, the standard deviation, determining the sensation spread and continuity, could be modulated through a broad range of values (0.1 - 2) without a significant performance loss (error: ∼ 10%; efficiency: ∼ 30%). For low values of standard deviation (0.1-0.5), the number of motors could be reduced to 4 without a significant performance decrease. Conclusion: The study demonstrated that the developed strategy provided meaningful rotation feedback. Moreover, the Gaussian standard deviation can be used as an independent parameter to encode an additional feedback variable. Significance: The proposed method is a flexible and effective approach to providing proprioceptive feedback while adjusting the trade-off between sensation quality and the number of vibromotors

Somatic ABC's: A Theoretical Framework for Designing, Developing and Evaluating the Building Blocks of Touch-Based Information Delivery

abstract: Situations of sensory overload are steadily becoming more frequent as the ubiquity of technology approaches reality--particularly with the advent of socio-communicative smartphone applications, and pervasive, high speed wireless networks. Although the ease of accessing information has improved our communication effectiveness and efficiency, our visual and auditory modalities--those modalities that today's computerized devices and displays largely engage--have become overloaded, creating possibilities for distractions, delays and high cognitive load; which in turn can lead to a loss of situational awareness, increasing chances for life threatening situations such as texting while driving. Surprisingly, alternative modalities for information delivery have seen little exploration. Touch, in particular, is a promising candidate given that it is our largest sensory organ with impressive spatial and temporal acuity. Although some approaches have been proposed for touch-based information delivery, they are not without limitations including high learning curves, limited applicability and/or limited expression. This is largely due to the lack of a versatile, comprehensive design theory--specifically, a theory that addresses the design of touch-based building blocks for expandable, efficient, rich and robust touch languages that are easy to learn and use. Moreover, beyond design, there is a lack of implementation and evaluation theories for such languages. To overcome these limitations, a unified, theoretical framework, inspired by natural, spoken language, is proposed called Somatic ABC's for Articulating (designing), Building (developing) and Confirming (evaluating) touch-based languages. To evaluate the usefulness of Somatic ABC's, its design, implementation and evaluation theories were applied to create communication languages for two very unique application areas: audio described movies and motor learning. These applications were chosen as they presented opportunities for complementing communication by offloading information, typically conveyed visually and/or aurally, to the skin. For both studies, it was found that Somatic ABC's aided the design, development and evaluation of rich somatic languages with distinct and natural communication units.Dissertation/ThesisPh.D. Computer Science 201

Perception of interactive vibrotactile cues on the acoustic grand and upright piano

An experiment has been conducted, measuring pianists’ sensitivity to piano key vibrations at the fingers while playing an upright or a grand Yamaha Disklavier piano. At each trial, which consisted in playing loud and long A notes across the whole keyboard, vibrations were either present or absent through setting the Disklavier pianos to normal or quiet mode. Sound feedback was always provided by a MIDI controlled piano synthesizer via isolating ear/headphones, which masked the acoustic sound in normal mode. In partial disagreement with the existing literature, our results suggest that significant vibrotactile cues are produced in the lower range of the piano keyboard, with perceptual cut-off around the middle octave. Possible psychophysical mechanisms supporting the existence of such cues are additionally discussed

Spatially Distributed Tactile Feedback for Kinesthetic Motion Guidance

Apraxic stroke patients need to perform repetitive arm movements to regain motor functionality, but they struggle to process the visual feedback provided by typical virtual rehabilitation systems. Instead, we imagine a low cost sleeve that can measure the movement of the upper limb and provide tactile feedback at key locations. The feedback provided by the tactors should guide the patient through a series of desired movements by allowing him or her to feel limb configuration errors at each instant in time. After discussing the relevant motion capture and actuator options, this paper describes the design and programming of our current prototype, a wearable tactile interface that uses magnetic motion tracking and shaftless eccentric mass motors. The sensors and actuators are attached to the sleeve of an athletic shirt with novel plastic caps, which also help focus the vibration on the user\u27s skin. We connect the motors in current drive for improved performance, and we present a full parametric model for their in situ dynamic response (acceleration output given current input)

The Rice Haptic Rocker: Skin stretch haptic feedback with the Pisa/IIT SoftHand

Touch provides an important cue to perceive the physical properties of the external objects. Recent studies showed that tactile sensation also contributes to our sense of hand position and displacement in perceptual tasks. In this study, we tested the hypothesis that, sliding our hand over a stationary surface, tactile motion may provide a feedback for guiding hand trajectory. We asked participants to touch a plate having parallel ridges at different orientations and to perform a self-paced, straight movement of the hand. In our daily-life experience, tactile slip motion is equal and opposite to hand motion. Here, we used a well-established perceptual illusion to dissociate, in a controlled manner, the two motionestimates. According to previous studies, this stimulus produces a bias in the perceived direction of tactile motion, predicted by tactile flow model. We showed a systematic deviation in the movement of the hand towards a direction opposite to the one predicted by tactile flow, supporting the hypothesis that touch contributes to motor control of the hand. We suggested a model where the perceived hand motion is equal to a weighted sum of the estimate from classical proprioceptive cues (e.g., from musculoskeletal system) and the estimate from tactile slip