A Review of Smart Materials in Tactile Actuators for Information Delivery

As the largest organ in the human body, the skin provides the important sensory channel for humans to receive external stimulations based on touch. By the information perceived through touch, people can feel and guess the properties of objects, like weight, temperature, textures, and motion, etc. In fact, those properties are nerve stimuli to our brain received by different kinds of receptors in the skin. Mechanical, electrical, and thermal stimuli can stimulate these receptors and cause different information to be conveyed through the nerves. Technologies for actuators to provide mechanical, electrical or thermal stimuli have been developed. These include static or vibrational actuation, electrostatic stimulation, focused ultrasound, and more. Smart materials, such as piezoelectric materials, carbon nanotubes, and shape memory alloys, play important roles in providing actuation for tactile sensation. This paper aims to review the background biological knowledge of human tactile sensing, to give an understanding of how we sense and interact with the world through the sense of touch, as well as the conventional and state-of-the-art technologies of tactile actuators for tactile feedback delivery

Soft Pneumatic Actuator Skin with Piezoelectric Sensors for Vibrotactile Feedback

The latest wearable technologies demand more intuitive and sophisticated interfaces for communication, sensing, and feedback closer to the body. Evidently, such interfaces require flexibility and conformity without losing their functionality even on rigid surfaces. Although there have been various research efforts in creating tactile feedback to improve various haptic interfaces and master–slave manipulators, we are yet to see a comprehensive device that can both supply vibratory actuation and tactile sensing. This paper describes a soft pneumatic actuator (SPA)-based skin prototype that allows bidirectional tactile information transfer to facilitate simpler and responsive wearable interface. We describe the design and fabrication of a 1.4 mm-thick vibratory SPA – skin that is integrated with piezoelectric sensors. We examine in detail the mechanical performance compared to the SPA model and the sensitivity of the sensors for the application in vibrotactile feedback. Experimental findings show that this ultra-thin SPA and the unique integration process of the discrete lead zirconate titanate (PZT)-based piezoelectric sensors achieve high resolution of soft contact sensing as well as accurate control on vibrotactile feedback by closing the control loop

Touching on elements for a non-invasive sensory feedback system for use in a prosthetic hand

Hand amputation results in the loss of motor and sensory functions, impacting activities of daily life and quality of life. Commercially available prosthetic hands restore the motor function but lack sensory feedback, which is crucial to receive information about the prosthesis state in real-time when interacting with the external environment. As a supplement to the missing sensory feedback, the amputee needs to rely on visual and audio cues to operate the prosthetic hand, which can be mentally demanding. This thesis revolves around finding potential solutions to contribute to an intuitive non-invasive sensory feedback system that could be cognitively less burdensome and enhance the sense of embodiment (the feeling that an artificial limb belongs to one’s own body), increasing acceptance of wearing a prosthesis.A sensory feedback system contains sensors to detect signals applied to the prosthetics. The signals are encoded via signal processing to resemble the detected sensation delivered by actuators on the skin. There is a challenge in implementing commercial sensors in a prosthetic finger. Due to the prosthetic finger’s curvature and the fact that some prosthetic hands use a covering rubber glove, the sensor response would be inaccurate. This thesis shows that a pneumatic touch sensor integrated into a rubber glove eliminates these errors. This sensor provides a consistent reading independent of the incident angle of stimulus, has a sensitivity of 0.82 kPa/N, a hysteresis error of 2.39±0.17%, and a linearity error of 2.95±0.40%.For intuitive tactile stimulation, it has been suggested that the feedback stimulus should be modality-matched with the intention to provide a sensation that can be easily associated with the real touch on the prosthetic hand, e.g., pressure on the prosthetic finger should provide pressure on the residual limb. A stimulus should also be spatially matched (e.g., position, size, and shape). Electrotactile stimulation has the ability to provide various sensations due to it having several adjustable parameters. Therefore, this type of stimulus is a good candidate for discrimination of textures. A microphone can detect texture-elicited vibrations to be processed, and by varying, e.g., the median frequency of the electrical stimulation, the signal can be presented on the skin. Participants in a study using electrotactile feedback showed a median accuracy of 85% in differentiating between four textures.During active exploration, electrotactile and vibrotactile feedback provide spatially matched modality stimulations, providing continuous feedback and providing a displaced sensation or a sensation dispatched on a larger area. Evaluating commonly used stimulation modalities using the Rubber Hand Illusion, modalities which resemble the intended sensation provide a more vivid illusion of ownership for the rubber hand.For a potentially more intuitive sensory feedback, the stimulation can be somatotopically matched, where the stimulus is experienced as being applied on a site corresponding to their missing hand. This is possible for amputees who experience referred sensation on their residual stump. However, not all amputees experience referred sensations. Nonetheless, after a structured training period, it is possible to learn to associate touch with specific fingers, and the effect persisted after two weeks. This effect was evaluated on participants with intact limbs, so it remains to evaluate this effect for amputees.In conclusion, this thesis proposes suggestions on sensory feedback systems that could be helpful in future prosthetic hands to (1) reduce their complexity and (2) enhance the sense of body ownership to enhance the overall sense of embodiment as an addition to an intuitive control system

Tacsac: a wearable haptic device with capacitive touch-sensing capability for tactile display

This paper presents a dual-function wearable device (Tacsac) with capacitive tactile sensing and integrated tactile feedback capability to enable communication among deafblind people. Tacsac has a skin contactor which enhances localized vibrotactile stimulation of the skin as a means of feedback to the user. It comprises two main modules—the touch-sensing module and the vibrotactile module; both stacked and integrated as a single device. The vibrotactile module is an electromagnetic actuator that employs a flexible coil and a permanent magnet assembled in soft poly (dimethylsiloxane) (PDMS), while the touch-sensing module is a planar capacitive metal-insulator-metal (MIM) structure. The flexible coil was fabricated on a 50 µm polyimide (PI) sheet using Lithographie Galvanoformung Abformung (LIGA) micromoulding technique. The Tacsac device has been tested for independent sensing and actuation as well as dual sensing-actuation mode. The measured vibration profiles of the actuator showed a synchronous response to external stimulus for a wide range of frequencies (10 Hz to 200 Hz) within the perceivable tactile frequency thresholds of the human hand. The resonance vibration frequency of the actuator is in the range of 60–70 Hz with an observed maximum off-plane displacement of 0.377 mm at coil current of 180 mA. The capacitive touch-sensitive layer was able to respond to touch with minimal noise both when actuator vibration is ON and OFF. A mobile application was also developed to demonstrate the application of Tacsac for communication between deafblind person wearing the device and a mobile phone user who is not deafblind. This advances existing tactile displays by providing efficient two-way communication through the use of a single device for both localized haptic feedback and touch-sensing

Turing-Test Evaluation of a Mobile Haptic Virtual Reality Kissing Machine

Various communication systems have been developed to integrate the haptic channel in digital communication. Future directions of such haptic technologies are moving towards realistic virtual reality applications and human-robot social interaction. With the digitisation of touch, robots equipped with touch sensors and actuators can communicate with humans on a more emotional and intimate level, such as sharing a hug or kiss just like humans do. This paper presents the design guideline, implementation and evaluations of a novel haptic kissing machine for smart phones - the Kissenger machine. The key novelties and contributions of the paper are: (i) A novel haptic kissing device for mobile phones, which uses dynamic perpendicular force stimulation to transmit realistic sensations of kissing in order to enhance intimacy and emotional connection of digital communication; (ii) Extensive evaluations of the Kissenger machine, including a lab experiment that compares mediated kissing with Kissenger to real kissing, a unique haptic Turing test that involves the first academic study of humanmachine kiss, and a field study of the effects of Kissenger on long distance relationships

Robotic simulators for tissue examination training with multimodal sensory feedback

Tissue examination by hand remains an essential technique in clinical practice. The effective application depends on skills in sensorimotor coordination, mainly involving haptic, visual, and auditory feedback. The skills clinicians have to learn can be as subtle as regulating finger pressure with breathing, choosing palpation action, monitoring involuntary facial and vocal expressions in response to palpation, and using pain expressions both as a source of information and as a constraint on physical examination. Patient simulators can provide a safe learning platform to novice physicians before trying real patients. This paper reviews state-of-the-art medical simulators for the training for the first time with a consideration of providing multimodal feedback to learn as many manual examination techniques as possible. The study summarizes current advances in tissue examination training devices simulating different medical conditions and providing different types of feedback modalities. Opportunities with the development of pain expression, tissue modeling, actuation, and sensing are also analyzed to support the future design of effective tissue examination simulators

Development and Validation of a Wearable Device to Provide Rich Somatosensory Stimulation for Rehabilitation After Sensorimotor Impairment

: Training sensory discrimination of the skin has the potential to reduce chronic pain due to sensorimotor impairments and increase sensorimotor function. Currently, there is no such device that can systematically provide rich skin stimulation suitable for a training protocol for individuals with amputation or major sensory impairment. This study describes the development and validation of a non-invasive wearable device meant to repeatedly and safely deliver somatosensory stimulations. The development was guided by a structured design control process to ensure the verifiability and validity of the design outcomes. Two sub-systems were designed: 1) a tactile display for touch and vibration sensations, and 2) a set of bands for sliding, pressure, and strain sensations. The device was designed with a versatile structure that allows for its application on different body parts. We designed a device-paired interactive computer program to enable structured sensory training sessions. Validation was performed with 11 individuals with intact limbs whose upper arm tactile sensitivity was measured over 5 training sessions. Tactile discrimination and perception threshold were measured using the standard 2-point discrimination and Semmes-Weinstein monofilament tests, respectively. The results of the monofilament test showed a significant improvement (p = 0.011), but the improvement was not significant for the 2-point discrimination test(p = 0.141). These promising results confirm the potential of the proposed training to increase the sensory acuity in the upper arms of individuals with intact limbs. Further studies will be conducted to determine how to transfer the findings of this work to improve the pain and/or functional rehabilitation in individuals with sensorimotor impairments

HapBead: on-skin microfluidic haptic interface using tunable bead

On-skin haptic interfaces using soft elastomers which are thin and flexible have significantly improved in recent years. Many are focused on vibrotactile feedback that requires complicated parameter tuning. Another approach is based on mechanical forces created via piezoelectric devices and other methods for non-vibratory haptic sensations like stretching, twisting. These are often bulky with electronic components and associated drivers are complicated with limited control of timing and precision. This paper proposes HapBead, a new on-skin haptic interface that is capable of rendering vibration like tactile feedback using microfluidics. HapBead leverages a microfluidic channel to precisely and agilely oscillate a small bead via liquid flow, which then generates various motion patterns in channel that creates highly tunable haptic sensations on skin. We developed a proof-of-concept design to implement thin, flexible and easily affordable HapBead platform, and verified its haptic rendering capabilities via attaching it to users’ fingertips. A study was carried out and confirmed that participants could accurately tell six different haptic patterns rendered by HapBead. HapBead enables new wearable display applications with multiple integrated functionalities such as on-skin haptic doodles, mixed reality haptics and visual-haptic displays

Design and fabrication of flexible tactile sensing and feedback interface for communication by deafblind people

Humans generally interact and communicate using five basic sensory modalities and mainly through vision, touch and audio. However, this does not work for deafblind people as they have both impaired hearing and vision modalities, and hence rely on touch-sensing. This necessitates the development of alternative means that allows them to independently interact and communicate. To do this requires a solution which has the capability for tactile sensing and feedback. Therefore, tactile interface becomes a critical component of any assistive device usable by deafblind people for interaction and communication. Given that existing solutions mainly use rigid and commercial components, there is a need to tap into the advancements in flexible electronics in order develop more effective and conformable solutions. This research involves the development of flexible tactile communication interface usable in assistive communication devices for deafblind people. First, commercial sensors and actuators were utilised as a proof-of-concept and then four novel tactile interfaces were explored which include two similar touch-sensitive electromagnetic actuators, one capacitive tactile sensing array, and a facile flexible inductance-based pressure sensor. The two fabricated touch-sensitive electromagnetic actuators (Type 1 and 2) are both based on electromagnetic principle and capable of simultaneous tactile sensing and feedback. Each comprises of a tandem combination of two main modules - the touch-sensing and the actuation module, with both modules integrated as a single device in each case. The actuation module employs a flexible planar spiral coil and a Neodymium magnet assembled in a soft Polydimethylsiloxane (PDMS) structure, while the touch-sensing module is a planar capacitive metal- insulator-metal structure of copper. The flexible coil (~17µm thick and with 45 turns) was fabricated on a Polyimide sheet using Lithographie Galvanoformung Abformung (LIGA) process. The results of characterisation of these actuators at frequencies ranging from 10Hz to 200Hz, shows a maximum displacement (~ 190µm) around 40Hz. Evaluation of this by 40 (20 deafblind and 20 sighted and hearing) participants show that they can feel vibration at this range. Another tactile interface fabricated is an 8 x 8 capacitive tactile sensing array. The sensor was developed on a flexible Polyvinyl Chloride (PVC) sheet with column electrodes deposited on one side and row electrodes on the reverse side. It is intended for use as an assistive tactile communication interface for deafblind people who communicate using deafblind manual alphabets as well as the English block letters. An inductance-based pressure sensor was also designed, fabricated and characterised for use as an input interface for finger Braille as well as other tactile communication methods for deafblind people. It was realised with a soft ferromagnetic elastomer and a 17µm-thick coil fabricated on a flexible 50 µm-thick polyimide sheet. The ferromagnetic elastomer acts as the core of the coil, which when pressed, sees the metal particles moving closer to each other, leading to changes in the inductance. The coil, with 75µm conductor and 25µm pitch, was also realised using LIGA micromolding technique. Seven different sensors were fabricated using different ratios (1:1, 1:2, 1:3, 1:5, 2:1, 3:1, and 5:1) of Ecoflex to Iron particles. The performance of each sensor was investigated and generally, sensors with higher Iron particles gave better sensitivity, linear as well as dynamic range. In comparison with all other fabricated sensors, the sensor made with 1:5DD was recommended for application as a tactile interface