Artificial Tongue-Placed Tactile Biofeedback for perceptual supplementation: application to human disability and biomedical engineering

The present paper aims at introducing the innovative technologies, based on the concept of "sensory substitution" or "perceptual supplementation", we are developing in the fields of human disability and biomedical engineering. Precisely, our goal is to design, develop and validate practical assistive biomedical and/technical devices and/or rehabilitating procedures for persons with disabilities, using artificial tongue-placed tactile biofeedback systems. Proposed applications are dealing with: (1) pressure sores prevention in case of spinal cord injuries (persons with paraplegia, or tetraplegia); (2) ankle proprioceptive acuity improvement for driving assistance in older and/or disabled adults; and (3) balance control improvement to prevent fall in older and/or disabled adults. This paper presents results of three feasibility studies performed on young healthy adults

Postural destabilization induced by trunk extensor muscles fatigue is suppressed by use of a plantar pressure-based electro-tactile biofeedback

Separate studies have reported that postural control during quiet standing could be (1) impaired with muscle fatigue localized at the lower back, and (2) improved through the use of plantar pressure-based electro-tactile biofeedback, under normal neuromuscular state. The aim of this experiment was to investigate whether this biofeedback could reduce postural destabilization induced by trunk extensor muscles. Ten healthy adults were asked to stand as immobile as possible in four experimental conditions: (1) no fatigue/no biofeedback, (2) no fatigue/biofeedback, (3) fatigue/no biofeedback and (4) fatigue/biofeedback. Muscular fatigue was achieved by performing trunk repetitive extensions until maximal exhaustion. The underlying principle of the biofeedback consisted of providing supplementary information related to foot sole pressure distribution through electro-tactile stimulation of the tongue. Centre of foot pressure (CoP) displacements were recorded using a force platform. Results showed (1) increased CoP displacements along the antero-posterior axis in the fatigue than no fatigue condition in the absence of biofeedback and (2) no significant difference between the no fatigue and fatigue conditions in the presence of biofeedback. This suggests that subjects were able to efficiently integrate an artificial plantar pressure information delivered through electro-tactile stimulation of the tongue that allowed them to suppress the destabilizing effect induced by trunk extensor muscles fatigue

Effect of saccades in tongue electrotactile stimulation for vision substitution applications

The visual substitution paradigm aims to facilitate the life of blind people. Generally one uses electro-stimulating devices where electrodes are arranged into arrays to stimulate the skin or the tongue mucosa to send signals of visual type to the subjects. When an electro-stimulation signal is applied continuously (e.g. when static visual scenes are displayed for a long period of time), the receptors of the affected region can get saturated and the patient may lose the displayed information. We propose here some mechanisms that ameliorate the quality of perception of the electro-stimulation information. The electrical signal is encoded as 2D scenes projected onto the tongue via a Tongue Display Unit, i.e. an electro-tactile stimulator formed by a 12x12 matrix of electrodes. We propose to apply stochastic saccades on this signal. Our assumption is that this eye-inspired mechanism should make the visual substitution more efficient (by improving the perception) because of the reduction of the tactile receptors saturation. The influence of saccades was evaluated by a series of experiments. Results revealed a benefit on the persistence of perception due to saccades. This work helps to prevent the saturation of receptors on the tongue. Therefore increasing the quality of vision by the way of the electro-stimulation. It allows new enhancement features to retinal prosthesis devices which suffer from the same phenomenon

Tongue Liminary Threshold Identification to Electrotactile Stimulation

Many applications use electrostimulation of the human skin to provide tactile sensation. The effect of electrotactile stimulations were studied on a 6x6 matrix of tactile electrodes placed on the anterior part of the tongue. The liminary threshold with continuous or discontinuous waveform and patterns with 2 or 4 electrodes was investigated. The result suggest that for energy saving and to improve the yield, it would probably be better to use discontinuous stimulation with two electrode patterns

LeviSense: a platform for the multisensory integration in levitating food and insights into its effect on flavour perception

Eating is one of the most multisensory experiences in everyday life. All of our five senses (i.e. taste, smell, vision, hearing and touch) are involved, even if we are not aware of it. However, while multisensory integration has been well studied in psychology, there is not a single platform for testing systematically the effects of different stimuli. This lack of platform results in unresolved design challenges for the design of taste-based immersive experiences. Here, we present LeviSense: the first system designed for multisensory integration in gustatory experiences based on levitated food. Our system enables the systematic exploration of different sensory effects on eating experiences. It also opens up new opportunities for other professionals (e.g., molecular gastronomy chefs) looking for innovative taste-delivery platforms. We describe the design process behind LeviSense and conduct two experiments to test a subset of the crossmodal combinations (i.e., taste and vision, taste and smell). Our results show how different lighting and smell conditions affect the perceived taste intensity, pleasantness, and satisfaction. We discuss how LeviSense creates a new technical, creative, and expressive possibilities in a series of emerging design spaces within Human-Food Interaction

A Wireless Lingual Feedback Device to Reduce Overpressures in Seated Posture: A Feasibility Study

BACKGROUND:Pressure sores are localized injuries to the skin and underlying tissues and are mainly resulting from overpressure. Paraplegic peoples are particularly subjects to pressure sores because of long-time seated postures and sensory deprivation at the lower limbs. METHODOLOGY/PRINCIPAL FINDINGS:Here we report outcomes of a feasibility trial involving a biofeedback system aimed at reducing buttock overpressure whilst an individual is seated. The system consists of (1) pressure sensors, (2) a laptop coupling sensors and actuator (3) a wireless Tongue Display Unit (TDU) consisting of a circuit embedded in a dental retainer with electrodes put in contact with the tongue. The principle consists in (1) detecting overpressures in people who are seated over long periods of time, (2) estimating a postural change that could reduce these overpressures and (3) communicating this change through directional information transmitted by the TDU.Twenty-four healthy subjects voluntarily participated in this study. Twelve healthy subjects initially formed the experimental group (EG) and were seated on a chair with the wireless TDU inside their mouth. They were asked to follow TDU orders that were randomly spread throughout the session. They were evaluated during two experimental sessions during which 20 electro-stimulations were sent. Twelve other subjects, added retrospectively, formed the control group (CG). These subjects participated in one session of the same experiment without any biofeedback.Three dependent variables were computed: (1) the ability of subjects to reach target posture (EG versus CG), (2) high pressure reductions after a biofeedback (EG versus CG) and (3) the level of these reductions relative to their initial values (EG only). Results show (1) that EG reached target postures in 90.2% of the trials, against 5,3% in the CG, (2) a significant reduction in overpressures in the EG compared to the CG and (3), for the EG, that the higher the initial pressures were, the more they were decreased. CONCLUSIONS/SIGNIFICANCE:The findings suggest that, in this trial, subjects were able to use a tongue tactile feedback system to reduce buttock overpressure while seated. Further evaluation of this system on paraplegic subjects remains to be done

Electrotactile vision substitution for 3D trajectory following

Navigation for blind persons represents a challenge for researchers in vision substitution. In this field, one of the used techniques to navigate is guidance. In this study, we develop a new approach for 3D trajectory following in which the requested task is to track a light path using computer input devices (keyboard and mouse) or a rigid body handled in front of a stereoscopic camera. The light path is visualized either on direct vision or by way of a electro-stimulation device, the Tongue Display Unit, a 12x12 matrix of electrodes. We improve our method by a series of experiments in which the effect of the modality of perception and that of the input device. Preliminary results indicated a close correlation between the stimulated and recorded trajectories

Development of an Electrotactile Haptic Device with Application to Balance Rehabilitation

Balance impairments affect many individuals especially those in the older age bracket, and can lead to severe complications from falls. Research has shown that the cause of these impairments can be attributed to degraded sensory inputs. With ample sensory supplementation (or sensory augmentation), these deficiencies may be overcome. The purpose of this research is to verify a design of a low-cost custom electrotactile stimulation device that can aid in balance rehabilitation purposes. To this end, a major focus will be on wearability. Presently, there is a large research gap in the field of electrotactile stimulation for achieving wearable designs. Additionally, few devices incorporate a sensing mechanism for detecting balance impairment such as with an inertial measurement unit. Many researchers still rely on expensive commercial devices that are very large and bulky. Additionally, the design and implementation of electrotactile stimulation devices require working knowledge of circuits, thus there is mainly a general lack of instructions for the design of such devices. The thesis hopes to address these gaps by studying a design that may be simple to replicate from scratch. The design includes the use of several half H-bridge circuits to produce localized dipole stimulation through a 4 by 4 electrode array. Feasibility of the design will be verified via oscilloscope measurements and a small pilot study that is aimed at obtaining user feedback. The wearable components of the device include a custom-fabricated electrode array to be worn on the wrist or arm, and also an IMU (inertial measurement unit) belt along the waist to measure the user’s sway angle along the sagittal plane. Preliminary results show that a user can detect sensations from dry-skin stimulation while wearing the electrode array. The detected sensations also include directional information. Additionally, verification with the subject showed that the device is able to provide biofeedback through an electrode array as a result of the IMU orientation information. Further design refinements such as better point discrimination, pattern generation, and consistent pulsing are required before proceeding to the human testing and validation stage