Combining brain-computer interfaces and assistive technologies: state-of-the-art and challenges

In recent years, new research has brought the field of EEG-based Brain-Computer Interfacing (BCI) out of its infancy and into a phase of relative maturity through many demonstrated prototypes such as brain-controlled wheelchairs, keyboards, and computer games. With this proof-of-concept phase in the past, the time is now ripe to focus on the development of practical BCI technologies that can be brought out of the lab and into real-world applications. In particular, we focus on the prospect of improving the lives of countless disabled individuals through a combination of BCI technology with existing assistive technologies (AT). In pursuit of more practical BCIs for use outside of the lab, in this paper, we identify four application areas where disabled individuals could greatly benefit from advancements in BCI technology, namely,“Communication and Control”, “Motor Substitution”, “Entertainment”, and “Motor Recovery”. We review the current state of the art and possible future developments, while discussing the main research issues in these four areas. In particular, we expect the most progress in the development of technologies such as hybrid BCI architectures, user-machine adaptation algorithms, the exploitation of users’ mental states for BCI reliability and confidence measures, the incorporation of principles in human-computer interaction (HCI) to improve BCI usability, and the development of novel BCI technology including better EEG devices

Parallel Facilitatory Reflex Pathways from the Foot and Hip to Flexors and Extensors in the Injured Human Spinal Cord

Spinal integration of sensory signals associated with hip position, muscle loading, and cutaneous sensation of the foot contributes to movement regulation. The exact interactive effects of these sensory signals under controlled dynamic conditions are unknown. The purpose of the present study was to establish the effects of combined plantar cutaneous afferent excitation and hip movement on the Hoffmann (H) and flexion reflexes in people with a spinal cord injury (SCI). The flexion and H-reflexes were elicited through stimulation of the right sural (at non-nociceptive levels) and posterior tibial nerves respectively. Reflex responses were recorded from the ipsilateral tibialis anterior (TA) (flexion reflex) and soleus (H-reflex) muscles. The plantar cutaneous afferents were stimulated at three times the perceptual threshold (200 Hz, 24-ms pulse train) at conditioning–test intervals that ranged from 3 to 90 ms. Sinusoidal movements were imposed to the right hip joint at 0.2 Hz with subjects supine. Control and conditioned reflexes were recorded as the hip moved in flexion and extension. Leg muscle activity and sagittal-plane joint torques were recorded. We found that excitation of plantar cutaneous afferents facilitated the soleus H-reflex and the long latency flexion reflex during hip extension. In contrast, the short latency flexion reflex was depressed by plantar cutaneous stimulation during hip flexion. Oscillatory joint forces were present during the transition phase of the hip movement from flexion to extension when stimuli were delivered during hip flexion. Hip-mediated input interacts with feedback from the foot sole to facilitate extensor and flexor reflex activity during the extension phase of movement. The interactive effects of these sensory signals may be a feature of impaired gait, but when they are appropriately excited, they may contribute to locomotion recovery in these patients

Audio-tactile stimuli to improve health and well-being : a preliminary position paper

From literature and through common experience it is known that stimulation of the tactile (touch) sense or auditory (hearing) sense can be used to improve people's health and well-being. For example, to make people relax, feel better, sleep better or feel comforted. In this position paper we propose the concept of combined auditory-tactile stimulation and argue that it potentially has positive effects on human health and well-being through influencing a user's body and mental state. Such effects have, to date, not yet been fully explored in scientific research. The current relevant state of the art is briefly addressed and its limitations are indicated. Based on this, a vision is presented of how auditory-tactile stimulation could be used in healthcare and various other application domains. Three interesting research challenges in this field are identified: 1) identifying relevant mechanisms of human perception of combined auditory-tactile stimuli; 2) finding methods for automatic conversions between audio and tactile content; 3) using measurement and analysis of human bio-signals and behavior to adapt the stimulation in an optimal way to the user. Ideas and possible routes to address these challenges are presented

ElectroCutscenes: Realistic Haptic Feedback in Cutscenes of Virtual Reality Games Using Electric Muscle Stimulation

Cutscenes in Virtual Reality (VR) games enhance story telling by delivering output in the form of visual, auditory, or haptic feedback (e.g., using vibrating handheld controllers). Since they lack interaction in the form of user input, cutscenes would significantly benefit from improved feedback. We introduce the concept and implementation of ElectroCutscenes, a concept in which Electric Muscle Stimulation (EMS) is leveraged to elicit physical user movements to correspond to those of personal avatars in cutscenes of VR games while the user stays passive. Through a user study (N=22) in which users passively received kinesthetic feedback resulting in involuntarily movements, we show that ElectroCutscenes significantly increases perceived presence and realism compared to controller-based vibrotactile and no haptic feedback. Furthermore, we found preliminary evidence that combining visual and EMS feedback can evoke movements that are not actuated by either of them alone. We discuss how to enhance realism and presence of cutscenes in VR games even when EMS can partially rather than completely actuate the desired body movements

Synopsis of an engineering solution for a painful problem Phantom Limb Pain

This paper is synopsis of a recently proposed solution for treating patients who suffer from Phantom Limb Pain (PLP). The underpinning approach of this research and development project is based on an extension of “mirror box” therapy which has had some promising results in pain reduction. An outline of an immersive individually tailored environment giving the patient a virtually realised limb presence, as a means to pain reduction is provided. The virtual 3D holographic environment is meant to produce immersive, engaging and creative environments and tasks to encourage and maintain patients’ interest, an important aspect in two of the more challenging populations under consideration (over-60s and war veterans). The system is hoped to reduce PLP by more than 3 points on an 11 point Visual Analog Scale (VAS), when a score less than 3 could be attributed to distraction alone

Aerospace Medicine and Biology: A continuing bibliography (supplement 160)

This bibliography lists 166 reports, articles, and other documents introduced into the NASA scientific and technical information system in October 1976

Aerospace Medicine and Biology: A continuing bibliography with indexes (supplement 141)

This special bibliography lists 267 reports, articles, and other documents introduced into the NASA scientific and technical information system in April 1975