Change in brain activity through virtual reality-based brain-machine communication in a chronic tetraplegic subject with muscular dystrophy

<p>Abstract</p> <p>Background</p> <p>For severely paralyzed people, a brain-computer interface (BCI) provides a way of re-establishing communication. Although subjects with muscular dystrophy (MD) appear to be potential BCI users, the actual long-term effects of BCI use on brain activities in MD subjects have yet to be clarified. To investigate these effects, we followed BCI use by a chronic tetraplegic subject with MD over 5 months. The topographic changes in an electroencephalogram (EEG) after long-term use of the virtual reality (VR)-based BCI were also assessed. Our originally developed BCI system was used to classify an EEG recorded over the sensorimotor cortex in real time and estimate the user's motor intention (MI) in 3 different limb movements: feet, left hand, and right hand. An avatar in the internet-based VR was controlled in accordance with the results of the EEG classification by the BCI. The subject was trained to control his avatar via the BCI by strolling in the VR for 1 hour a day and then continued the same training twice a month at his home.</p> <p>Results</p> <p>After the training, the error rate of the EEG classification decreased from 40% to 28%. The subject successfully walked around in the VR using only his MI and chatted with other users through a voice-chat function embedded in the internet-based VR. With this improvement in BCI control, event-related desynchronization (ERD) following MI was significantly enhanced (<it>p </it>< 0.01) for feet MI (from -29% to -55%), left-hand MI (from -23% to -42%), and right-hand MI (from -22% to -51%).</p> <p>Conclusions</p> <p>These results show that our subject with severe MD was able to learn to control his EEG signal and communicate with other users through use of VR navigation and suggest that an internet-based VR has the potential to provide paralyzed people with the opportunity for easy communication.</p

Predicting mental imagery based BCI performance from personality, cognitive profile and neurophysiological patterns

Mental-Imagery based Brain-Computer Interfaces (MI-BCIs) allow their users to send commands to a computer using their brain-activity alone (typically measured by ElectroEncephaloGraphy— EEG), which is processed while they perform specific mental tasks. While very promising, MI-BCIs remain barely used outside laboratories because of the difficulty encountered by users to control them. Indeed, although some users obtain good control performances after training, a substantial proportion remains unable to reliably control an MI-BCI. This huge variability in user-performance led the community to look for predictors of MI-BCI control ability. However, these predictors were only explored for motor-imagery based BCIs, and mostly for a single training session per subject. In this study, 18 participants were instructed to learn to control an EEG-based MI-BCI by performing 3 MI-tasks, 2 of which were non-motor tasks, across 6 training sessions, on 6 different days. Relationships between the participants’ BCI control performances and their personality, cognitive profile and neurophysiological markers were explored. While no relevant relationships with neurophysiological markers were found, strong correlations between MI-BCI performances and mental-rotation scores (reflecting spatial abilities) were revealed. Also, a predictive model of MI-BCI performance based on psychometric questionnaire scores was proposed. A leave-one-subject-out cross validation process revealed the stability and reliability of this model: it enabled to predict participants’ performance with a mean error of less than 3 points. This study determined how users’ profiles impact their MI-BCI control ability and thus clears the way for designing novel MI-BCI training protocols, adapted to the profile of each user

A comparison of univariate, vector, bilinear autoregressive, and band power features for brain–computer interfaces

Selecting suitable feature types is crucial to obtain good overall brain–computer interface performance. Popular feature types include logarithmic band power (logBP), autoregressive (AR) parameters, time-domain parameters, and wavelet-based methods. In this study, we focused on different variants of AR models and compare performance with logBP features. In particular, we analyzed univariate, vector, and bilinear AR models. We used four-class motor imagery data from nine healthy users over two sessions. We used the first session to optimize parameters such as model order and frequency bands. We then evaluated optimized feature extraction methods on the unseen second session. We found that band power yields significantly higher classification accuracies than AR methods. However, we did not update the bias of the classifiers for the second session in our analysis procedure. When updating the bias at the beginning of a new session, we found no significant differences between all methods anymore. Furthermore, our results indicate that subject-specific optimization is not better than globally optimized parameters. The comparison within the AR methods showed that the vector model is significantly better than both univariate and bilinear variants. Finally, adding the prediction error variance to the feature space significantly improved classification results

Detecting Awareness in the Vegetative State: Electroencephalographic Evidence for Attempted Movements to Command

Patients in the Vegetative State (VS) do not produce overt motor behavior to command and are therefore considered to be unaware of themselves and of their environments. However, we recently showed that high-density electroencephalography (EEG) can be used to detect covert command-following in some VS patients. Due to its portability and inexpensiveness, EEG assessments of awareness have the potential to contribute to a standard clinical protocol, thus improving diagnostic accuracy. However, this technique requires refinement and optimization if it is to be used widely as a clinical tool. We asked a patient who had been repeatedly diagnosed as VS for 12-years to try to move his left and right hands, between periods of rest, while EEG was recorded from four scalp electrodes. We identified appropriate and statistically reliable modulations of sensorimotor beta rhythms following commands to try to move, which could be significantly classified at a single-trial level. These reliable effects indicate that the patient attempted to follow the commands, and was therefore aware, but was unable to execute an overtly discernable action. The cognitive demands of this novel task are lower than those used previously and, crucially, allow for awareness to be determined on the basis of a 20-minute EEG recording made with only four electrodes. This approach makes EEG assessments of awareness clinically viable, and therefore has potential for inclusion in a standard assessment of awareness in the VS

Source analysis of beta-synchronisation and cortico-muscular coherence after movement termination based on high resolution electroencephalography

We hypothesized that post-movement beta synchronization (PMBS) and cortico-muscular coherence (CMC) during movement termination relate to each other and have similar role in sensorimotor integration. We calculated the parameters and estimated the sources of these phenomena.We measured 64-channel EEG simultaneously with surface EMG of the right first dorsal interosseus muscle in 11 healthy volunteers. In Task1, subjects kept a medium-strength contraction continuously; in Task2, superimposed on this movement, they performed repetitive self-paced short contractions. In Task3 short contractions were executed alone. Time-frequency analysis of the EEG and CMC was performed with respect to the offset of brisk movements and averaged in each subject. Sources of PMBS and CMC were also calculated.High beta power in Task1, PMBS in Task2-3, and CMC in Task1-2 could be observed in the same individual frequency bands. While beta synchronization in Task1 and PMBS in Task2-3 appeared bilateral with contralateral predominance, CMC in Task1-2 was strictly a unilateral phenomenon; their main sources did not differ contralateral to the movement in the primary sensorimotor cortex in 7 of 11 subjects in Task1, and in 6 of 9 subjects in Task2. In Task2, CMC and PMBS had the same latency but their amplitudes did not correlate with each other. In Task2, weaker PMBS source was found bilaterally within the secondary sensory cortex, while the second source of CMC was detected in the premotor cortex, contralateral to the movement. In Task3, weaker sources of PMBS could be estimated in bilateral supplementary motor cortex and in the thalamus. PMBS and CMC appear simultaneously at the end of a phasic movement possibly suggesting similar antikinetic effects, but they may be separate processes with different active functions. Whereas PMBS seems to reset the supraspinal sensorimotor network, cortico-muscular coherence may represent the recalibration of cortico-motoneuronal and spinal systems

Unilateral Exoskeleton Imposes Significantly Different Hemispherical Effect in Parietooccipital Region, but Not in Other Regions

In modern society, increasing people suffering from locomotor disabilities need an assistive exoskeleton to help them improve or restore ambulation. When walking is assisted by an exoskeleton, brain activities are altered as the closed-loop between brain and lower limbs is affected by the exoskeleton. Intuitively, a unilateral exoskeleton imposes differential effect on brain hemispheres (i.e., hemispherical effect) according to contralateral control mechanism. However, it is unclear whether hemispherical effect appears in whole hemisphere or particular region. To this end, we explored hemispherical effect on different brain regions using EEG data collected from 30 healthy participants during overground walking. The results showed that hemispherical effect was significantly different between regions when a unilateral exoskeleton was employed for walking assistance and no significance was observed for walking without the exoskeleton. Post-hoc t-test analysis revealed that hemispherical effect in the parietooccipital region significantly differed from other regions. In the parietooccipital region, a greater hemispherical effect was observed in beta band for exoskeleton-assisted walking compared to walking without exoskeleton, which was also found in the source analysis. These findings deepen the understanding of hemispherical effect of unilateral exoskeleton on brain and could aid the development of more efficient and suitable exoskeleton for walking assistance

Separating heart and brain: on the reduction of physiological noise from multichannel functional near-infrared spectroscopy (fNIRS) signals.

Objective: Functional near-infrared spectroscopy (fNIRS) is an emerging technique for the in vivo assessment of functional activity of the cerebral cortex as well as in the field of brain-computer interface (BCI) research. A common challenge for the utilization of fNIRS in these areas is a stable and reliable investigation of the spatio-temporal hemodynamic patterns. However, the recorded patterns may be influenced and superimposed by signals generated from physiological processes, resulting in an inaccurate estimation of the cortical activity. Up to now only a few studies have investigated these influences, and still less has been attempted to remove/reduce these influences. The present study aims to gain insights into the reduction of physiological rhythms in hemodynamic signals (oxygenated hemoglobin (oxy-Hb), deoxygenated hemoglobin (deoxy-Hb)). Approach: We introduce the use of three different signal processing approaches (spatial filtering, a common average reference (CAR) method; independent component analysis (ICA); and transfer function (TF) models) to reduce the influence of respiratory and blood pressure (BP) rhythms on the hemodynamic responses. Main results: All approaches produce large reductions in BP and respiration influences on the oxy-Hb signals and, therefore, improve the contrast-to-noise ratio (CNR). In contrast, for deoxy-Hb signals CAR and ICA did not improve the CNR. However, for the TF approach, a CNR-improvement in deoxy-Hb can also be found. Significance: The present study investigates the application of different signal processing approaches to reduce the influences of physiological rhythms on the hemodynamic responses. In addition to the identification of the best signal processing method, we also show the importance of noise reduction in fNIRS data