Integrating EEG and MEG signals to improve motor imagery classification in brain-computer interfaces

We propose a fusion approach that combines features from simultaneously recorded electroencephalographic (EEG) and magnetoencephalographic (MEG) signals to improve classification performances in motor imagery-based brain-computer interfaces (BCIs). We applied our approach to a group of 15 healthy subjects and found a significant classification performance enhancement as compared to standard single-modality approaches in the alpha and beta bands. Taken together, our findings demonstrate the advantage of considering multimodal approaches as complementary tools for improving the impact of non-invasive BCIs

Comparing Features for Classification of MEG Responses to Motor Imagery

Peer reviewe

Transcranial magnetic stimulation for individual identification of the best electrode position for a motor imagery-based brain-computer interface

Background: For the translation of noninvasive motor imagery (MI)-based brain-computer interfaces (BCIs) from the lab environment to end users at their homes, their handling must be improved. As a key component, the number of electroencephalogram (EEG)-recording electrodes has to be kept at a minimum. However, due to inter-individual anatomical and physiological variations, reducing the number of electrodes bares the risk of electrode misplacement, which will directly translate into a limited BCI performance of end users. The aim of the study is to evaluate the use of focal transcranial magnetic stimulation (TMS) as an easy tool to individually optimize electrode positioning for a MI-based BCI. For this, the area of MI-induced mu-rhythm modulation was compared with the motor hand representation area in respect to their localization and to the control performance of a MI-based BCI. Methods: Focal TMS was applied to map the motor hand areas and a 48-channel high-resolution EEG was used to localize MI-induced mu-rhythm modulations in 11 able-bodied, right-handed subjects (5 male, age: 23–31). The online BCI performances of the study participants were assessed with a single next-neighbor Laplace channel consecutively placed over the motor hand area and over the area of the strongest mu-modulation. Results: For most subjects, a consistent deviation between the position of the mu-modulation center and the corresponding motor hand areas well above the localization error could be observed in mediolateral and to a lesser degree in anterior-posterior direction. On an individual level, the MI-induced mu-rhythm modulation was at average found 1.6 cm (standard deviation (SD) = 1.30 cm) lateral and 0.31 cm anterior (SD = 1.39 cm) to the motor hand area and enabled a significantly better online BCI performance than the motor hand areas. Conclusion: On an individual level a trend towards a consistent average spatial distance between motor hand area and mu-rhythm modulation center was found indicating that TMS may be used as a simple tool for quick individual optimization of EEG-recording electrode positions of MI-based BCIs. The study results indicate that motor hand areas of the primary motor cortex determined by TMS are not the main generators of the cortical mu-rhythm

Brain-Switches for Asynchronous Brain−Computer Interfaces: A Systematic Review

A brain–computer interface (BCI) has been extensively studied to develop a novel communication system for disabled people using their brain activities. An asynchronous BCI system is more realistic and practical than a synchronous BCI system, in that, BCI commands can be generated whenever the user wants. However, the relatively low performance of an asynchronous BCI system is problematic because redundant BCI commands are required to correct false-positive operations. To significantly reduce the number of false-positive operations of an asynchronous BCI system, a two-step approach has been proposed using a brain-switch that first determines whether the user wants to use an asynchronous BCI system before the operation of the asynchronous BCI system. This study presents a systematic review of the state-of-the-art brain-switch techniques and future research directions. To this end, we reviewed brain-switch research articles published from 2000 to 2019 in terms of their (a) neuroimaging modality, (b) paradigm, (c) operation algorithm, and (d) performance

Proprioceptive Feedback and Brain Computer Interface (BCI) Based Neuroprostheses

Brain computer interface (BCI) technology has been proposed for motor neurorehabilitation, motor replacement and assistive technologies. It is an open question whether proprioceptive feedback affects the regulation of brain oscillations and therefore BCI control. We developed a BCI coupled on-line with a robotic hand exoskeleton for flexing and extending the fingers. 24 healthy participants performed five different tasks of closing and opening the hand: (1) motor imagery of the hand movement without any overt movement and without feedback, (2) motor imagery with movement as online feedback (participants see and feel their hand, with the exoskeleton moving according to their brain signals, (3) passive (the orthosis passively opens and closes the hand without imagery) and (4) active (overt) movement of the hand and rest. Performance was defined as the difference in power of the sensorimotor rhythm during motor task and rest and calculated offline for different tasks. Participants were divided in three groups depending on the feedback receiving during task 2 (the other tasks were the same for all participants). Group 1 (n = 9) received contingent positive feedback (participants' sensorimotor rhythm (SMR) desynchronization was directly linked to hand orthosis movements), group 2 (n = 8) contingent “negative” feedback (participants' sensorimotor rhythm synchronization was directly linked to hand orthosis movements) and group 3 (n = 7) sham feedback (no link between brain oscillations and orthosis movements). We observed that proprioceptive feedback (feeling and seeing hand movements) improved BCI performance significantly. Furthermore, in the contingent positive group only a significant motor learning effect was observed enhancing SMR desynchronization during motor imagery without feedback in time. Furthermore, we observed a significantly stronger SMR desynchronization in the contingent positive group compared to the other groups during active and passive movements. To summarize, we demonstrated that the use of contingent positive proprioceptive feedback BCI enhanced SMR desynchronization during motor tasks