Standardization of Protocol Design for User Training in EEG-based Brain-Computer Interface

International audienceBrain-computer interfaces (BCIs) are systems that enable a personto interact with a machine using only neural activity. Such interaction canbe non-intuitive for the user hence training methods are developed to increaseone’s understanding, confidence and motivation, which would in parallel increasesystem performance. To clearly address the current issues in the BCI usertraining protocol design, here it is divided intointroductoryperiod and BCIinteractionperiod. First, theintroductoryperiod (before BCI interaction) mustbe considered as equally important as the BCI interaction for user training. Tosupport this claim, a review of papers show that BCI performance can dependon the methodologies presented in such introductory period. To standardize itsdesign, the literature from human-computer interaction (HCI) is adjusted to theBCI context. Second, during the user-BCI interaction, the interface can takea large spectrum of forms (2D, 3D, size, color etc.) and modalities (visual,auditory or haptic etc.) without following any design standard or guidelines.Namely, studies that explore perceptual affordance on neural activity show thatmotor neurons can be triggered from a simple observation of certain objects, anddepending on objects’ properties (size, location etc.) neural reactions can varygreatly. Surprisingly, the effects of perceptual affordance were not investigatedin the BCI context. Both inconsistent introductions to BCI as well as variableinterface designs make it difficult to reproduce experiments, predict their outcomesand compare results between them. To address these issues, a protocol designstandardization for user training is proposed

Quality and denoising in real-time functional magnetic resonance imaging neurofeedback: A methods review

First published: 25 April 2020Neurofeedback training using real-time functional magnetic resonance imaging (rtfMRI-NF) allows subjects voluntary control of localised and distributed brain activity. It has sparked increased interest as a promising non-invasive treatment option in neuropsychiatric and neurocognitive disorders, although its efficacy and clinical significance are yet to be determined. In this work, we present the first extensive review of acquisition, processing and quality control methods available to improve the quality of the neurofeedback signal. Furthermore, we investigate the state of denoising and quality control practices in 128 recently published rtfMRI-NF studies. We found: (a) that less than a third of the studies reported implementing standard real-time fMRI denoising steps, (b) significant room for improvement with regards to methods reporting and (c) the need for methodological studies quantifying and comparing the contribution of denoising steps to the neurofeedback signal quality. Advances in rtfMRI-NF research depend on reproducibility of methods and results. Notably, a systematic effort is needed to build up evidence that disentangles the various mechanisms influencing neurofeedback effects. To this end, we recommend that future rtfMRI-NF studies: (a) report implementation of a set of standard real-time fMRI denoising steps according to a proposed COBIDAS-style checklist (https://osf.io/kjwhf/), (b) ensure the quality of the neurofeedback signal by calculating and reporting community-informed quality metrics and applying offline control checks and (c) strive to adopt transparent principles in the form of methods and data sharing and support of open-source rtfMRI-NF software. Code and data for reproducibility, as well as an interactive environment to explore the study data, can be accessed at https://github. com/jsheunis/quality-and-denoising-in-rtfmri-nf.LSH‐TKI, Grant/Award Number: LSHM16053‐SGF; Philips Researc

Spatial Graph Signal Interpolation with an Application for Merging BCI Datasets with Various Dimensionalities

BCI Motor Imagery datasets usually are small and have different electrodes setups. When training a Deep Neural Network, one may want to capitalize on all these datasets to increase the amount of data available and hence obtain good generalization results. To this end, we introduce a spatial graph signal interpolation technique, that allows to interpolate efficiently multiple electrodes. We conduct a set of experiments with five BCI Motor Imagery datasets comparing the proposed interpolation with spherical splines interpolation. We believe that this work provides novel ideas on how to leverage graphs to interpolate electrodes and on how to homogenize multiple datasets.Comment: Submitted to the 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2023

A Strong and Simple Deep Learning Baseline for BCI MI Decoding

We propose EEG-SimpleConv, a straightforward 1D convolutional neural network for Motor Imagery decoding in BCI. Our main motivation is to propose a very simple baseline to compare to, using only very standard ingredients from the literature. We evaluate its performance on four EEG Motor Imagery datasets, including simulated online setups, and compare it to recent Deep Learning and Machine Learning approaches. EEG-SimpleConv is at least as good or far more efficient than other approaches, showing strong knowledge-transfer capabilities across subjects, at the cost of a low inference time. We advocate that using off-the-shelf ingredients rather than coming with ad-hoc solutions can significantly help the adoption of Deep Learning approaches for BCI. We make the code of the models and the experiments accessible

Exploring the use of brain-sensing technologies for natural interactions

Recent technical innovation in the field of Brain-Computer Interfaces (BCIs) has increased the opportunity for including physical, brain-sensing devices as a part of our day-to-day lives. The potential for obtaining a time-correlated, direct, brain-based measure of a participant's mental activity is an alluring and important development for HCI researchers. In this work, we investigate the application of BCI hardware for answering HCI centred research questions, in turn, fusing the two disciplines to form an approach we name - Brain based Human-Computer Interaction (BHCI). We investigate the possibility of using BHCI to provide natural interaction - an ideal form of HCI, where communication between man-and-machine is indistinguishable from everyday forms of interactions such as Speaking and Gesturing. We present the development, execution and output of three user studies investigating the application of BHCI. We evaluate two technologies, fNIRS and EEG, and investigate their suitability for supporting BHCI based interactions. Through our initial studies, we identify that the lightweight and portable attributes of EEG make it preferable for use in developing natural interactions. Building upon this, we develop an EEG based cinematic experience exploring natural forms of interaction through the mind of the viewer. In studying the viewers response to this experience, we were able to develop a taxonomy of control based on how viewers discovered and exerted control over the experience

Exploring the use of brain-sensing technologies for natural interactions

Recent technical innovation in the field of Brain-Computer Interfaces (BCIs) has increased the opportunity for including physical, brain-sensing devices as a part of our day-to-day lives. The potential for obtaining a time-correlated, direct, brain-based measure of a participant's mental activity is an alluring and important development for HCI researchers. In this work, we investigate the application of BCI hardware for answering HCI centred research questions, in turn, fusing the two disciplines to form an approach we name - Brain based Human-Computer Interaction (BHCI). We investigate the possibility of using BHCI to provide natural interaction - an ideal form of HCI, where communication between man-and-machine is indistinguishable from everyday forms of interactions such as Speaking and Gesturing. We present the development, execution and output of three user studies investigating the application of BHCI. We evaluate two technologies, fNIRS and EEG, and investigate their suitability for supporting BHCI based interactions. Through our initial studies, we identify that the lightweight and portable attributes of EEG make it preferable for use in developing natural interactions. Building upon this, we develop an EEG based cinematic experience exploring natural forms of interaction through the mind of the viewer. In studying the viewers response to this experience, we were able to develop a taxonomy of control based on how viewers discovered and exerted control over the experience

Immunohistochemical and electrophysiological investigation of E/I balance alterations in animal models of frontotemporal dementia

Behavioural variant frontotemporal dementia (bvFTD) is a neurodegenerative disease characterised by changes in behaviour. Apathy, behavioural disinhibition and stereotyped behaviours are the first symptoms to appear and all have a basis in reward and pleasure deficits. The ventral striatum and ventral regions of the globus pallidus are involved in reward and pleasure. It is therefore reasonable to suggest alterations in these regions may underpin bvFTD. One postulated contributory factor is alteration in E/I balance in striatal regions. GABAergic interneurons play a role in E/I balance, acting as local inhibitory brakes, they are therefore a rational target for research investigating early biological predictors of bvFTD. To investigate this, we will carry out immunohistochemical staining for GABAergic interneurons (parvalbumin and neuronal nitric oxide synthase) in striatal regions of brains taken from CHMP2B mice, a validated animal model of bvFTD. We hypothesise that there will be fewer GABAergic interneurons in the striatum which may lead to ‘reward-seeking’ behaviour in bvFTD. This will also enable us to investigate any preclinical alterations in interneuron expression within this region. Results will be analysed using a mixed ANOVA and if significant, post hoc t-tests will be used. The second part of our study will involve extracellular recordings from CHMP2B mouse brains using a multi-electrode array (MEA). This will enable us to determine if there are alterations in local field potentials (LFP) in preclinical and symptomatic animals. We will also be able to see if neuromodulators such as serotonin and dopamine effect LFPs after bath application. We will develop slice preparations to preserve pathways between the ventral tegmental area and the ventral pallidum, an output structure of the striatum, and the dorsal raphe nucleus and the VP. Using the MEA we will stimulate an endogenous release of dopamine and serotonin using the slice preparations as described above. This will enable us to see if there are any changes in LFPs after endogenous release of neuromodulators. We hypothesise there will be an increase in LFPs due to loss of GABAergic interneurons