Single-trial EEG Discrimination between Wrist and Finger Movement Imagery and Execution in a Sensorimotor BCI

A brain-computer interface (BCI) may be used to control a prosthetic or orthotic hand using neural activity from the brain. The core of this sensorimotor BCI lies in the interpretation of the neural information extracted from electroencephalogram (EEG). It is desired to improve on the interpretation of EEG to allow people with neuromuscular disorders to perform daily activities. This paper investigates the possibility of discriminating between the EEG associated with wrist and finger movements. The EEG was recorded from test subjects as they executed and imagined five essential hand movements using both hands. Independent component analysis (ICA) and time-frequency techniques were used to extract spectral features based on event-related (de)synchronisation (ERD/ERS), while the Bhattacharyya distance (BD) was used for feature reduction. Mahalanobis distance (MD) clustering and artificial neural networks (ANN) were used as classifiers and obtained average accuracies of 65 % and 71 % respectively. This shows that EEG discrimination between wrist and finger movements is possible. The research introduces a new combination of motor tasks to BCI research.Comment: 33rd Annual International IEEE EMBS Conference 201

Decoding Complex Imagery Hand Gestures

Brain computer interfaces (BCIs) offer individuals suffering from major disabilities an alternative method to interact with their environment. Sensorimotor rhythm (SMRs) based BCIs can successfully perform control tasks; however, the traditional SMR paradigms intuitively disconnect the control and real task, making them non-ideal for complex control scenarios. In this study, we design a new, intuitively connected motor imagery (MI) paradigm using hierarchical common spatial patterns (HCSP) and context information to effectively predict intended hand grasps from electroencephalogram (EEG) data. Experiments with 5 participants yielded an aggregate classification accuracy--intended grasp prediction probability--of 64.5\% for 8 different hand gestures, more than 5 times the chance level.Comment: This work has been submitted to EMBC 201

VALIDATION OF A MODEL OF SENSORIMOTOR INTEGRATION WITH CLINICAL BENEFITS

Healthy sensorimotor integration – or how our touch influences our movements – is critical to efficiently interact with our environment. Yet, many aspects of this process are still poorly understood. Importantly, several movement disorders are often considered as originating from purely motor impairments, while a sensory origin could also lead to a similar set of symptoms. To alleviate these issues, we hereby propose a novel biologically-based model of the sensorimotor loop, known as the SMILE model. After describing both the functional, and the corresponding neuroanatomical versions of the SMILE, we tested several aspects of its motor component through functional magnetic resonance imaging (fMRI) and transcranial magnetic stimulation (TMS). Both experimental studies resulted in coherent outcomes with respect to the SMILE predictions, but they also provided novel scientific outcomes about such broad topics as the sub-phases of motor imagery, the neural processing of bodily representations, or the extend of the role of the extrastriate body area. In the final sections of this manuscript, we describe some potential clinical application of the SMILE. The first one presents the identification of plausible neuroanatomical origins for focal hand dystonia, a yet poorly understood sensorimotor disorder. The last chapter then covers possible improvements on brain-machine interfaces, driven by a better understanding of the sensorimotor system. -- La façon dont votre sens du toucher et vos mouvements interagissent est connue sous le nom d’intégration sensorimotrice. Ce procédé est essentiel pour une interaction normale avec tout ce qui nous entoure. Cependant, plusieurs aspects de ce processus sont encore méconnus. Plus important encore, l’origine de certaines déficiences motrices encore trop peu comprises sont parfois considérées comme purement motrice, alors qu’une origine sensorielle pourrait mener à un même ensemble de symptômes. Afin d’améliorer cette situation, nous proposons ici un nouveau modèle d’intégration sensorimotrice, dénommé « SMILE », basé sur les connaissances de neurobiologie actuelles. Dans ce manuscrit, nous commençons par décrire les caractéristiques fonctionnelles et neuroanatomiques du SMILE. Plusieurs expériences sont ensuite effectuées, via l’imagerie par résonance magnétique fonctionnelle (IRMf), et la stimulation magnétique transcranienne (SMT), afin de tester différents aspects de la composante motrice du SMILE. Si les résultats de ces expériences corroborent les prédictions du SMILE, elles ont aussi mis en évidences d’autres résultats scientifiques intéressants et novateurs, dans des domaines aussi divers que les sous-phases de l’imagination motrice, les processus cérébraux liés aux représentations corporelles, ou encore l’extension du rôle de l’extrastriate body area. Dans les dernières parties de ce manuscrit, nous dévoilons quelques applications cliniques potentielles de notre modèle. Nous utilisons le SMILE afin de proposer deux origines cérébrales plausibles de la dystonie focale de la main. Le dernier chapitre présente comment certaines technologies existantes, telles que les interfaces cerveaux-machines, pourraient bénéficier d’une meilleure compréhension du système sensorimoteur

Towards improved EEG interpretation in a sensorimotor BCI for the control of a prosthetic or orthotic hand.

A brain computer interface (BCI), which reroutes neural signals from the brain to actuators in a prosthetic or orthotic hand, promises to aid those who suffer from hand motor impairments, such as amputees and victims of strokes and spinal cord injuries. Such individuals can greatly benefit from the return of some of the essential functionality of the hand through the renewed performance of the basic hand movements involved in daily activities. These hand movements include wrist extension, wrist flexion, finger extension, finger flexion and the tripod pinch. The core of this sensorimotor BCI solution lies in the interpretation of the neural information for the five essential hand movements extracted from EEG (electroencephalogram). It is necessary to improve on the interpretation of these EEG signals; hence this research explores the possibility of single-trial EEG discrimination for the five essential hand movements in an offline, synchronous manner. The EEG was recorded from five healthy test subjects as they performed the actual and imagined movements for both hands. The research is then divided into three investigations which respectively attempt to differentiate the EEG for: 1) right and left combinations of the different hand movements, 2) wrist and finger movements on the same hand and 3) the individual five movements on the same hand. A general method is applied to all three investigations. It utilizes independent component analysis (ICA) and time-frequency techniques to extract features based on eventrelated (de)synchronisation (ERD/ERS) and movement-related cortical potentials (MRCP). The Bhattacharyya distance is used for feature reduction and Mahalanobis distance clustering and artificial neural networks are used as classifiers. The best average accuracies of 89 %, 71 % and 57 % for the three respective investigations are obtained using ANNs and features related to ERD/ERS. Along with accuracies around 70 % for a few subjects in the five-movement differentiation investigation, these results indicated the possibility of offline, synchronous differentiation of single-trial EEG for the five essential hand movements. These hand movements can be used in part or in combination as imagined and performed motor tasks for BCIs aimed at controlling prosthetic or orthotic hands

Spatial Detection of Multiple Movement Intentions from SAM-Filtered Single-Trial MEG for a high performance BCI

The objective of this study is to test whether human intentions to sustain or cease movements in right and left hands can be decoded reliably from spatially filtered single trial magneto-encephalographic (MEG) signals. This study was performed using motor execution and motor imagery movements to achieve a potential high performance Brain-Computer interface (BCI). Seven healthy volunteers, naïve to BCI technology, participated in this study. Signals were recorded from 275-channel MEG and synthetic aperture magnetometry (SAM) was employed as the spatial filter. The four-class classification for natural movement intentions was performed offline; Genetic Algorithm based Mahalanobis Linear Distance (GA-MLD) and direct-decision tree classifier (DTC) techniques were adopted for the classification through 10-fold cross-validation. Through SAM imaging, strong and distinct event related desynchronisation (ERD) associated with sustaining, and event related synchronisation (ERS) patterns associated with ceasing of hand movements were observed in the beta band (15 - 30 Hz). The right and left hand ERD/ERS patterns were observed on the contralateral hemispheres for motor execution and motor imagery sessions. Virtual channels were selected from these cortical areas of high activity to correspond with the motor tasks as per the paradigm of the study. Through a statistical comparison between SAM-filtered virtual channels from single trial MEG signals and basic MEG sensors, it was found that SAM-filtered virtual channels significantly increased the classification accuracy for motor execution (GA-MLD: 96.51 ± 2.43 %) as well as motor imagery sessions (GA-MLD: 89.69 ± 3.34%). Thus, multiple movement intentions can be reliably detected from SAM-based spatially-filtered single trial MEG signals. MEG signals associated with natural motor behavior may be utilized for a reliable high-performance brain-computer interface (BCI) and may reduce long-term training compared with conventional BCI methods using rhythm control. This may prove tremendously helpful for patients suffering from various movement disorders to improve their quality of life

EEG and ECoG features for Brain Computer Interface in Stroke Rehabilitation

The ability of non-invasive Brain-Computer Interface (BCI) to control an exoskeleton was used for motor rehabilitation in stroke patients or as an assistive device for the paralyzed. However, there is still a need to create a more reliable BCI that could be used to control several degrees of Freedom (DoFs) that could improve rehabilitation results. Decoding different movements from the same limb, high accuracy and reliability are some of the main difficulties when using conventional EEG-based BCIs and the challenges we tackled in this thesis. In this PhD thesis, we investigated that the classification of several functional hand reaching movements from the same limb using EEG is possible with acceptable accuracy. Moreover, we investigated how the recalibration could affect the classification results. For this reason, we tested the recalibration in each multi-class decoding for within session, recalibrated between-sessions, and between sessions. It was shown the great influence of recalibrating the generated classifier with data from the current session to improve stability and reliability of the decoding. Moreover, we used a multiclass extension of the Filter Bank Common Spatial Patterns (FBCSP) to improve the decoding accuracy based on features and compared it to our previous study using CSP. Sensorimotor-rhythm-based BCI systems have been used within the same frequency ranges as a way to influence brain plasticity or controlling external devices. However, neural oscillations have shown to synchronize activity according to motor and cognitive functions. For this reason, the existence of cross-frequency interactions produces oscillations with different frequencies in neural networks. In this PhD, we investigated for the first time the existence of cross-frequency coupling during rest and movement using ECoG in chronic stroke patients. We found that there is an exaggerated phase-amplitude coupling between the phase of alpha frequency and the amplitude of gamma frequency, which can be used as feature or target for neurofeedback interventions using BCIs. This coupling has been also reported in another neurological disorder affecting motor function (Parkinson and dystonia) but, to date, it has not been investigated in stroke patients. This finding might change the future design of assistive or therapeuthic BCI systems for motor restoration in stroke patients

Comparison of tri-polar concentric ring electrodes to disc electrodes for decoding real and imaginary finger movements, A

2019 Spring.Includes bibliographical references.The electroencephalogram (EEG) is broadly used for diagnosis of brain diseases and research of brain activities. Although the EEG provides a good temporal resolution, it suffers from poor spatial resolution due to the blurring effects of volume conduction and signal-to-noise ratio. Many efforts have been devoted to the development of novel methods that can increase the EEG spatial resolution. The surface Laplacian, which is the second derivative of the surface potential, has been applied to EEG to improve the spatial resolution. Tri-polar concentric ring electrodes (TCREs) have been shown to estimate the surface Laplacian automatically with better spatial resolution than conventional disc electrodes. The aim of this research is to study how well the TCREs can be used to acquire EEG signals to decode real and imaginary finger movements. These EEG signals will be then translated into finger movements commands. We also compare the feasibility of discriminating finger movements from one hand using EEG recorded from TCREs and conventional disc electrodes. Furthermore, we evaluated two movement-related features, temporal EEG data and spectral features, in discriminating individual finger from one hand using non-invasive EEG. To do so, movement-related potentials (MRPs) are measured and analyzed from four TCREs and conventional disc electrodes while 13 subjects performed either motor execution or motor imagery of individual finger movements. The tri-polar-EEG (tEEG) and conventional EEG (cEEG) were recorded from electrodes placed according to the 10-20 International Electrode Positioning System over the motor cortex. Our results show that the TCREs achieved higher spatial resolution than conventional disc electrodes. Moreover, the results show that signals from TCREs generated higher decoding accuracy compared to signals from conventional disc electrodes. The average decoding accuracy of five-class classification for all subjects was of 70.04 ± 7.68% when we used temporal EEG data as feature and classified it using Artificial Neural Networks (ANNs) classifier. In addition, the results show that the TCRE EEG (tEEG) provides approximately a four times enhancement in the signal-to-noise ratio (SNR) compared to disc electrode signals. We also evaluated the interdependency level between neighboring electrodes from tri-polar, disc, and disc with Hjorth's Laplacian method in time and frequency domains by calculating the mutual information (MI) and coherence. The MRP signals recorded with the TCRE system have significantly less mutual information (MI) between electrodes than the conventional disc electrode system and disc electrodes with Hjorth's Laplacian method. Also, the results show that the mean coherence between neighboring tri-polar electrodes was found to be significantly smaller than disc electrode and disc electrode with Hjorth's method, especially at higher frequencies. This lower coherence in the high frequency band between neighboring tri polar electrodes suggests that the TCREs may record a more localized neuronal activity. The successful decoding of finger movements can provide extra degrees of freedom to drive brain computer interface (BCI) applications, especially for neurorehabilitation