OPTIMIZATION OF FEATURE SELECTION IN A BRAIN-COMPUTER INTERFACE SWITCH BASED ON EVENT-RELATED DESYNCHRONIZATION AND SYNCHRONIZATION DETECTED BY EEG

There are hundreds of thousands of people who could benefit from a Brain-Computer Interface. However, not all are willing to undergo surgery, so an EEG is the prime candidate for use as a BCI. The features of Event-Related Desynchronization and Synchronization could be used for a switch and have been in the past. A new method of feature selection was proposed to optimize classification of active motor movement vs a non-active idle state. The previous method had pre-selected which frequency and electrode to use as electrode C3 at the 20Hz bin. The new method used SPSS statistical software to determine the most significant frequency and electrode combination. This improved method found increased accuracy in classifying cases as either active or idle states. Future directions could be using multiple features for classification and BCI control, or exploiting the difference between ERD and ERS, though for either of these a more advanced algorithm would be required

EEG and ECoG features for Brain Computer Interface in Stroke Rehabilitation

The ability of non-invasive Brain-Computer Interface (BCI) to control an exoskeleton was used for motor rehabilitation in stroke patients or as an assistive device for the paralyzed. However, there is still a need to create a more reliable BCI that could be used to control several degrees of Freedom (DoFs) that could improve rehabilitation results. Decoding different movements from the same limb, high accuracy and reliability are some of the main difficulties when using conventional EEG-based BCIs and the challenges we tackled in this thesis. In this PhD thesis, we investigated that the classification of several functional hand reaching movements from the same limb using EEG is possible with acceptable accuracy. Moreover, we investigated how the recalibration could affect the classification results. For this reason, we tested the recalibration in each multi-class decoding for within session, recalibrated between-sessions, and between sessions. It was shown the great influence of recalibrating the generated classifier with data from the current session to improve stability and reliability of the decoding. Moreover, we used a multiclass extension of the Filter Bank Common Spatial Patterns (FBCSP) to improve the decoding accuracy based on features and compared it to our previous study using CSP. Sensorimotor-rhythm-based BCI systems have been used within the same frequency ranges as a way to influence brain plasticity or controlling external devices. However, neural oscillations have shown to synchronize activity according to motor and cognitive functions. For this reason, the existence of cross-frequency interactions produces oscillations with different frequencies in neural networks. In this PhD, we investigated for the first time the existence of cross-frequency coupling during rest and movement using ECoG in chronic stroke patients. We found that there is an exaggerated phase-amplitude coupling between the phase of alpha frequency and the amplitude of gamma frequency, which can be used as feature or target for neurofeedback interventions using BCIs. This coupling has been also reported in another neurological disorder affecting motor function (Parkinson and dystonia) but, to date, it has not been investigated in stroke patients. This finding might change the future design of assistive or therapeuthic BCI systems for motor restoration in stroke patients

Analysis of sensorimotor rhythms based on lower-limbs motor imagery for brain-computer interface

Over recent years significant advancements in the field of assistive technologies have been observed. One of the paramount needs for the development and advancement that urged researchers to contribute in the field other than congenital or diagnosed chronic disorders, is the rising number of affectees from accidents, natural calamity (due to climate change), or warfare, worldwide resulting in spinal cord injuries (SCI), neural disorder, or amputation (interception) of limbs, that impede a human to live a normal life. In addition to this, more than ten million people in the world are living with some form of handicap due to the central nervous system (CNS) disorder, which is precarious. Biomedical devices for rehabilitation are the center of research focus for many years. For people with lost motor control, or amputation, but unscathed sensory control, instigation of control signals from the source, i.e. electrophysiological signals, is vital for seamless control of assistive biomedical devices. Control signals, i.e. motion intentions, arouse    in the sensorimotor cortex of the brain that can be detected using invasive or non-invasive modality. With non-invasive modality, the electroencephalography (EEG) is used to record these motion intentions encoded in electrical activity of the cortex, and are deciphered to recognize user intent for locomotion. They are further transferred to the actuator, or end effector of the assistive device for control purposes. This can be executed via the brain-computer interface (BCI) technology. BCI is an emerging research field that establishes a real-time bidirectional connection between the human brain and a computer/output device. Amongst its diverse applications, neurorehabilitation to deliver sensory feedback and brain controlled biomedical devices for rehabilitation are most popular. While substantial literature on control of upper-limb assistive technologies controlled via BCI is there, less is known about the lower-limb (LL) control of biomedical devices for navigation or gait assistance via BCI. The types  of EEG signals compatible with an independent BCI are the oscillatory/sensorimotor rhythms (SMR) and event-related potential (ERP). These signals have successfully been used in BCIs for navigation control of assistive devices. However, ERP paradigm accounts for a voluminous setup for stimulus presentation to the user during operation of BCI assistive device. Contrary to this, the SMR does not require large setup for activation of cortical activity; it instead depends on the motor imagery (MI) that is produced synchronously or asynchronously by the user. MI is a covert cognitive process also termed kinaesthetic motor imagery (KMI) and elicits clearly after rigorous training trials, in form of event-related desynchronization (ERD) or synchronization (ERS), depending on imagery activity or resting period. It usually comprises of limb movement tasks, but is not limited to it in a BCI paradigm. In order to produce detectable features that correlate to the user¿s intent, selection of cognitive task is an important aspect to improve the performance of a BCI. MI used in BCI predominantly remains associated with the upper- limbs, particularly hands, due to the somatotopic organization of the motor cortex. The hand representation area is substantially large, in contrast to the anatomical location of the LL representation areas in the human sensorimotor cortex. The LL area is located within the interhemispheric fissure, i.e. between the mesial walls of both hemispheres of the cortex. This makes it arduous to detect EEG features prompted upon imagination of LL. Detailed investigation of the ERD/ERS in the mu and beta oscillatory rhythms during left and right LL KMI tasks is required, as the user¿s intent to walk is of paramount importance associated to everyday activity. This is an important area of research, followed by the improvisation of the already existing rehabilitation system that serves the LL affectees. Though challenging, solution to these issues is also imperative for the development of robust controllers that follow the asynchronous BCI paradigms to operate LL assistive devices seamlessly. This thesis focusses on the investigation of cortical lateralization of ERD/ERS in the SMR, based on foot dorsiflexion KMI and knee extension KMI separately. This research infers the possibility to deploy these features in real-time BCI by finding maximum possible classification accuracy from the machine learning (ML) models. EEG signal is non-stationary, as it is characterized by individual-to-individual and trial-to-trial variability, and a low signal-to-noise ratio (SNR), which is challenging. They are high in dimension with relatively low number of samples available for fitting ML models to the data. These factors account for ML methods that were developed into the tool of choice  to analyse single-trial EEG data. Hence, the selection of appropriate ML model for true detection of class label with no tradeoff of overfitting is crucial. The feature extraction part of the thesis constituted of testing the band-power (BP) and the common spatial pattern (CSP) methods individually. The study focused on the synchronous BCI paradigm. This was to ensure the exhibition of SMR for the possibility of a practically viable control system in a BCI. For the left vs. right foot KMI, the objective was to distinguish the bilateral tasks, in order to use them as unilateral commands in a 2-class BCI for controlling/navigating a robotic/prosthetic LL for rehabilitation. Similar was the approach for left-right knee KMI. The research was based on four main experimental studies. In addition to the four studies, the research is also inclusive of the comparison of intra-cognitive tasks within the same limb, i.e. left foot vs. left knee and right foot vs. right knee tasks, respectively (Chapter 4). This added to another novel contribution towards the findings based on comparison of different tasks within the same LL. It provides basis to increase the dimensionality of control signals within one BCI paradigm, such as a BCI-controlled LL assistive device with multiple degrees of freedom (DOF) for restoration of locomotion function. This study was based on analysis of statistically significant mu ERD feature using BP feature extraction method. The first stage of this research comprised of the left vs. right foot KMI tasks, wherein the ERD/ERS that elicited in the mu-beta rhythms were analysed using BP feature extraction method (Chapter 5). Three individual features, i.e. mu ERD, beta ERD, and beta ERS were investigated on EEG topography and time-frequency (TF) maps, and average time course of power percentage, using the common average reference and bipolar reference methods. A comparative study was drawn for both references to infer the optimal method. This was followed by ML, i.e. classification of the three feature vectors (mu ERD, beta ERD, and beta ERS), using linear discriminant analysis (LDA), support vector machine (SVM), and k-nearest neighbour (KNN) algorithms, separately. Finally, the multiple correction statistical tests were done, in order to predict maximum possible classification accuracy amongst all paradigms for the most significant feature. All classifier models were supported with the statistical techniques of k-fold cross validation and evaluation of area under receiver-operator characteristic curves (AUC-ROC) for prediction of the true class label. The highest classification accuracy of 83.4% ± 6.72 was obtained with KNN model for beta ERS feature. The next study was based on enhancing the classification accuracy obtained from previous study. It was based on using similar cognitive tasks as study in Chapter 5, however deploying different methodology for feature extraction and classification procedure. In the second study, ERD/ERS from mu and beta rhythms were extracted using CSP and filter bank common spatial pattern (FBCSP) algorithms, to optimize the individual spatial patterns (Chapter 6). This was followed by ML process, for which the supervised logistic regression (Logreg) and LDA were deployed separately. Maximum classification accuracy resulted in 77.5% ± 4.23 with FBCSP feature vector and LDA model, with a maximum kappa coefficient of 0.55 that is in the moderate range of agreement between the two classes. The left vs. right foot discrimination results were nearly same, however the BP feature vector performed better than CSP. The third stage was based on the deployment of novel cognitive task of left vs. right knee extension KMI. Analysis of the ERD/ERS in the mu-beta rhythms was done for verification of cortical lateralization via BP feature vector (Chapter 7). Similar to Chapter 5, in this study the analysis of ERD/ERS features was done on the EEG topography and TF maps, followed by the determination of average time course and peak latency of feature occurrence. However, for this study, only mu ERD and beta ERS features were taken into consideration and the EEG recording method only comprised of common average reference. This was due to the established results from the foot study earlier, in Chapter 5, where beta ERD features showed less average amplitude. The LDA and KNN classification algorithms were employed. Unexpectedly, the left vs. right knee KMI reflected the highest accuracy of 81.04% ± 7.5 and an AUC-ROC = 0.84, strong enough to be used in a real-time BCI as two independent control features. This was using KNN model for beta ERS feature. The final study of this research followed the same paradigm as used in Chapter 6, but for left vs. right knee KMI cognitive task (Chapter 8). Primarily this study aimed at enhancing the resulting accuracy from Chapter 7, using CSP and FBCSP methods with Logreg and LDA models respectively. Results were in accordance with those of the already established foot KMI study, i.e. BP feature vector performed better than the CSP. Highest classification accuracy of 70.00% ± 2.85 with kappa score of 0.40 was obtained with Logreg using FBCSP feature vector. Results stipulated the utilization of ERD/ERS in mu and beta bands, as independent control features for discrimination of bilateral foot or the novel bilateral knee KMI tasks. Resulting classification accuracies implicate that any 2-class BCI, employing unilateral foot, or knee KMI, is suitable for real-time implementation. In conclusion, this thesis demonstrates the possible EEG pre-processing, feature extraction and classification methods to instigate a real-time BCI from the conducted studies. Following this, the critical aspects of latency in information transfer rate, SNR, and tradeoff between dimensionality and overfitting needs to be taken care of, during design of real-time BCI controller. It also highlights that there is a need for consensus over the development of standardized methods of cognitive tasks for MI based BCI. Finally, the application of wireless EEG for portable assistance is essential as it will contribute to lay the foundations of the development of independent asynchronous BCI based on SMR

Comparison of tri-polar concentric ring electrodes to disc electrodes for decoding real and imaginary finger movements, A

2019 Spring.Includes bibliographical references.The electroencephalogram (EEG) is broadly used for diagnosis of brain diseases and research of brain activities. Although the EEG provides a good temporal resolution, it suffers from poor spatial resolution due to the blurring effects of volume conduction and signal-to-noise ratio. Many efforts have been devoted to the development of novel methods that can increase the EEG spatial resolution. The surface Laplacian, which is the second derivative of the surface potential, has been applied to EEG to improve the spatial resolution. Tri-polar concentric ring electrodes (TCREs) have been shown to estimate the surface Laplacian automatically with better spatial resolution than conventional disc electrodes. The aim of this research is to study how well the TCREs can be used to acquire EEG signals to decode real and imaginary finger movements. These EEG signals will be then translated into finger movements commands. We also compare the feasibility of discriminating finger movements from one hand using EEG recorded from TCREs and conventional disc electrodes. Furthermore, we evaluated two movement-related features, temporal EEG data and spectral features, in discriminating individual finger from one hand using non-invasive EEG. To do so, movement-related potentials (MRPs) are measured and analyzed from four TCREs and conventional disc electrodes while 13 subjects performed either motor execution or motor imagery of individual finger movements. The tri-polar-EEG (tEEG) and conventional EEG (cEEG) were recorded from electrodes placed according to the 10-20 International Electrode Positioning System over the motor cortex. Our results show that the TCREs achieved higher spatial resolution than conventional disc electrodes. Moreover, the results show that signals from TCREs generated higher decoding accuracy compared to signals from conventional disc electrodes. The average decoding accuracy of five-class classification for all subjects was of 70.04 ± 7.68% when we used temporal EEG data as feature and classified it using Artificial Neural Networks (ANNs) classifier. In addition, the results show that the TCRE EEG (tEEG) provides approximately a four times enhancement in the signal-to-noise ratio (SNR) compared to disc electrode signals. We also evaluated the interdependency level between neighboring electrodes from tri-polar, disc, and disc with Hjorth's Laplacian method in time and frequency domains by calculating the mutual information (MI) and coherence. The MRP signals recorded with the TCRE system have significantly less mutual information (MI) between electrodes than the conventional disc electrode system and disc electrodes with Hjorth's Laplacian method. Also, the results show that the mean coherence between neighboring tri-polar electrodes was found to be significantly smaller than disc electrode and disc electrode with Hjorth's method, especially at higher frequencies. This lower coherence in the high frequency band between neighboring tri polar electrodes suggests that the TCREs may record a more localized neuronal activity. The successful decoding of finger movements can provide extra degrees of freedom to drive brain computer interface (BCI) applications, especially for neurorehabilitation

Detecting and classifying three different hand movement types through electroencephalography recordings for neurorehabilitation

Brain–computer interfaces can be used for motor substitution and recovery; therefore, detection and classification of movement intention are crucial for optimal control. In this study, palmar, lateral and pinch grasps were differentiated from the idle state and classified from single-trial EEG using only information prior to the movement onset. Fourteen healthy subjects performed the three grasps 100 times, while EEG was recorded from 25 electrodes. Temporal and spectral features were extracted from each electrode, and feature reduction was performed using sequential forward selection (SFS) and principal component analysis (PCA). The detection problem was investigated as the ability to discriminate between movement preparation and the idle state. Furthermore, all task pairs and the three movements together were classified. The best detection performance across movements (79 ± 8 %) was obtained by combining temporal and spectral features. The best movement–movement discrimination was obtained using spectral features: 76 ± 9 % (2-class) and 63 ± 10 % (3-class). For movement detection and discrimination, the performance was similar across grasp types and task pairs; SFS outperformed PCA. The results show it is feasible to detect different grasps and classify the distinct movements using only information prior to the movement onset, which may enable brain–computer interface-based neurorehabilitation of upper limb function through Hebbian learning mechanisms

Optimization of Electroencephalograph-Based Classification for Imaginary Motion Brain Computer Interface Study

Using Electroencephalography (EEG) to detect imaginary motions from brain waves, to interface human and computer is a very nascent and challenging field that started developing rapidly in the past few decades. The technique involves some electrodes attached on the scalp of the patient and the signals generated by the brain while the thought process of the patient is captured and recorded in a computer. This technique of human and computer interfacing is termed as Brain Computer Interface (BCI). Disability is a serious problem of our nation and hence BCI is extremely important in case of people who are incapable of communicating due to spinal cord injury. This technique uses the brain signals to make decisions, control objects and communicate with the world using brain integration with peripheral devices and systems. This requires some intelligence to classify these motions. Neural network have been used as a mean to classify motions, however, the accuracy of classification for certain motion was limited. The novelty of the proposed approach is in using a majority vote system for a network of artificial neural networks (ANNs) that is used to optimally classify imaginary motions performed by multiple subjects. Three kinds of imaginary motionswere classified which are imaginary left hand movement, imaginary right hand movement, and imagination of words starting with the same letter. Using an optimized set of electrodes, classification accuracywas optimized for the three users as a group and also individually. The optimization procedure was conducted based on the rank of the electrodes 2 according to their individual classification accuracy, and the eliminating electrodes with the lowest accuracies. The group optimization of 3 subjects altogether resulted in an electrode structure consisting of 15 electrodes with a relatively high classification accuracy of almost 80%. The individual optimization for each subject resulted in an electrode structure of 20 for subject 1 and subject 3 with classification accuracies of 63:63% and 84:33% respectively and single electrode structure for subject 2 with an accuracy of 94:01%. The overall average classification accuracy of all the users with the individual optimization of electrodes was as high as 82:32%

Lightweight Machine Learning with Brain Signals

Electroencephalography(EEG) signals are gaining popularity in Brain-Computer Interface(BCI) systems and neural engineering applications thanks to their portability and availability. Inevitably, the sensory electrodes on the entire scalp would collect signals irrelevant to the particular BCI task, increasing the risks of overfitting in machine learning-based predictions. While this issue is being addressed by scaling up the EEG datasets and handcrafting the complex predictive models, this also leads to increased computation costs. Moreover, the model trained for one set of subjects cannot easily be adapted to other sets due to inter-subject variability, which creates even higher over-fitting risks. Meanwhile, despite previous studies using either convolutional neural networks(CNNs) or graph neural networks(GNNs) to determine spatial correlations between brain regions, they fail to capture brain functional connectivity beyond physical proximity. To this end, we propose 1) removing task-irrelevant noises instead of merely complicating models; 2) extracting subject-invariant discriminative EEG encodings, by taking functional connectivity into account; 3) navigating and training deep learning model with the most critical EEG channels; 4) detecting most similar EEG segments with target subject to reduce the cost of computation as well as inter-subject variability. Specifically, we construct a task-adaptive graph representation of brain network based on topological functional connectivity rather than distance-based connections. Further, non-contributory EEG channels are excluded by selecting only functional regions relevant to the corresponding intention. Lastly, contributory EEG segments are detected by several similarity estimation metrics, we then evaluate and train our proposed framework upon detected EEG segments to compare the performance of different metrics in EEG BCI tasks. We empirically show that our proposed approach, SIFT-EEG, outperforms state-of-the-art, with around 4% and 7% improvements over CNN-based and GNN-based models, on performing motor imagery predictions. Also, the task-adaptive channel selection demonstrates similar predictive performance with only 20% of raw EEG data. Moreover, the best-performed metric can achieve a high level of accuracy with less than 9% training data, suggesting a possible shift in direction for future works other than simply scaling up the model

Upper Limb Movement Recognition utilising EEG and EMG Signals for Rehabilitative Robotics

Upper limb movement classification, which maps input signals to the target activities, is a key building block in the control of rehabilitative robotics. Classifiers are trained for the rehabilitative system to comprehend the desires of the patient whose upper limbs do not function properly. Electromyography (EMG) signals and Electroencephalography (EEG) signals are used widely for upper limb movement classification. By analysing the classification results of the real-time EEG and EMG signals, the system can understand the intention of the user and predict the events that one would like to carry out. Accordingly, it will provide external help to the user. However, the noise in the real-time EEG and EMG data collection process contaminates the effectiveness of the data, which undermines classification performance. Moreover, not all patients process strong EMG signals due to muscle damage and neuromuscular disorder. To address these issues, this paper explores different feature extraction techniques and machine learning and deep learning models for EEG and EMG signals classification and proposes a novel decision-level multisensor fusion technique to integrate EEG signals with EMG signals. This system retrieves effective information from both sources to understand and predict the desire of the user, and thus aid. By testing out the proposed technique on a publicly available WAY-EEG-GAL dataset, which contains EEG and EMG signals that were recorded simultaneously, we manage to conclude the feasibility and effectiveness of the novel system.Comment: 20 pages, 11 figures, 2 tables; Thesis for Undergraduate Research Project in Computing, NUS; Accepted by Future of Information and Communication Conference 2023, San Francisc

Towards improved EEG interpretation in a sensorimotor BCI for the control of a prosthetic or orthotic hand.

A brain computer interface (BCI), which reroutes neural signals from the brain to actuators in a prosthetic or orthotic hand, promises to aid those who suffer from hand motor impairments, such as amputees and victims of strokes and spinal cord injuries. Such individuals can greatly benefit from the return of some of the essential functionality of the hand through the renewed performance of the basic hand movements involved in daily activities. These hand movements include wrist extension, wrist flexion, finger extension, finger flexion and the tripod pinch. The core of this sensorimotor BCI solution lies in the interpretation of the neural information for the five essential hand movements extracted from EEG (electroencephalogram). It is necessary to improve on the interpretation of these EEG signals; hence this research explores the possibility of single-trial EEG discrimination for the five essential hand movements in an offline, synchronous manner. The EEG was recorded from five healthy test subjects as they performed the actual and imagined movements for both hands. The research is then divided into three investigations which respectively attempt to differentiate the EEG for: 1) right and left combinations of the different hand movements, 2) wrist and finger movements on the same hand and 3) the individual five movements on the same hand. A general method is applied to all three investigations. It utilizes independent component analysis (ICA) and time-frequency techniques to extract features based on eventrelated (de)synchronisation (ERD/ERS) and movement-related cortical potentials (MRCP). The Bhattacharyya distance is used for feature reduction and Mahalanobis distance clustering and artificial neural networks are used as classifiers. The best average accuracies of 89 %, 71 % and 57 % for the three respective investigations are obtained using ANNs and features related to ERD/ERS. Along with accuracies around 70 % for a few subjects in the five-movement differentiation investigation, these results indicated the possibility of offline, synchronous differentiation of single-trial EEG for the five essential hand movements. These hand movements can be used in part or in combination as imagined and performed motor tasks for BCIs aimed at controlling prosthetic or orthotic hands