195 research outputs found

    An Approach of One-vs-Rest Filter Bank Common Spatial Pattern and Spiking Neural Networks for Multiple Motor Imagery Decoding

    Get PDF
    Motor imagery (MI) is a typical BCI paradigm and has been widely applied into many aspects (e.g. brain-driven wheelchair and motor function rehabilitation training). Although significant achievements have been achieved, multiple motor imagery decoding is still unsatisfactory. To deal with this challenging issue, firstly, a segment of electroencephalogram was extracted and preprocessed. Secondly, we applied a filter bank common spatial pattern (FBCSP) with one-vs-rest (OVR) strategy to extract the spatio-temporal-frequency features of multiple MI. Thirdly, the F-score was employed to optimise and select these features. Finally, the optimized features were fed to the spiking neural networks (SNN) for classification. Evaluation was conducted on two public multiple MI datasets (Dataset IIIa of the BCI competition III and Dataset IIa of the BCI competition IV). Experimental results showed that the average accuracy of the proposed framework reached up to 90.09% (kappa: 0.868) and 81.33% (kappa: 0.751) on the two public datasets, respectively. The achieved performance (accuracy and kappa) was comparable to the best one of the compared methods. This study demonstrated that the proposed method can be used as an alternative approach for multiple MI decoding and it provided a potential solution for online multiple MI detection

    Diverse Feature Blend Based on Filter-Bank Common Spatial Pattern and Brain Functional Connectivity for Multiple Motor Imagery Detection

    Get PDF
    Motor imagery (MI) based brain-computer interface (BCI) is a research hotspot and has attracted lots of attention. Within this research topic, multiple MI classification is a challenge due to the difficulties caused by time-varying spatial features across different individuals. To deal with this challenge, we tried to fuse brain functional connectivity (BFC) and one-versus-the-rest filter-bank common spatial pattern (OVR-FBCSP) to improve the robustness of classification. The BFC features were extracted by phase locking value (PLV), representing the brain inter-regional interactions relevant to the MI, whilst the OVR-FBCSP is used to extract the spatial-frequency features related to the MI. These diverse features were then fed into a multi-kernel relevance vector machine (MK-RVM). The dataset with three motor imagery tasks (left hand MI, right hand MI, and feet MI) was used to assess the proposed method. Experimental results not only showed that the cascade structure of diverse feature fusion and MK-RVM achieved satisfactory classification performance (average accuracy: 83.81%, average kappa: 0.76), but also demonstrated that BFC plays a supplementary role in the MI classification. Moreover, the proposed method has a potential to be integrated into multiple MI online detection owing to the advantage of strong time-efficiency of RVM

    Interpretable Convolutional Neural Networks for Decoding and Analyzing Neural Time Series Data

    Get PDF
    Machine learning is widely adopted to decode multi-variate neural time series, including electroencephalographic (EEG) and single-cell recordings. Recent solutions based on deep learning (DL) outperformed traditional decoders by automatically extracting relevant discriminative features from raw or minimally pre-processed signals. Convolutional Neural Networks (CNNs) have been successfully applied to EEG and are the most common DL-based EEG decoders in the state-of-the-art (SOA). However, the current research is affected by some limitations. SOA CNNs for EEG decoding usually exploit deep and heavy structures with the risk of overfitting small datasets, and architectures are often defined empirically. Furthermore, CNNs are mainly validated by designing within-subject decoders. Crucially, the automatically learned features mainly remain unexplored; conversely, interpreting these features may be of great value to use decoders also as analysis tools, highlighting neural signatures underlying the different decoded brain or behavioral states in a data-driven way. Lastly, SOA DL-based algorithms used to decode single-cell recordings rely on more complex, slower to train and less interpretable networks than CNNs, and the use of CNNs with these signals has not been investigated. This PhD research addresses the previous limitations, with reference to P300 and motor decoding from EEG, and motor decoding from single-neuron activity. CNNs were designed light, compact, and interpretable. Moreover, multiple training strategies were adopted, including transfer learning, which could reduce training times promoting the application of CNNs in practice. Furthermore, CNN-based EEG analyses were proposed to study neural features in the spatial, temporal and frequency domains, and proved to better highlight and enhance relevant neural features related to P300 and motor states than canonical EEG analyses. Remarkably, these analyses could be used, in perspective, to design novel EEG biomarkers for neurological or neurodevelopmental disorders. Lastly, CNNs were developed to decode single-neuron activity, providing a better compromise between performance and model complexity

    Compact and interpretable convolutional neural network architecture for electroencephalogram based motor imagery decoding

    Get PDF
    Recently, due to the popularity of deep learning, the applicability of deep Neural Networks (DNN) algorithms such as the convolutional neural networks (CNN) has been explored in decoding electroencephalogram (EEG) for Brain-Computer Interface (BCI) applications. This allows decoding of the EEG signals end-to-end, eliminating the tedious process of manually tuning each process in the decoding pipeline. However, the current DNN architectures, consisting of multiple hidden layers and numerous parameters, are not developed for EEG decoding and classification tasks, making them underperform when decoding EEG signals. Apart from this, a DNN is typically treated as a black box and interpreting what the network learns in solving the classification task is difficult, hindering from performing neurophysiological validation of the network. This thesis proposes an improved and compact CNN architecture for motor imagery decoding based on the adaptation of SincNet, which was initially developed for speaker recognition task from the raw audio input. Such adaptation allows for a very compact end-to-end neural network with state-of-the-art (SOTA) performances and enables network interpretability for neurophysiological validation in terms of cortical rhythms and spatial analysis. In order to validate the performance of proposed algorithms, two datasets were used; the first is the publicly available BCI Competition IV dataset 2a, which is often used as a benchmark in validating motor imagery (MI) classification algorithms, and a primary data that was initially collected to study the difference between motor imagery and mental rotation task associated motor imagery (MI+MR) BCI. The latter was also used in this study to test the plausibility of the proposed algorithm in highlighting the differences in cortical rhythms. In both datasets, the proposed Sinc adapted CNN algorithms show competitive decoding performance in comparisons with SOTA CNN models, where up to 87% decoding accuracy was achieved in BCI Competition IV dataset 2a and up to 91% decoding accuracy when using the primary MI+MR data. Such decoding performance was achieved with the lowest number of trainable parameters (26.5% - 34.1% reduction in the number of parameters compared to its non-Sinc counterpart). In addition, it was shown that the proposed architecture performs a cleaner band-pass, highlighting the necessary frequency bands that focus on important cortical rhythms during task execution, thus allowing for the development of the proposed Spatial Filter Visualization algorithm. Such characteristic was crucial for the neurophysiological interpretation of the learned spatial features and was not previously established with the benchmarked SOTA methods

    Data-Driven Transducer Design and Identification for Internally-Paced Motor Brain Computer Interfaces: A Review

    Get PDF
    Brain-Computer Interfaces (BCIs) are systems that establish a direct communication pathway between the users' brain activity and external effectors. They offer the potential to improve the quality of life of motor-impaired patients. Motor BCIs aim to permit severely motor-impaired users to regain limb mobility by controlling orthoses or prostheses. In particular, motor BCI systems benefit patients if the decoded actions reflect the users' intentions with an accuracy that enables them to efficiently interact with their environment. One of the main challenges of BCI systems is to adapt the BCI's signal translation blocks to the user to reach a high decoding accuracy. This paper will review the literature of data-driven and user-specific transducer design and identification approaches and it focuses on internally-paced motor BCIs. In particular, continuous kinematic biomimetic and mental-task decoders are reviewed. Furthermore, static and dynamic decoding approaches, linear and non-linear decoding, offline and real-time identification algorithms are considered. The current progress and challenges related to the design of clinical-compatible motor BCI transducers are additionally discussed

    EEG and ECoG features for Brain Computer Interface in Stroke Rehabilitation

    Get PDF
    The ability of non-invasive Brain-Computer Interface (BCI) to control an exoskeleton was used for motor rehabilitation in stroke patients or as an assistive device for the paralyzed. However, there is still a need to create a more reliable BCI that could be used to control several degrees of Freedom (DoFs) that could improve rehabilitation results. Decoding different movements from the same limb, high accuracy and reliability are some of the main difficulties when using conventional EEG-based BCIs and the challenges we tackled in this thesis. In this PhD thesis, we investigated that the classification of several functional hand reaching movements from the same limb using EEG is possible with acceptable accuracy. Moreover, we investigated how the recalibration could affect the classification results. For this reason, we tested the recalibration in each multi-class decoding for within session, recalibrated between-sessions, and between sessions. It was shown the great influence of recalibrating the generated classifier with data from the current session to improve stability and reliability of the decoding. Moreover, we used a multiclass extension of the Filter Bank Common Spatial Patterns (FBCSP) to improve the decoding accuracy based on features and compared it to our previous study using CSP. Sensorimotor-rhythm-based BCI systems have been used within the same frequency ranges as a way to influence brain plasticity or controlling external devices. However, neural oscillations have shown to synchronize activity according to motor and cognitive functions. For this reason, the existence of cross-frequency interactions produces oscillations with different frequencies in neural networks. In this PhD, we investigated for the first time the existence of cross-frequency coupling during rest and movement using ECoG in chronic stroke patients. We found that there is an exaggerated phase-amplitude coupling between the phase of alpha frequency and the amplitude of gamma frequency, which can be used as feature or target for neurofeedback interventions using BCIs. This coupling has been also reported in another neurological disorder affecting motor function (Parkinson and dystonia) but, to date, it has not been investigated in stroke patients. This finding might change the future design of assistive or therapeuthic BCI systems for motor restoration in stroke patients

    Motor Imagery Decoding Enhancement Based on Hybrid EEG-fNIRS Signals

    Get PDF
    This study explores the combination of electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRS) to enhance the decoding performance of motor imagery (MI) tasks for brain-computer interface (BCI). The experiment involved measuring 64 channels of EEG signals and 20 channels of fNIRS signals simultaneously during a task of the left-right hand MI. By combining these two types of signals, the study aimed to understand how feature fusion affected classification accuracy for MI. The EEG signals were filtered into three bands ( θ : 4–7 Hz, α : 8–13 Hz, β : 14–30 Hz), while the fNIRS signals were filtered into 0.02-0.08 Hz to improve signal quality for subsequent analysis. The common spatial patterns (CSP) algorithm was utilized to extract features from both EEG and fNIRS signals. This allowed the researchers to create a fused signal with both EEG and fNIRS features that could then be processed using principal component analysis (PCA). Finally, the processed data was fed into a support vector machine (SVM) classifier, which improved the mean accuracy rate of MI to 92.25%. By comparing the classification accuracies obtained with fused and unfused segments of EEG and fNIRS signals, the study discovered that fusing the signals significantly improved classification accuracy by 5%-10%. Furthermore, analyzing the activated brain regions using fNIRS showed that the auxiliary motor cortex was significantly activated during MI. These results demonstrate that hybrid signals with a fusion strategy can enhance the stability and fault tolerance in BCI systems, making them valuable for practical applications

    Review of the BCI competition IV

    Get PDF

    Review of the BCI Competition IV

    Get PDF
    The BCI competition IV stands in the tradition of prior BCI competitions that aim to provide high quality neuroscientific data for open access to the scientific community. As experienced already in prior competitions not only scientists from the narrow field of BCI compete, but scholars with a broad variety of backgrounds and nationalities. They include high specialists as well as students. The goals of all BCI competitions have always been to challenge with respect to novel paradigms and complex data. We report on the following challenges: (1) asynchronous data, (2) synthetic, (3) multi-class continuous data, (4) session-to-session transfer, (5) directionally modulated MEG, (6) finger movements recorded by ECoG. As after past competitions, our hope is that winning entries may enhance the analysis methods of future BCIs.BMBF, 01IB001A, LOKI - Lernen zur Organisation komplexer Systeme der Informationsverarbeitung - Lernen im Kontext der SzenenanalyseBMBF, 01GQ0850, Bernstein Fokus Neurotechnologie - Nichtinvasive Neurotechnologie für Mensch-Maschine InteraktionEC/FP7/224631/EU/Tools for Brain-Computer Interaction/TOBIEC/FP7/216886/EU/Pattern Analysis, Statistical Modelling and Computational Learning 2/PASCAL2BMBF, 01GQ0420, Verbundprojekt: Bernstein-Zentrum für Neural Dynamics, Freiburg - CNDFBMBF, 01GQ0761, Bewegungsassoziierte Aktivierung - Dekodierung bewegungsassoziierter GehirnsignaleBMBF, 01GQ0762, Bewegungsassoziierte Aktivierung - Gehirn- und Maschinenlerne
    corecore