483 research outputs found
RFNet: Riemannian Fusion Network for EEG-based Brain-Computer Interfaces
This paper presents the novel Riemannian Fusion Network (RFNet), a deep
neural architecture for learning spatial and temporal information from
Electroencephalogram (EEG) for a number of different EEG-based Brain Computer
Interface (BCI) tasks and applications. The spatial information relies on
Spatial Covariance Matrices (SCM) of multi-channel EEG, whose space form a
Riemannian Manifold due to the Symmetric and Positive Definite structure. We
exploit a Riemannian approach to map spatial information onto feature vectors
in Euclidean space. The temporal information characterized by features based on
differential entropy and logarithm power spectrum density is extracted from
different windows through time. Our network then learns the temporal
information by employing a deep long short-term memory network with a soft
attention mechanism. The output of the attention mechanism is used as the
temporal feature vector. To effectively fuse spatial and temporal information,
we use an effective fusion strategy, which learns attention weights applied to
embedding-specific features for decision making. We evaluate our proposed
framework on four public datasets from three popular fields of BCI, notably
emotion recognition, vigilance estimation, and motor imagery classification,
containing various types of tasks such as binary classification, multi-class
classification, and regression. RFNet approaches the state-of-the-art on one
dataset (SEED) and outperforms other methods on the other three datasets
(SEED-VIG, BCI-IV 2A, and BCI-IV 2B), setting new state-of-the-art values and
showing the robustness of our framework in EEG representation learning
Electroencephalograph (EEG) signal processing techniques for motor imagery Brain Computer interface systems
Brain-Computer Interface (BCI) system provides a channel for the brain to
control external devices using electrical activities of the brain without using the
peripheral nervous system. These BCI systems are being used in various medical
applications, for example controlling a wheelchair and neuroprosthesis devices for
the disabled, thereby assisting them in activities of daily living. People suffering
from Amyotrophic Lateral Sclerosis (ALS), Multiple Sclerosis and completely locked
in are unable to perform any body movements because of the damage of the
peripheral nervous system, but their cognitive function is still intact. BCIs operate
external devices by acquiring brain signals and converting them to control
commands to operate external devices. Motor-imagery (MI) based BCI systems, in
particular, are based on the sensory-motor rhythms which are generated by the
imagination of body limbs. These signals can be decoded as control commands in
BCI application. Electroencephalogram (EEG) is commonly used for BCI applications
because it is non-invasive. The main challenges of decoding the EEG signal are
because it is non-stationary and has a low spatial resolution. The common spatial
pattern algorithm is considered to be the most effective technique for
discrimination of spatial filter but is easily affected by the presence of outliers.
Therefore, a robust algorithm is required for extraction of discriminative features
from the motor imagery EEG signals.
This thesis mainly aims in developing robust spatial filtering criteria which
are effective for classification of MI movements. We have proposed two approaches
for the robust classification of MI movements. The first approach is for the
classification of multiclass MI movements based on the thinICA (Independent
Component Analysis) and mCSP (multiclass Common Spatial Pattern Filter) method.
The observed results indicate that these approaches can be a step towards the
development of robust feature extraction for MI-based BCI system.
The main contribution of the thesis is the second criterion, which is based on
Alpha- Beta logarithmic-determinant divergence for the classification of two class
MI movements. A detailed study has been done by obtaining a link between the AB
log det divergence and CSP criterion. We propose a scaling parameter to enable a
similar way for selecting the respective filters like the CSP algorithm. Additionally,
the optimization of the gradient of AB log-det divergence for this application was
also performed. The Sub-ABLD (Subspace Alpha-Beta Log-Det divergence)
algorithm is proposed for the discrimination of two class MI movements. The
robustness of this algorithm is tested with both the simulated and real data from BCI
competition dataset. Finally, the resulting performances of the proposed algorithms
have been favorably compared with other existing algorithms
- …