73,413 research outputs found
An embedding for EEG signals learned using a triplet loss
Neurophysiological time series recordings like the electroencephalogram (EEG)
or local field potentials are obtained from multiple sensors. They can be
decoded by machine learning models in order to estimate the ongoing brain state
of a patient or healthy user. In a brain-computer interface (BCI), this decoded
brain state information can be used with minimal time delay to either control
an application, e.g., for communication or for rehabilitation after stroke, or
to passively monitor the ongoing brain state of the subject, e.g., in a
demanding work environment. A specific challenge in such decoding tasks is
posed by the small dataset sizes in BCI compared to other domains of machine
learning like computer vision or natural language processing. A possibility to
tackle classification or regression problems in BCI despite small training data
sets is through transfer learning, which utilizes data from other sessions,
subjects or even datasets to train a model. In this exploratory study, we
propose novel domain-specific embeddings for neurophysiological data. Our
approach is based on metric learning and builds upon the recently proposed
ladder loss. Using embeddings allowed us to benefit, both from the good
generalisation abilities and robustness of deep learning and from the fast
training of classical machine learning models for subject-specific calibration.
In offline analyses using EEG data of 14 subjects, we tested the embeddings'
feasibility and compared their efficiency with state-of-the-art deep learning
models and conventional machine learning pipelines. In summary, we propose the
use of metric learning to obtain pre-trained embeddings of EEG-BCI data as a
means to incorporate domain knowledge and to reach competitive performance on
novel subjects with minimal calibration requirements.Comment: 23 pages, 11 figures, 5 appendix pages, 6 appendix figures, work
conducted in 2020-2021 during an ARPE
(https://ens-paris-saclay.fr/en/masters/ens-paris-saclay-degree/year-pre-doctoral-research-abroad-arpe
Converting Your Thoughts to Texts: Enabling Brain Typing via Deep Feature Learning of EEG Signals
An electroencephalography (EEG) based Brain Computer Interface (BCI) enables
people to communicate with the outside world by interpreting the EEG signals of
their brains to interact with devices such as wheelchairs and intelligent
robots. More specifically, motor imagery EEG (MI-EEG), which reflects a
subjects active intent, is attracting increasing attention for a variety of BCI
applications. Accurate classification of MI-EEG signals while essential for
effective operation of BCI systems, is challenging due to the significant noise
inherent in the signals and the lack of informative correlation between the
signals and brain activities. In this paper, we propose a novel deep neural
network based learning framework that affords perceptive insights into the
relationship between the MI-EEG data and brain activities. We design a joint
convolutional recurrent neural network that simultaneously learns robust
high-level feature presentations through low-dimensional dense embeddings from
raw MI-EEG signals. We also employ an Autoencoder layer to eliminate various
artifacts such as background activities. The proposed approach has been
evaluated extensively on a large- scale public MI-EEG dataset and a limited but
easy-to-deploy dataset collected in our lab. The results show that our approach
outperforms a series of baselines and the competitive state-of-the- art
methods, yielding a classification accuracy of 95.53%. The applicability of our
proposed approach is further demonstrated with a practical BCI system for
typing.Comment: 10 page
Combining brain-computer interfaces and assistive technologies: state-of-the-art and challenges
In recent years, new research has brought the field of EEG-based Brain-Computer Interfacing (BCI) out of its infancy and into a phase of relative maturity through many demonstrated prototypes such as brain-controlled wheelchairs, keyboards, and computer games. With this proof-of-concept phase in the past, the time is now ripe to focus on the development of practical BCI technologies that can be brought out of the lab and into real-world applications. In particular, we focus on the prospect of improving the lives of countless disabled individuals through a combination of BCI technology with existing assistive technologies (AT). In pursuit of more practical BCIs for use outside of the lab, in this paper, we identify four application areas where disabled individuals could greatly benefit from advancements in BCI technology, namely,“Communication and Control”, “Motor Substitution”, “Entertainment”, and “Motor Recovery”. We review the current state of the art and possible future developments, while discussing the main research issues in these four areas. In particular, we expect the most progress in the development of technologies such as hybrid BCI architectures, user-machine adaptation algorithms, the exploitation of users’ mental states for BCI reliability and confidence measures, the incorporation of principles in human-computer interaction (HCI) to improve BCI usability, and the development of novel BCI technology including better EEG devices
Brain-Switches for Asynchronous Brain−Computer Interfaces: A Systematic Review
A brain–computer interface (BCI) has been extensively studied to develop a novel communication system for disabled people using their brain activities. An asynchronous BCI system is more realistic and practical than a synchronous BCI system, in that, BCI commands can be generated whenever the user wants. However, the relatively low performance of an asynchronous BCI system is problematic because redundant BCI commands are required to correct false-positive operations. To significantly reduce the number of false-positive operations of an asynchronous BCI system, a two-step approach has been proposed using a brain-switch that first determines whether the user wants to use an asynchronous BCI system before the operation of the asynchronous BCI system. This study presents a systematic review of the state-of-the-art brain-switch techniques and future research directions. To this end, we reviewed brain-switch research articles published from 2000 to 2019 in terms of their (a) neuroimaging modality, (b) paradigm, (c) operation algorithm, and (d) performance
Multi-Person Brain Activity Recognition via Comprehensive EEG Signal Analysis
An electroencephalography (EEG) based brain activity recognition is a
fundamental field of study for a number of significant applications such as
intention prediction, appliance control, and neurological disease diagnosis in
smart home and smart healthcare domains. Existing techniques mostly focus on
binary brain activity recognition for a single person, which limits their
deployment in wider and complex practical scenarios. Therefore, multi-person
and multi-class brain activity recognition has obtained popularity recently.
Another challenge faced by brain activity recognition is the low recognition
accuracy due to the massive noises and the low signal-to-noise ratio in EEG
signals. Moreover, the feature engineering in EEG processing is time-consuming
and highly re- lies on the expert experience. In this paper, we attempt to
solve the above challenges by proposing an approach which has better EEG
interpretation ability via raw Electroencephalography (EEG) signal analysis for
multi-person and multi-class brain activity recognition. Specifically, we
analyze inter-class and inter-person EEG signal characteristics, based on which
to capture the discrepancy of inter-class EEG data. Then, we adopt an
Autoencoder layer to automatically refine the raw EEG signals by eliminating
various artifacts. We evaluate our approach on both a public and a local EEG
datasets and conduct extensive experiments to explore the effect of several
factors (such as normalization methods, training data size, and Autoencoder
hidden neuron size) on the recognition results. The experimental results show
that our approach achieves a high accuracy comparing to competitive
state-of-the-art methods, indicating its potential in promoting future research
on multi-person EEG recognition.Comment: 10 page
- …