Data-driven multivariate and multiscale methods for brain computer interface

This thesis focuses on the development of data-driven multivariate and multiscale methods for brain computer interface (BCI) systems. The electroencephalogram (EEG), the most convenient means to measure neurophysiological activity due to its noninvasive nature, is mainly considered. The nonlinearity and nonstationarity inherent in EEG and its multichannel recording nature require a new set of data-driven multivariate techniques to estimate more accurately features for enhanced BCI operation. Also, a long term goal is to enable an alternative EEG recording strategy for achieving long-term and portable monitoring. Empirical mode decomposition (EMD) and local mean decomposition (LMD), fully data-driven adaptive tools, are considered to decompose the nonlinear and nonstationary EEG signal into a set of components which are highly localised in time and frequency. It is shown that the complex and multivariate extensions of EMD, which can exploit common oscillatory modes within multivariate (multichannel) data, can be used to accurately estimate and compare the amplitude and phase information among multiple sources, a key for the feature extraction of BCI system. A complex extension of local mean decomposition is also introduced and its operation is illustrated on two channel neuronal spike streams. Common spatial pattern (CSP), a standard feature extraction technique for BCI application, is also extended to complex domain using the augmented complex statistics. Depending on the circularity/noncircularity of a complex signal, one of the complex CSP algorithms can be chosen to produce the best classification performance between two different EEG classes. Using these complex and multivariate algorithms, two cognitive brain studies are investigated for more natural and intuitive design of advanced BCI systems. Firstly, a Yarbus-style auditory selective attention experiment is introduced to measure the user attention to a sound source among a mixture of sound stimuli, which is aimed at improving the usefulness of hearing instruments such as hearing aid. Secondly, emotion experiments elicited by taste and taste recall are examined to determine the pleasure and displeasure of a food for the implementation of affective computing. The separation between two emotional responses is examined using real and complex-valued common spatial pattern methods. Finally, we introduce a novel approach to brain monitoring based on EEG recordings from within the ear canal, embedded on a custom made hearing aid earplug. The new platform promises the possibility of both short- and long-term continuous use for standard brain monitoring and interfacing applications

EEG-Based User Reaction Time Estimation Using Riemannian Geometry Features

Riemannian geometry has been successfully used in many brain-computer interface (BCI) classification problems and demonstrated superior performance. In this paper, for the first time, it is applied to BCI regression problems, an important category of BCI applications. More specifically, we propose a new feature extraction approach for Electroencephalogram (EEG) based BCI regression problems: a spatial filter is first used to increase the signal quality of the EEG trials and also to reduce the dimensionality of the covariance matrices, and then Riemannian tangent space features are extracted. We validate the performance of the proposed approach in reaction time estimation from EEG signals measured in a large-scale sustained-attention psychomotor vigilance task, and show that compared with the traditional powerband features, the tangent space features can reduce the root mean square estimation error by 4.30-8.30%, and increase the estimation correlation coefficient by 6.59-11.13%.Comment: arXiv admin note: text overlap with arXiv:1702.0291

Approximate entropy as an indicator of non-linearity in self paced voluntary finger movement EEG

This study investigates the indications of non-linear dynamic structures in electroencephalogram signals. The iterative amplitude adjusted surrogate data method along with seven non-linear test statistics namely the third order autocorrelation, asymmetry due to time reversal, delay vector variance method, correlation dimension, largest Lyapunov exponent, non-linear prediction error and approximate entropy has been used for analysing the EEG data obtained during self paced voluntary finger-movement. The results have demonstrated that there are clear indications of non-linearity in the EEG signals. However the rejection of the null hypothesis of non-linearity rate varied based on different parameter settings demonstrating significance of embedding dimension and time lag parameters for capturing underlying non-linear dynamics in the signals. Across non-linear test statistics, the highest degree of non-linearity was indicated by approximate entropy (APEN) feature regardless of the parameter settings

The brain's response to pleasant touch: an EEG investigation of tactile caressing

Somatosensation as a proximal sense can have a strong impact on our attitude toward physical objects and other human beings. However, relatively little is known about how hedonic valence of touch is processed at the cortical level. Here we investigated the electrophysiological correlates of affective tactile sensation during caressing of the right forearm with pleasant and unpleasant textile fabrics. We show dissociation between more physically driven differential brain responses to the different fabrics in early somatosensory cortex - the well-known mu-suppression (10-20 Hz) - and a beta-band response (25-30 Hz) in presumably higher-order somatosensory areas in the right hemisphere that correlated well with the subjective valence of tactile caressing. Importantly, when using single trial classification techniques, beta-power significantly distinguished between pleasant and unpleasant stimulation on a single trial basis with high accuracy. Our results therefore suggest a dissociation of the sensory and affective aspects of touch in the somatosensory system and may provide features that may be used for single trial decoding of affective mental states from simple electroencephalographic measurements

Translation of EEG spatial filters from resting to motor imagery using independent component analysis.

Electroencephalogram (EEG)-based brain-computer interfaces (BCIs) often use spatial filters to improve signal-to-noise ratio of task-related EEG activities. To obtain robust spatial filters, large amounts of labeled data, which are often expensive and labor-intensive to obtain, need to be collected in a training procedure before online BCI control. Several studies have recently developed zero-training methods using a session-to-session scenario in order to alleviate this problem. To our knowledge, a state-to-state translation, which applies spatial filters derived from one state to another, has never been reported. This study proposes a state-to-state, zero-training method to construct spatial filters for extracting EEG changes induced by motor imagery. Independent component analysis (ICA) was separately applied to the multi-channel EEG in the resting and the motor imagery states to obtain motor-related spatial filters. The resultant spatial filters were then applied to single-trial EEG to differentiate left- and right-hand imagery movements. On a motor imagery dataset collected from nine subjects, comparable classification accuracies were obtained by using ICA-based spatial filters derived from the two states (motor imagery: 87.0%, resting: 85.9%), which were both significantly higher than the accuracy achieved by using monopolar scalp EEG data (80.4%). The proposed method considerably increases the practicality of BCI systems in real-world environments because it is less sensitive to electrode misalignment across different sessions or days and does not require annotated pilot data to derive spatial filters

Preference Analysis Method Applying Relationship between Electroencephalogram Activities and Egogram in Prefrontal Cortex Activities : How to collaborate between engineering techniques and psychology

This paper introduces a method of preference analysis based on electroencephalogram (EEG) analysis of prefrontal cortex activity. The proposed method applies the relationship between EEG activity and the Egogram. The EEG senses a single point and records readings by means of a dry-type sensor and a small number of electrodes. The EEG analysis adapts the feature mining and the clustering on EEG patterns using a self-organizing map (SOM). EEG activity of the prefrontal cortex displays individual difference. To take the individual difference into account, we construct a feature vector for input modality of the SOM. The input vector for the SOM consists of the extracted EEG feature vector and a human character vector, which is the human character quantified through the ego analysis using psychological testing. In preprocessing, we extract the EEG feature vector by calculating the time average on each frequency band: θ, low-β, and high-β. To prove the effectiveness of the proposed method, we perform experiments using real EEG data. These results show that the accuracy rate of the EEG pattern classification is higher than it was before the improvement of the input vector

Tracking Control for Non-Minimum Phase System and Brain Computer Interface

For generations, humans dreamed about the ability to communicate and interact with machines through thought alone or to create devices that can peer into a person’s mind and thoughts. Researchers have developed new technologies to create brain computer interfaces (BCIs), communication systems that do not depend on the brain’s normal output pathways of peripheral nerves and muscles. The objective of the first part of this thesis is to develop a new BCI based on electroencephalography (EEG) to move a computer cursor over a short training period in real time. The work motivations of this part are to increase: speed and accuracy, as in BCI settings, subject has a few seconds to make a selection with a relatively high accuracy. Recently, improvements have been developed to make EEG more accurate by increasing the spatial resolution. One such improvement is the application of the surface Laplacian to the EEG, the second spatial derivative. Tripolar concentric ring electrodes (TCREs) automatically perform the Laplacian on the surface potentials and provide better spatial selectivity and signal-to-noise ratio than conventional EEG that is recorded with conventional disc electrodes. Another important feature using TCRE is the capability to record the EEG and the TCRE EEG (tEEG) signals concurrently from the same location on the scalp for the same electrical activity coming from the brain. In this part we also demonstrate that tEEG signals can enable users to control a computer cursor rapidly in different directions with significantly higher accuracy during their first session of training for 1D and 2D cursor control. Output tracking control of non-minimum phase systems is a highly challenging problem encountered in many practical engineering applications. Classical inversion techniques provide exact output tracking but lead to internal instability, whereas modern inversion methods provide stable asymptotic tracking but produce large transient errors. Both methods provide an approximation of feedback control, which leads to non robust systems, very sensitive to noise, considerable tracking errors and a significant singularity problem. Aiming at the problem of system inversion to the true system, the objective of the second part of this thesis is to develop a new method based on true inversion for minimum phase system and approximate inversion for non-minimum phase systems. The proposed algorithm is automatic and has minimal computational complexities which make it suitable for real-time control. The process to develop the proposed algorithm is partitioned into (1) minimum phase feedforward inverse filter, and (2) non-minimum phase inversion. In a minimum phase inversion, we consider the design of a feedforward controller to invert the response of a feedback loop that has stable zero locations. The complete control system consists of a feedforward controller cascaded with a closed-loop system. The outputs of the resulting inverse filter are delayed versions of the corresponding reference input signals, and delays are given by the vector relative degree of the closed-loop