Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networks

One of the challenges in modeling cognitive events from electroencephalogram (EEG) data is finding representations that are invariant to inter- and intra-subject differences, as well as to inherent noise associated with such data. Herein, we propose a novel approach for learning such representations from multi-channel EEG time-series, and demonstrate its advantages in the context of mental load classification task. First, we transform EEG activities into a sequence of topology-preserving multi-spectral images, as opposed to standard EEG analysis techniques that ignore such spatial information. Next, we train a deep recurrent-convolutional network inspired by state-of-the-art video classification to learn robust representations from the sequence of images. The proposed approach is designed to preserve the spatial, spectral, and temporal structure of EEG which leads to finding features that are less sensitive to variations and distortions within each dimension. Empirical evaluation on the cognitive load classification task demonstrated significant improvements in classification accuracy over current state-of-the-art approaches in this field.Comment: To be published as a conference paper at ICLR 201

Sparse Bilinear Logistic Regression

In this paper, we introduce the concept of sparse bilinear logistic regression for decision problems involving explanatory variables that are two-dimensional matrices. Such problems are common in computer vision, brain-computer interfaces, style/content factorization, and parallel factor analysis. The underlying optimization problem is bi-convex; we study its solution and develop an efficient algorithm based on block coordinate descent. We provide a theoretical guarantee for global convergence and estimate the asymptotical convergence rate using the Kurdyka-{\L}ojasiewicz inequality. A range of experiments with simulated and real data demonstrate that sparse bilinear logistic regression outperforms current techniques in several important applications.Comment: 27 pages, 5 figure

Decoding Brain Activation from Ipsilateral Cortex using ECoG Signals in Humans

Today, learning from the brain is the most challenging issue in many areas. Neural scientists, computer scientists, and engineers are collaborating in this broad research area. With better techniques, we can extract the brain signals by either non-invasive approach such as EEG: electroencephalography), fMRI, or invasive method such as ECoG: electrocorticography), FP: field potential) and signals from single unit. The challenge is, given the brain signals, how can we possibly decipher them? Brain Computer Interfaces, or BCIs, aim at utilizing the brain signals to control prothetic arms or operate devices. Previously almost all the research on BCIs focuses on decoding signals from the contralateral hemisphere to implement BCI systems. However, the loss of functionality in the contralateral cortex often occurs due to strokes, resulting in total failure to motor function of fingers, hands, and limbs contralateral to the damaged hemisphere. Recent studies indicate that the signals from ipsilateral cortex is relevant to the planning phase of motor movements. Therefore, it is critical to find out if human motor movements can be decoded using signals from the ipsilateral cortex. In the thesis, we propose using ECoG signals from the ipsilateral cortex to decode finger movements. To our knowledge, this is the first work that successfully detects finger movements using signals from the ipsilateral cortex. We also investigate the experiment design and decoding directional movements. Our results show high decoding performance. We also show the anatomical feature analysis for ipsilateral cortex in performing motor-associated tasks, and the features are consistent with previous findings. The result reveals promising implications for a stroke relevant BCI

Weighted multi-task learning in classification domain for improving brain-computer interface

One of the major limitations of brain computer interface (BCI) is its long calibration time. Due to between sessions/subjects nonstationarity, typically a big amount of training data needs to be collected at the beginning of each session in order to tune the parameters of the system for the target user. In this paper, a number of novel weighted multi-task transfer learning algorithms are proposed in the classification domain to reduce the calibration time without sacrificing the classification accuracy of the BCI system. The proposed algorithms use data from other subjects and combine them to estimate the classifier parameters for the target subject. This combination is done based on how similar the data from each subject is to the few trials available from the target subject. The proposed algorithms are evaluated using dataset 2a from BCI competition IV. According to the results, the proposed algorithms lead to reduce the calibration time by 75% and enhance the average classification accuracy at the same time

Weighted transfer learning for improving motor imagery-based brain-computer interface

One of the major limitations of motor imagery (MI)-based brain-computer interface (BCI) is its long calibration time. Due to between sessions/subjects variations in the properties of brain signals, typically a large amount of training data needs to be collected at the beginning of each session to calibrate the parameters of the BCI system for the target user. In this paper, we propose a novel transfer learning approach on the classification domain to reduce the calibration time without sacrificing the classification accuracy of MI-BCI. Thus, when only few subject-specific trials are available for training, the estimation of the classification parameters is improved by incorporating previously recorded data from other users. For this purpose, a regularization parameter is added to the objective function of the classifier to make the classification parameters as close as possible to the classification parameters of the previous users who have feature spaces similar to that of the target subject. In this study, a new similarity measure based on the kullback leibler divergence (KL) is used to measure similarity between two feature spaces obtained using subject-specific common spatial patterns (CSP). The proposed transfer learning approach is applied on the logistic regression classifier and evaluated using three datasets. The results showed that compared to the subject-specific classifier, the proposed weighted transfer learning classifier improved the classification results particularly when few subject-specific trials were available for training (p<0.05). Importantly, this improvement was more pronounced for users with medium and poor accuracy. Moreover, the statistical results showed that the proposed weighted transfer learning classifier performed significantly better than the considered comparable baseline algorithms