Sustained attention driving task analysis based on recurrent residual neural network using EEG data

© 2018 IEEE. This paper proposes applying recurrent residual network (RRN) for analyzing electroencephalogram (EEG) data captured during a simulated sustained attention driving task. We first address the suitableness of utilizing residual structure as well as adopting recurrent structure for EEG signal processing. Then based on these descriptions a recurrent residual network is tailored and depicted in detail. Thirdly we use an EEG dataset obtained from a sustained-attention experiment for our model justification. By applying the RRN model to the experimental data and via the competitive result achieved, we demonstrate the elegance of the proposed model. At last, we discuss the characteristics of the learned filters and their interpretations from EEG frequency band perspectives

Generalization of Deep Neural Networks for EEG Data Analysis

University of Technology Sydney. Faculty of Engineering and Information Technology.Electroencephalography (EEG) facilitates the neuroscientific research and applications by virtue of its properties such as non-invasion, affordability, mobility, etc. However, challenges including high artefacts pending, intra- and cross-subject variance, limited data availability, etc., pose the difficulty in reaching solid conclusions. This thesis explores how to utilize and generalize deep neural networks (DNN), which have set new performance records in various fields, to analyze EEG data to mitigate these challenges in reaching enlightening conclusions. This thesis brings the comprehension of research goals by the introduction of EEG and DNN background. It reviews the conventional EEG signal processing methods and highlights the challenges of EEG data analysis. As part of this work, EEG datasets from three stereotypical brain-computer interface (BCI) experiments are described in detail to assess the proposed methods by benchmarking. To illustrate the DNN centered methodology for addressing divergent challenges of EEG data analysis, a research map is compassed to show respective contributions in fulfilling the following specific goals: (1) Selection of appropriate DNN structures targeting EEG data captured during different BCI experiments. (2) Solutions to address the intra- and cross-subject variance of EEG data. (3) Utilization of brain-inspired computation such as memory network to improve the performance of processing EEG data. (4) Exploration of new computation paradigm, i.e., reinforcement learning (RL), to relieve the noise label challenge and to improve data utilization. By a series of published and in-preparation papers, this thesis demonstrates different achievements corresponding to the set goals: (1) Investigation of the computation traits of neural network structures and revelation of their effectiveness in EEG signal processing. The designed recurrent residual network (RRN), which is based on the recurrent structure, residual structures, etc., achieves the highest classification accuracy and provides coherent evidence and interpretation to the efficacy of conventional hand-crafted filters. (2) Invention of adversarial method in light of the domain adaptation (DA) and generative adversarial network (GAN) to address inter- and cross-subject variance. The proposed subject adaptation network (SAN), which borrows the philosophy of GAN but works in different ways, shows promising results among EEG sample clustering, sample-of-interest selection, EEG data alignment, etc. (3) Systematic study of memory networks and proposal of memory module based on self-organized maps (SOM). Work on a stacked version of differentiable neural computer (DNC), reveals that EEG features buried in the endurance experiment can be more effectively harvested by augmenting memory and consequently boost the performance. SOM-based memory network demonstrates its capability in reducing network complexity. (4) Implementation of reinforcement learning (RL) for EEG data analysis to relieve the noisy label challenge and to improve EEG data utilization. Instantiation of RL framework such as deep Q-network (DQN) demonstrates its feasibility and practicability for certain BCI experiments. Generally, through this sequence of work and papers, this thesis contributes from different aspects that well advance the EEG data analysis via DNN