Data Augmentation for Deep-Learning-Based Electroencephalography

Background: Data augmentation (DA) has recently been demonstrated to achieve considerable performance gains for deep learning (DL)—increased accuracy and stability and reduced overfitting. Some electroencephalography (EEG) tasks suffer from low samples-to-features ratio, severely reducing DL effectiveness. DA with DL thus holds transformative promise for EEG processing, possibly like DL revolutionized computer vision, etc. New method: We review trends and approaches to DA for DL in EEG to address: Which DA approaches exist and are common for which EEG tasks? What input features are used? And, what kind of accuracy gain can be expected? Results: DA for DL on EEG begun 5 years ago and is steadily used more. We grouped DA techniques (noise addition, generative adversarial networks, sliding windows, sampling, Fourier transform, recombination of segmentation, and others) and EEG tasks (into seizure detection, sleep stages, motor imagery, mental workload, emotion recognition, motor tasks, and visual tasks). DA efficacy across techniques varied considerably. Noise addition and sliding windows provided the highest accuracy boost; mental workload most benefitted from DA. Sliding window, noise addition, and sampling methods most common for seizure detection, mental workload, and sleep stages, respectively. Comparing with existing methods: Percent of decoding accuracy explained by DA beyond unaugmented accuracy varied between 8% for recombination of segmentation and 36% for noise addition and from 14% for motor imagery to 56% for mental workload—29% on average. Conclusions: DA increasingly used and considerably improved DL decoding accuracy on EEG. Additional publications—if adhering to our reporting guidelines—will facilitate more detailed analysis

Data Augmentation for Deep-Learning-Based Electroencephalography

Background: Data augmentation (DA) has recently been demonstrated to achieve considerable performance gains for deep learning (DL)—increased accuracy and stability and reduced overfitting. Some electroencephalography (EEG) tasks suffer from low samples-to-features ratio, severely reducing DL effectiveness. DA with DL thus holds transformative promise for EEG processing, possibly like DL revolutionized computer vision, etc. New method: We review trends and approaches to DA for DL in EEG to address: Which DA approaches exist and are common for which EEG tasks? What input features are used? And, what kind of accuracy gain can be expected? Results: DA for DL on EEG begun 5 years ago and is steadily used more. We grouped DA techniques (noise addition, generative adversarial networks, sliding windows, sampling, Fourier transform, recombination of segmentation, and others) and EEG tasks (into seizure detection, sleep stages, motor imagery, mental workload, emotion recognition, motor tasks, and visual tasks). DA efficacy across techniques varied considerably. Noise addition and sliding windows provided the highest accuracy boost; mental workload most benefitted from DA. Sliding window, noise addition, and sampling methods most common for seizure detection, mental workload, and sleep stages, respectively. Comparing with existing methods: Percent of decoding accuracy explained by DA beyond unaugmented accuracy varied between 8% for recombination of segmentation and 36% for noise addition and from 14% for motor imagery to 56% for mental workload—29% on average. Conclusions: DA increasingly used and considerably improved DL decoding accuracy on EEG. Additional publications—if adhering to our reporting guidelines—will facilitate more detailed analysis

Spatio-Temporal and Multisensory Integration: the relationship between sleep and the cerebellum

Does the cerebellum sleep? If so, does sleep contribute to cerebellar cognition? In this thesis, the sleep contribution to the consolidation process of spatial-temporal and multisensory integration was investigated in relation to the human cerebellum. Multiple experimental approaches were used to answer research questions addressed in the various chapters. Summarizing the evidence of the electrophysiology and neuroimaging studies, in Chapter1 we present intriguing evidence that the cerebellum is involved in sleep physiology, and that cerebellar-dependent memory formation can be consolidated during sleep. In Chapter 2, using functional neuroimaging in healthy participants during various forms of the Serial interception sequential learning (SISL) task, i.e., predictive timing, motor coordination, and motor imagination, we assessed the cerebellar involvement in spatio-temporal predictive timing; and possible cerebellar interactions with other regions, most notably the hippocampus. In Chapter 3, we add to the findings of Chapter 2 that indicate the cerebellum and hippocampus are involved in the task, by showing that more than simply activated, the cerebellum is a necessary and responsible region for the establishment of the spatio-temporal prediction. This follows from the deficits in behavioral properties of the predictive and reactive timing in the cerebellar ataxia type 6 patients, using the modified version of the SISL task. In Chapter 4, we assessed the subsequent post-interval behavioral performances on the learning of the fixed and random timing sequences in the SISL task, comparing a sleep group and wake group in healthy participants. Our findings show that sleep consolidates the process of cerebellar-dependent spatio-temporal integration. In Chapter 5, we investigated the establishment of visual-tactile integration during sleep through the examination of tactile motion stimulation during sleep and showed that, subsequent to sleep, directional visual motion discrimination i