160 research outputs found
Adversarial Variational Embedding for Robust Semi-supervised Learning
Semi-supervised learning is sought for leveraging the unlabelled data when
labelled data is difficult or expensive to acquire. Deep generative models
(e.g., Variational Autoencoder (VAE)) and semisupervised Generative Adversarial
Networks (GANs) have recently shown promising performance in semi-supervised
classification for the excellent discriminative representing ability. However,
the latent code learned by the traditional VAE is not exclusive (repeatable)
for a specific input sample, which prevents it from excellent classification
performance. In particular, the learned latent representation depends on a
non-exclusive component which is stochastically sampled from the prior
distribution. Moreover, the semi-supervised GAN models generate data from
pre-defined distribution (e.g., Gaussian noises) which is independent of the
input data distribution and may obstruct the convergence and is difficult to
control the distribution of the generated data. To address the aforementioned
issues, we propose a novel Adversarial Variational Embedding (AVAE) framework
for robust and effective semi-supervised learning to leverage both the
advantage of GAN as a high quality generative model and VAE as a posterior
distribution learner. The proposed approach first produces an exclusive latent
code by the model which we call VAE++, and meanwhile, provides a meaningful
prior distribution for the generator of GAN. The proposed approach is evaluated
over four different real-world applications and we show that our method
outperforms the state-of-the-art models, which confirms that the combination of
VAE++ and GAN can provide significant improvements in semisupervised
classification.Comment: 9 pages, Accepted by Research Track in KDD 201
An overview of deep learning techniques for epileptic seizures detection and prediction based on neuroimaging modalities: Methods, challenges, and future works
Epilepsy is a disorder of the brain denoted by frequent seizures. The symptoms of seizure include confusion,
abnormal staring, and rapid, sudden, and uncontrollable hand movements. Epileptic seizure detection methods
involve neurological exams, blood tests, neuropsychological tests, and neuroimaging modalities. Among these,
neuroimaging modalities have received considerable attention from specialist physicians. One method to facilitate
the accurate and fast diagnosis of epileptic seizures is to employ computer-aided diagnosis systems (CADS)
based on deep learning (DL) and neuroimaging modalities. This paper has studied a comprehensive overview of
DL methods employed for epileptic seizures detection and prediction using neuroimaging modalities. First, DLbased
CADS for epileptic seizures detection and prediction using neuroimaging modalities are discussed. Also,
descriptions of various datasets, preprocessing algorithms, and DL models which have been used for epileptic
seizures detection and prediction have been included. Then, research on rehabilitation tools has been presented,
which contains brain-computer interface (BCI), cloud computing, internet of things (IoT), hardware implementation
of DL techniques on field-programmable gate array (FPGA), etc. In the discussion section, a comparison
has been carried out between research on epileptic seizure detection and prediction. The challenges in
epileptic seizures detection and prediction using neuroimaging modalities and DL models have been described. In
addition, possible directions for future works in this field, specifically for solving challenges in datasets, DL,
rehabilitation, and hardware models, have been proposed. The final section is dedicated to the conclusion which
summarizes the significant findings of the paper
Early Warning via tipping-preserving latent stochastic dynamical system and meta label correcting
Early warning for epilepsy patients is crucial for their safety and
well-being, in terms of preventing or minimizing the severity of seizures.
Through the patients' EEG data, we propose a meta learning framework for
improving prediction on early ictal signals. To better utilize the meta label
corrector method, we fuse the information from both the real data and the
augmented data from the latent Stochastic differential equation(SDE). Besides,
we also optimally select the latent dynamical system via distribution of
transition time between real data and that from the latent SDE. In this way,
the extracted tipping dynamical feature is also integrated into the meta
network to better label the noisy data. To validate our method, LSTM is
implemented as the baseline model. We conduct a series of experiments to
predict seizure in various long-term window from 1-2 seconds input data and
find surprisingly increment of prediction accuracy.Comment: 12 pages,4 figure
Data Augmentation for Deep-Learning-Based Electroencephalography
Background: Data augmentation (DA) has recently been demonstrated to achieve considerable performance gains for deep learning (DL)—increased accuracy and stability and reduced overfitting. Some electroencephalography (EEG) tasks suffer from low samples-to-features ratio, severely reducing DL effectiveness. DA with DL thus holds transformative promise for EEG processing, possibly like DL revolutionized computer vision, etc.
New method: We review trends and approaches to DA for DL in EEG to address: Which DA approaches exist and are common for which EEG tasks? What input features are used? And, what kind of accuracy gain can be expected?
Results: DA for DL on EEG begun 5 years ago and is steadily used more. We grouped DA techniques (noise addition, generative adversarial networks, sliding windows, sampling, Fourier transform, recombination of segmentation, and others) and EEG tasks (into seizure detection, sleep stages, motor imagery, mental workload, emotion recognition, motor tasks, and visual tasks). DA efficacy across techniques varied considerably. Noise addition and sliding windows provided the highest accuracy boost; mental workload most benefitted from DA. Sliding window, noise addition, and sampling methods most common for seizure detection, mental workload, and sleep stages, respectively.
Comparing with existing methods: Percent of decoding accuracy explained by DA beyond unaugmented accuracy varied between 8% for recombination of segmentation and 36% for noise addition and from 14% for motor imagery to 56% for mental workload—29% on average.
Conclusions: DA increasingly used and considerably improved DL decoding accuracy on EEG. Additional publications—if adhering to our reporting guidelines—will facilitate more detailed analysis
Decoding Neural Signals with Computational Models: A Systematic Review of Invasive BMI
There are significant milestones in modern human's civilization in which
mankind stepped into a different level of life with a new spectrum of
possibilities and comfort. From fire-lighting technology and wheeled wagons to
writing, electricity and the Internet, each one changed our lives dramatically.
In this paper, we take a deep look into the invasive Brain Machine Interface
(BMI), an ambitious and cutting-edge technology which has the potential to be
another important milestone in human civilization. Not only beneficial for
patients with severe medical conditions, the invasive BMI technology can
significantly impact different technologies and almost every aspect of human's
life. We review the biological and engineering concepts that underpin the
implementation of BMI applications. There are various essential techniques that
are necessary for making invasive BMI applications a reality. We review these
through providing an analysis of (i) possible applications of invasive BMI
technology, (ii) the methods and devices for detecting and decoding brain
signals, as well as (iii) possible options for stimulating signals into human's
brain. Finally, we discuss the challenges and opportunities of invasive BMI for
further development in the area.Comment: 51 pages, 14 figures, review articl
Data Augmentation for Deep-Learning-Based Electroencephalography
Background: Data augmentation (DA) has recently been demonstrated to achieve considerable performance gains for deep learning (DL)—increased accuracy and stability and reduced overfitting. Some electroencephalography (EEG) tasks suffer from low samples-to-features ratio, severely reducing DL effectiveness. DA with DL thus holds transformative promise for EEG processing, possibly like DL revolutionized computer vision, etc.
New method: We review trends and approaches to DA for DL in EEG to address: Which DA approaches exist and are common for which EEG tasks? What input features are used? And, what kind of accuracy gain can be expected?
Results: DA for DL on EEG begun 5 years ago and is steadily used more. We grouped DA techniques (noise addition, generative adversarial networks, sliding windows, sampling, Fourier transform, recombination of segmentation, and others) and EEG tasks (into seizure detection, sleep stages, motor imagery, mental workload, emotion recognition, motor tasks, and visual tasks). DA efficacy across techniques varied considerably. Noise addition and sliding windows provided the highest accuracy boost; mental workload most benefitted from DA. Sliding window, noise addition, and sampling methods most common for seizure detection, mental workload, and sleep stages, respectively.
Comparing with existing methods: Percent of decoding accuracy explained by DA beyond unaugmented accuracy varied between 8% for recombination of segmentation and 36% for noise addition and from 14% for motor imagery to 56% for mental workload—29% on average.
Conclusions: DA increasingly used and considerably improved DL decoding accuracy on EEG. Additional publications—if adhering to our reporting guidelines—will facilitate more detailed analysis
- …