A Motor-Imagery BCI System Based on Deep Learning Networks and Its Applications

Motor imagery brain-computer interface (BCI) by using of deep-learning models is proposed in this paper. In which, we used the electroencephalogram (EEG) signals of motor imagery (MI-EEG) to identify different imagery activities. The brain dynamics of motor imagery are usually measured by EEG as non-stationary time series of low signal-to-noise ratio. However, a variety of methods have been previously developed to classify MI-EEG signals getting not satisfactory results owing to lack of characteristics in time-frequency features. In this paper, discrete wavelet transform (DWT) was applied to transform MIEEG signals and extract their effective coefficients as the time-frequency features. Then two deep learning (DL) models named Long-short term memory (LSTM) and gated recurrent neural networks (GRNN) are used to classify MI-EEG data. LSTM is designed to fight against vanishing gradients. GRNN makes each recurrent unit to capture dependencies of different time scales adaptively. Similar scheme of the LSTM unit, GRNN has gating units that modulate the flow of information inside the unit, but without having a separate memory cells. Experimental results show that GRNN and LSTM yield higher classification accuracies compared to the existing approaches that is helpful for the further research and application of relative RNN in processing of MI-EEG

Saccade Landing Point Prediction Based on Fine-Grained Learning Method

The landing point of a saccade defines the new fixation region, the new region of interest. We asked whether it was possible to predict the saccade landing point early in this very fast eye movement. This work proposes a new algorithm based on LSTM networks and a fine-grained loss function for saccade landing point prediction in real-world scenarios. Predicting the landing point is a critical milestone toward reducing the problems caused by display-update latency in gaze-contingent systems that make real-time changes in the display based on eye tracking. Saccadic eye movements are some of the fastest human neuro-motor activities with angular velocities of up to 1,000°/s. We present a comprehensive analysis of the performance of our method using a database with almost 220,000 saccades from 75 participants captured during natural viewing of videos. We include a comparison with state-of-the-art saccade landing point prediction algorithms. The results obtained using our proposed method outperformed existing approaches with improvements of up to 50% error reduction. Finally, we analyzed some factors that affected prediction errors including duration, length, age, and user intrinsic characteristics.This work was supported in part by the Project BIBECA through MINECO/FEDER under Grant RTI2018-101248-B-100, in part by the Jose Castillejo Program through MINECO under Grant CAS17/00117, and in part by the National Institutes of Health (NIH) under Grant P30EY003790 and Grant R21EY023724

Phase-amplitude coupling between infraslow and high-frequency activities well discriminates between the preictal and interictal states

Hashimoto H., Khoo H.M., Yanagisawa T., et al. Phase-amplitude coupling between infraslow and high-frequency activities well discriminates between the preictal and interictal states. Scientific Reports 11, 17405 (2021); https://doi.org/10.1038/s41598-021-96479-1.Infraslow activity (ISA) and high-frequency activity (HFA) are key biomarkers for studying epileptic seizures. We aimed to elucidate the relationship between ISA and HFA around seizure onset. We enrolled seven patients with drug-resistant focal epilepsy who underwent intracranial electrode placement. We comparatively analyzed the ISA, HFA, and ISA-HFA phase-amplitude coupling (PAC) in the seizure onset zone (SOZ) or non-SOZ (nSOZ) in the interictal, preictal, and ictal states. We recorded 15 seizures. HFA and ISA were larger in the ictal states than in the interictal or preictal state. During seizures, the HFA and ISA of the SOZ were larger and occurred earlier than those of nSOZ. In the preictal state, the ISA-HFA PAC of the SOZ was larger than that of the interictal state, and it began increasing at approximately 87 s before the seizure onset. The receiver-operating characteristic curve revealed that the ISA-HFA PAC of the SOZ showed the highest discrimination performance in the preictal and interictal states, with an area under the curve of 0.926. This study demonstrated the novel insight that ISA-HFA PAC increases before the onset of seizures. Our findings indicate that ISA-HFA PAC could be a useful biomarker for discriminating between the preictal and interictal states

Cross-Subject EEG Emotion Recognition With Self-Organized Graph Neural Network

As a physiological process and high-level cognitive behavior, emotion is an important subarea in neuroscience research. Emotion recognition across subjects based on brain signals has attracted much attention. Due to individual differences across subjects and the low signal-to-noise ratio of EEG signals, the performance of conventional emotion recognition methods is relatively poor. In this paper, we propose a self-organized graph neural network (SOGNN) for cross-subject EEG emotion recognition. Unlike the previous studies based on pre-constructed and fixed graph structure, the graph structure of SOGNN are dynamically constructed by self-organized module for each signal. To evaluate the cross-subject EEG emotion recognition performance of our model, leave-one-subject-out experiments are conducted on two public emotion recognition datasets, SEED and SEED-IV. The SOGNN is able to achieve state-of-the-art emotion recognition performance. Moreover, we investigated the performance variances of the models with different graph construction techniques or features in different frequency bands. Furthermore, we visualized the graph structure learned by the proposed model and found that part of the structure coincided with previous neuroscience research. The experiments demonstrated the effectiveness of the proposed model for cross-subject EEG emotion recognition

A Recurrent Log-Linearized Gaussian Mixture Network

Context in time series is one of the most useful andinteresting characteristics for machine learning. In some cases, thedynamic characteristic would be the only basis for achieving a possibleclassification. A novel neural network, which is named “a recurrentlog-linearized Gaussian mixture network (R-LLGMN)," isproposed in this paper for classification of time series. The structureof this network is based on a hidden Markov model (HMM),which has been well developed in the area of speech recognition.R-LLGMN can as well be interpreted as an extension of a probabilisticneural network using a log-linearized Gaussian mixturemodel, in which recurrent connections have been incorporated tomake temporal information in use. Some simulation experimentsare carried out to compare R-LLGMN with the traditional estimatorof HMM as classifiers, and finally, pattern classification experimentsfor EEG signals are conducted. It is indicated from theseexperiments that R-LLGMN can successfully classify not only artificialdata but real biological data such as EEG signals

Machine Learning approaches to the application of Disease Modifying Therapy for Sickle Cell using Classification Models

This paper discusses the use of machine learning techniques for the classification of medical data, specifically for guiding disease modifying therapies for Sickle Cell. Extensive research has indicated that machine learning approaches generate significant improvements when used for the pre-processing of medical time-series data signals and have assisted in obtaining high accuracy in the classification of medical data. The aim of this paper is to present findings for several classes of learning algorithm for medically related problems. The initial case study addressed in this paper involves classifying the dosage of medication required for the treatment of patients with Sickle Cell Disease. We use different machine learning architectures in order to investigate the accuracy and performance within the case study. The main purpose of applying classification approach is to enable healthcare organisations to provide accurate amount of medication. The results obtained from a range of models during our experiments have shown that of the proposed models, recurrent networks produced inferior results in comparison to conventional feedforward neural networks and the Random Forest model. Results have also indicated that for the recurrent network models tested, the Jordan architecture was found to yield significantly better outcomes over the range of performance measures considered. For our dataset, it was found that the Random Forest Classifier produced the highest levels of performance overall

A Dynamic Neural Network Architecture with immunology Inspired Optimization for Weather Data Forecasting

Recurrent neural networks are dynamical systems that provide for memory capabilities to recall past behaviour, which is necessary in the prediction of time series. In this paper, a novel neural network architecture inspired by the immune algorithm is presented and used in the forecasting of naturally occurring signals, including weather big data signals. Big Data Analysis is a major research frontier, which attracts extensive attention from academia, industry and government, particularly in the context of handling issues related to complex dynamics due to changing weather conditions. Recently, extensive deployment of IoT, sensors, and ambient intelligence systems led to an exponential growth of data in the climate domain. In this study, we concentrate on the analysis of big weather data by using the Dynamic Self Organized Neural Network Inspired by the Immune Algorithm. The learning strategy of the network focuses on the local properties of the signal using a self-organised hidden layer inspired by the immune algorithm, while the recurrent links of the network aim at recalling previously observed signal patterns. The proposed network exhibits improved performance when compared to the feedforward multilayer neural network and state-of-the-art recurrent networks, e.g., the Elman and the Jordan networks. Three non-linear and non-stationary weather signals are used in our experiments. Firstly, the signals are transformed into stationary, followed by 5-steps ahead prediction. Improvements in the prediction results are observed with respect to the mean value of the error (RMS) and the signal to noise ratio (SNR), however to the expense of additional computational complexity, due to presence of recurrent links