Efficient transfer entropy analysis of non-stationary neural time series

Information theory allows us to investigate information processing in neural systems in terms of information transfer, storage and modification. Especially the measure of information transfer, transfer entropy, has seen a dramatic surge of interest in neuroscience. Estimating transfer entropy from two processes requires the observation of multiple realizations of these processes to estimate associated probability density functions. To obtain these observations, available estimators assume stationarity of processes to allow pooling of observations over time. This assumption however, is a major obstacle to the application of these estimators in neuroscience as observed processes are often non-stationary. As a solution, Gomez-Herrero and colleagues theoretically showed that the stationarity assumption may be avoided by estimating transfer entropy from an ensemble of realizations. Such an ensemble is often readily available in neuroscience experiments in the form of experimental trials. Thus, in this work we combine the ensemble method with a recently proposed transfer entropy estimator to make transfer entropy estimation applicable to non-stationary time series. We present an efficient implementation of the approach that deals with the increased computational demand of the ensemble method's practical application. In particular, we use a massively parallel implementation for a graphics processing unit to handle the computationally most heavy aspects of the ensemble method. We test the performance and robustness of our implementation on data from simulated stochastic processes and demonstrate the method's applicability to magnetoencephalographic data. While we mainly evaluate the proposed method for neuroscientific data, we expect it to be applicable in a variety of fields that are concerned with the analysis of information transfer in complex biological, social, and artificial systems.Comment: 27 pages, 7 figures, submitted to PLOS ON

Differentiating Epileptic from Psychogenic Nonepileptic EEG Signals using Time Frequency and Information Theoretic Measures of Connectivity

Differentiating psychogenic nonepileptic seizures from epileptic seizures is a difficult task that requires timely recording of psychogenic events using video electroencephalography (EEG). Interpretation of video EEG to distinguish epileptic features from signal artifacts is error prone and can lead to misdiagnosis of psychogenic seizures as epileptic seizures resulting in undue stress and ineffective treatment with antiepileptic drugs. In this study, an automated surface EEG analysis was implemented to investigate differences between patients classified as having psychogenic or epileptic seizures. Surface EEG signals were grouped corresponding to the anatomical lobes of the brain (frontal, parietal, temporal, and occipital) and central coronal plane of the skull. To determine if differences were present between psychogenic and epileptic groups, magnitude squared coherence (MSC) and cross approximate entropy (C-ApEn) were used as measures of neural connectivity. MSC was computed within each neural frequency band (delta: 0.5Hz-4Hz, theta: 4-8Hz, alpha: 8-13Hz, beta: 13-30Hz, and gamma: 30-100Hz) between all brain regions. C-ApEn was computed bidirectionally between all brain regions. Independent samples t-tests were used to compare groups. The statistical analysis revealed significant differences between psychogenic and epileptic groups for both connectivity measures with the psychogenic group showing higher average connectivity. Average MSC was found to be lower for the epileptic group between the frontal/central, parietal/central, and temporal/occipital regions in the delta band and between the temporal/occipital regions in the theta band. Average C-ApEn was found to be greater for the epileptic group between the frontal/parietal, parietal/frontal, parietal/occipital, and parietal/central region pairs. These results suggest that differences in neural connectivity exist between psychogenic and epileptic patient groups

Entropy Analysis of Univariate Biomedical Signals:Review and Comparison of Methods

International audienc

Characterization of the spontaneous EEG activity in the Alzheimer's disease continuum: from local activation to network organization

La presente Tesis Doctoral se presenta como un compendio de cuatro publicaciones indexadas en el Journal Citation Reports. El objetivo de estas publicaciones es la caracterización de los cambios neuronales subyacentes en las diferentes etapas de la enfermedad de Alzheimer (EA) y su etapa prodrómica, el deterioro cognitivo leve (DCL), siguiendo tres niveles de análisis: activación local, interacción entre pares de sensores, y organización de red. Los principales cambios encontrados a medida que progresa la enfermedad son: (i) una lentificación, y una pérdida de complejidad e irregularidad de la actividad EEG espontánea; (ii) una disminución significativa de la conectividad en bandas altas de frecuencia y un aumento en las bandas bajas; y (iii) una pérdida en la integración y la segregación de las redes neuronales. Estos hallazgos han proporcionado información adicional sobre las alteraciones cerebrales de la EA en sus diferentes etapas, útiles para comprender mejor sus mecanismos fisiopatológicos.Departamento de Teoría de la Señal y Comunicaciones e Ingeniería TelemáticaDoctorado en Tecnologías de la Información y las Telecomunicacione

Measuring Alterations of Spontaneous EEG Neural Coupling in Alzheimer's Disease and Mild Cognitive Impairment by Means of Cross-Entropy Metrics

Alzheimer's Disease (AD) represents the most prevalent form of dementia and is considered a major health problem due to its high prevalence and its economic costs. An accurate characterization of the underlying neural dynamics in AD is crucial in order to adopt effective treatments. In this regard, mild cognitive impairment (MCI) is an important clinical entity, since it is a risk-state for developing dementia. In the present study, coupling patterns of 111 resting-state electroencephalography (EEG) recordings were analyzed. Specifically, we computed Cross-Approximate Entropy (Cross-ApEn) and Cross-Sample Entropy (Cross-SampEn) of 37 patients with dementia due to AD, 37 subjects with MCI, and 37 healthy control (HC) subjects. Our results showed that Cross-SampEn outperformed Cross-ApEn, revealing higher number of significant connections among the three groups (Kruskal-Wallis test, FDR-corrected p-values < 0.05). AD patients exhibited statistically significant lower similarity values at θ and β1 frequency bands compared to HC. MCI is also characterized by a global decrease of similarity in all bands, being only significant at β1. These differences shows that β band might play a significant role in the identification of early stages of AD. Our results suggest that Cross-SampEn could increase the insight into brain dynamics at different AD stages. Consequently, it may contribute to develop early AD biomarkers, potentially useful as diagnostic information

Locomotion postural variability and coordination in boys with overweight

The purpose of this study was to examine the variability and coordination of postural adaptations in normal weight children and those with overweight in running and hopping. Fifty-six boys between 7-10 years were classified into groups as overweight (n=33) or normal-weight (n=23). They performed two trials of running and hopping over a 20-meter straight line distance. Accelerometers were attached on the trunk and head for collecting body movements in different directions from 15 strides. Postural variability and coordination were calculated by multiscale entropy and cross approximate entropy for the running and hopping trials, separately. Findings highlight overweight boys had significantly higher trunk-head coordination in mediolateral direction than normal-weight boys (0.72 vs. 0.68). The hopping movement pattern had highest variability (9.88 vs. 8.77) and trunk-head coordination (0.61 vs. 0.67) than running. Excess body mass demands additional postural adaptations to compensate for reducing the risk of losing balance laterally in boys with overweight

A reusable benchmark of brain-age prediction from M/EEG resting-state signals

Population-level modeling can define quantitative measures of individual aging by applying machine learning to large volumes of brain images. These measures of brain age, obtained from the general population, helped characterize disease severity in neurological populations, improving estimates of diagnosis or prognosis. Magnetoencephalography (MEG) and Electroencephalography (EEG) have the potential to further generalize this approach towards prevention and public health by enabling assessments of brain health at large scales in socioeconomically diverse environments. However, more research is needed to define methods that can handle the complexity and diversity of M/EEG signals across diverse real-world contexts. To catalyse this effort, here we propose reusable benchmarks of competing machine learning approaches for brain age modeling. We benchmarked popular classical machine learning pipelines and deep learning architectures previously used for pathology decoding or brain age estimation in 4 international M/EEG cohorts from diverse countries and cultural contexts, including recordings from more than 2500 participants. Our benchmarks were built on top of the M/EEG adaptations of the BIDS standard, providing tools that can be applied with minimal modification on any M/EEG dataset provided in the BIDS format. Our results suggest that, regardless of whether classical machine learning or deep learning was used, the highest performance was reached by pipelines and architectures involving spatially aware representations of the M/EEG signals, leading to R^2 scores between 0.60-0.71. Hand-crafted features paired with random forest regression provided robust benchmarks even in situations in which other approaches failed. Taken together, this set of benchmarks, accompanied by open-source software and high-level Python scripts, can serve as a starting point and quantitative reference for future efforts at developing M/EEG-based measures of brain aging. The generality of the approach renders this benchmark reusable for other related objectives such as modeling specific cognitive variables or clinical endpoints

RFNet: Riemannian Fusion Network for EEG-based Brain-Computer Interfaces

This paper presents the novel Riemannian Fusion Network (RFNet), a deep neural architecture for learning spatial and temporal information from Electroencephalogram (EEG) for a number of different EEG-based Brain Computer Interface (BCI) tasks and applications. The spatial information relies on Spatial Covariance Matrices (SCM) of multi-channel EEG, whose space form a Riemannian Manifold due to the Symmetric and Positive Definite structure. We exploit a Riemannian approach to map spatial information onto feature vectors in Euclidean space. The temporal information characterized by features based on differential entropy and logarithm power spectrum density is extracted from different windows through time. Our network then learns the temporal information by employing a deep long short-term memory network with a soft attention mechanism. The output of the attention mechanism is used as the temporal feature vector. To effectively fuse spatial and temporal information, we use an effective fusion strategy, which learns attention weights applied to embedding-specific features for decision making. We evaluate our proposed framework on four public datasets from three popular fields of BCI, notably emotion recognition, vigilance estimation, and motor imagery classification, containing various types of tasks such as binary classification, multi-class classification, and regression. RFNet approaches the state-of-the-art on one dataset (SEED) and outperforms other methods on the other three datasets (SEED-VIG, BCI-IV 2A, and BCI-IV 2B), setting new state-of-the-art values and showing the robustness of our framework in EEG representation learning