Multiscale Information Decomposition: Exact Computation for Multivariate Gaussian Processes

Exploiting the theory of state space models, we derive the exact expressions of the information transfer, as well as redundant and synergistic transfer, for coupled Gaussian processes observed at multiple temporal scales. All of the terms, constituting the frameworks known as interaction information decomposition and partial information decomposition, can thus be analytically obtained for different time scales from the parameters of the VAR model that fits the processes. We report the application of the proposed methodology firstly to benchmark Gaussian systems, showing that this class of systems may generate patterns of information decomposition characterized by mainly redundant or synergistic information transfer persisting across multiple time scales or even by the alternating prevalence of redundant and synergistic source interaction depending on the time scale. Then, we apply our method to an important topic in neuroscience, i.e., the detection of causal interactions in human epilepsy networks, for which we show the relevance of partial information decomposition to the detection of multiscale information transfer spreading from the seizure onset zone

Fundamental structures of dynamic social networks

Social systems are in a constant state of flux with dynamics spanning from minute-by-minute changes to patterns present on the timescale of years. Accurate models of social dynamics are important for understanding spreading of influence or diseases, formation of friendships, and the productivity of teams. While there has been much progress on understanding complex networks over the past decade, little is known about the regularities governing the micro-dynamics of social networks. Here we explore the dynamic social network of a densely-connected population of approximately 1000 individuals and their interactions in the network of real-world person-to-person proximity measured via Bluetooth, as well as their telecommunication networks, online social media contacts, geo-location, and demographic data. These high-resolution data allow us to observe social groups directly, rendering community detection unnecessary. Starting from 5-minute time slices we uncover dynamic social structures expressed on multiple timescales. On the hourly timescale, we find that gatherings are fluid, with members coming and going, but organized via a stable core of individuals. Each core represents a social context. Cores exhibit a pattern of recurring meetings across weeks and months, each with varying degrees of regularity. Taken together, these findings provide a powerful simplification of the social network, where cores represent fundamental structures expressed with strong temporal and spatial regularity. Using this framework, we explore the complex interplay between social and geospatial behavior, documenting how the formation of cores are preceded by coordination behavior in the communication networks, and demonstrating that social behavior can be predicted with high precision.Comment: Main Manuscript: 16 pages, 4 figures. Supplementary Information: 39 pages, 34 figure

Increment entropy as a measure of complexity for time series

Entropy has been a common index to quantify the complexity of time series in a variety of fields. Here, we introduce increment entropy to measure the complexity of time series in which each increment is mapped into a word of two letters, one letter corresponding to direction and the other corresponding to magnitude. The Shannon entropy of the words is termed as increment entropy (IncrEn). Simulations on synthetic data and tests on epileptic EEG signals have demonstrated its ability of detecting the abrupt change, regardless of energetic (e.g. spikes or bursts) or structural changes. The computation of IncrEn does not make any assumption on time series and it can be applicable to arbitrary real-world data.Comment: 12pages,7figure,2 table

Sample entropy analysis of EEG signals via artificial neural networks to model patients' consciousness level based on anesthesiologists experience.

Electroencephalogram (EEG) signals, as it can express the human brain's activities and reflect awareness, have been widely used in many research and medical equipment to build a noninvasive monitoring index to the depth of anesthesia (DOA). Bispectral (BIS) index monitor is one of the famous and important indicators for anesthesiologists primarily using EEG signals when assessing the DOA. In this study, an attempt is made to build a new indicator using EEG signals to provide a more valuable reference to the DOA for clinical researchers. The EEG signals are collected from patients under anesthetic surgery which are filtered using multivariate empirical mode decomposition (MEMD) method and analyzed using sample entropy (SampEn) analysis. The calculated signals from SampEn are utilized to train an artificial neural network (ANN) model through using expert assessment of consciousness level (EACL) which is assessed by experienced anesthesiologists as the target to train, validate, and test the ANN. The results that are achieved using the proposed system are compared to BIS index. The proposed system results show that it is not only having similar characteristic to BIS index but also more close to experienced anesthesiologists which illustrates the consciousness level and reflects the DOA successfully.This research is supported by the Center forDynamical Biomarkers and Translational Medicine, National Central University, Taiwan, which is sponsored by Ministry of Science and Technology (Grant no. MOST103-2911-I-008-001). Also, it is supported by National Chung-Shan Institute of Science & Technology in Taiwan (Grant nos. CSIST-095-V301 and CSIST-095-V302)

Permutation entropy and irreversibility in gait kinematic time series from patients with mild cognitive decline and early alzheimer’s dementia

Gait is a basic cognitive purposeful action that has been shown to be altered in late stages of neurodegenerative dementias. Nevertheless, alterations are less clear in mild forms of dementia, and the potential use of gait analysis as a biomarker of initial cognitive decline has hitherto mostly been neglected. Herein, we report the results of a study of gait kinematic time series for two groups of patients (mild cognitive impairment and mild Alzheimer’s disease) and a group of matched control subjects. Two metrics based on permutation patterns are considered, respectively measuring the complexity and irreversibility of the time series. Results indicate that kinematic disorganisation is present in early phases of cognitive impairment; in addition, they depict a rich scenario, in which some joint movements display an increased complexity and irreversibility, while others a marked decrease. Beyond their potential use as biomarkers, complexity and irreversibility metrics can open a new door to the understanding of the role of the nervous system in gait, as well as its adaptation and compensatory mechanismsThis research was funded through the Premio del Ilustre Colegio Profesional de Fisioterapeutas de la Comunidad De Madrid, prize number ICPFM-IX-201

Uncovering the Correlation between COVID-19 and Neurodegenerative Processes: Toward a New Approach Based on EEG Entropic Analysis

COVID-19 is an ongoing global pandemic caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) virus. Although it primarily attacks the respiratory tract, inflammation can also affect the central nervous system (CNS), leading to chemo-sensory deficits such as anosmia and serious cognitive problems. Recent studies have shown a connection between COVID-19 and neurodegenerative diseases, particularly Alzheimer’s disease (AD). In fact, AD appears to exhibit neurological mechanisms of protein interactions similar to those that occur during COVID-19. Starting from these considerations, this perspective paper outlines a new approach based on the analysis of the complexity of brain signals to identify and quantify common features between COVID-19 and neurodegenerative disorders. Considering the relation between olfactory deficits, AD, and COVID-19, we present an experimental design involving olfactory tasks using multiscale fuzzy entropy (MFE) for electroencephalographic (EEG) signal analysis. Additionally, we present the open challenges and future perspectives. More specifically, the challenges are related to the lack of clinical standards regarding EEG signal entropy and public data that can be exploited in the experimental phase. Furthermore, the integration of EEG analysis with machine learning still requires further investigatio

Information theoretic measures and their applications

The concept of entropy, an ever-growing physical magnitude that measured the degree of decay of order in a physical system, was introduced by Rudolf Clausius in 1865 through an elegant formulation of the second law of thermodynamics. Seven years later, in 1872, Ludwig Boltzmann proved the famous H-theorem, showing that the quantity H always decreases in time, and in the case of perfect gas in equilibrium, the quantity H was related to Clausius’ entropyS. The dynamical approach of Boltzmann, together with the elegant theory of statistical ensembles at equilibrium proposed by Josiah Willard Gibbs, led to the Boltzmann–Gibbs theory of statistical mechanics, which represents one of the most successful theoretical frameworks of physics. In fact, with the introduction of entropy, thermodynamics became a model of theoretical science.Fil: Rosso, Osvaldo Anibal. Universidade Federal de Alagoas; Brasil. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Montani, Fernando Fabián. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - La Plata. Instituto de Física La Plata. Universidad Nacional de La Plata. Facultad de Ciencias Exactas. Instituto de Física La Plata; Argentin

Entrograms and coarse graining of dynamics on complex networks

Using an information theoretic point of view, we investigate how a dynamics acting on a network can be coarse grained through the use of graph partitions. Specifically, we are interested in how aggregating the state space of a Markov process according to a partition impacts on the thus obtained lower-dimensional dynamics. We highlight that for a dynamics on a particular graph there may be multiple coarse grained descriptions that capture different, incomparable features of the original process. For instance, a coarse graining induced by one partition may be commensurate with a time-scale separation in the dynamics, while another coarse graining may correspond to a different lower-dimensional dynamics that preserves the Markov property of the original process. Taking inspiration from the literature of Computational Mechanics, we find that a convenient tool to summarise and visualise such dynamical properties of a coarse grained model (partition) is the entrogram. The entrogram gathers certain information-theoretic measures, which quantify how information flows across time steps. These information theoretic quantities include the entropy rate, as well as a measure for the memory contained in the process, i.e., how well the dynamics can be approximated by a first order Markov process. We use the entrogram to investigate how specific macro-scale connection patterns in the state-space transition graph of the original dynamics result in desirable properties of coarse grained descriptions. We thereby provide a fresh perspective on the interplay between structure and dynamics in networks, and the process of partitioning from an information theoretic perspective. We focus on networks that may be approximated by both a core-periphery or a clustered organization, and highlight that each of these coarse grained descriptions can capture different aspects of a Markov process acting on the network.Comment: 17 pages, 6 figue