On directed information theory and Granger causality graphs

Directed information theory deals with communication channels with feedback. When applied to networks, a natural extension based on causal conditioning is needed. We show here that measures built from directed information theory in networks can be used to assess Granger causality graphs of stochastic processes. We show that directed information theory includes measures such as the transfer entropy, and that it is the adequate information theoretic framework needed for neuroscience applications, such as connectivity inference problems.Comment: accepted for publications, Journal of Computational Neuroscienc

Mapping the epileptic brain with EEG dynamical connectivity: established methods and novel approaches

Several algorithms rooted in statistical physics, mathematics and machine learning are used to analyze neuroimaging data from patients suffering from epilepsy, with the main goals of localizing the brain region where the seizure originates from and of detecting upcoming seizure activity in order to trigger therapeutic neurostimulation devices. Some of these methods explore the dynamical connections between brain regions, exploiting the high temporal resolution of the electroencephalographic signals recorded at the scalp or directly from the cortical surface or in deeper brain areas. In this paper we describe this specific class of algorithms and their clinical application, by reviewing the state of the art and reporting their application on EEG data from an epileptic patient

Critical comments on EEG sensor space dynamical connectivity analysis

Many different analysis techniques have been developed and applied to EEG recordings that allow one to investigate how different brain areas interact. One particular class of methods, based on the linear parametric representation of multiple interacting time series, is widely used to study causal connectivity in the brain. However, the results obtained by these methods should be interpreted with great care. The goal of this paper is to show, both theoretically and using simulations, that results obtained by applying causal connectivity measures on the sensor (scalp) time series do not allow interpretation in terms of interacting brain sources. This is because 1) the channel locations cannot be seen as an approximation of a source's anatomical location and 2) spurious connectivity can occur between sensors. Although many measures of causal connectivity derived from EEG sensor time series are affected by the latter, here we will focus on the well-known time domain index of Granger causality (GC) and on the frequency domain directed transfer function (DTF). Using the state-space framework and designing two simulation studies we show that mixing effects caused by volume conduction can lead to spurious connections, detected either by time domain GC or by DTF. Therefore, GC/DTF causal connectivity measures should be computed at the source level, or derived within analysis frameworks that model the effects of volume conduction. Since mixing effects can also occur in the source space, it is advised to combine source space analysis with connectivity measures that are robust to mixing

Critical comments on EEG sensor space dynamical connectivity analysis

any different analysis techniques have been developed and applied to EEG recordings that allow one to investigate how different brain areas interact. One particular class of methods, based on the linear parametric representation of multiple interacting time series, is widely used to study causal connectivity in the brain. However, the results obtained by these methods should be interpreted with great care. The goal of this paper is to show, both theoretically and using simulations, that results obtained by applying causal connectivity measures on the sensor (scalp) time series do not allow interpretation in terms of interacting brain sources. This is because (1) the channel locations cannot be seen as an approximation of a source's anatomical location and (2) spurious connectivity can occur between sensors. Although many measures of causal connectivity derived from EEG sensor time series are affected by the latter, here we will focus on the well-known time domain index of Granger causality (GC) and on the frequency domain directed transfer function (DTF). Using the state-space framework and designing two simulation studies we show that mixing effects caused by volume conduction can lead to spurious connections, detected either by time domain GC or by DTF. Therefore, GC/DTF causal connectivity measures should be computed at the source level, or derived within analysis frameworks that model the effects of volume conduction. Since mixing effects can also occur in the source space, it is advised to combine source space analysis with connectivity measures that are robust to mixing

Extending Transfer Entropy Improves Identification of Effective Connectivity in a Spiking Cortical Network Model

Transfer entropy (TE) is an information-theoretic measure which has received recent attention in neuroscience for its potential to identify effective connectivity between neurons. Calculating TE for large ensembles of spiking neurons is computationally intensive, and has caused most investigators to probe neural interactions at only a single time delay and at a message length of only a single time bin. This is problematic, as synaptic delays between cortical neurons, for example, range from one to tens of milliseconds. In addition, neurons produce bursts of spikes spanning multiple time bins. To address these issues, here we introduce a free software package that allows TE to be measured at multiple delays and message lengths. To assess performance, we applied these extensions of TE to a spiking cortical network model (Izhikevich, 2006) with known connectivity and a range of synaptic delays. For comparison, we also investigated single-delay TE, at a message length of one bin (D1TE), and cross-correlation (CC) methods. We found that D1TE could identify 36% of true connections when evaluated at a false positive rate of 1%. For extended versions of TE, this dramatically improved to 73% of true connections. In addition, the connections correctly identified by extended versions of TE accounted for 85% of the total synaptic weight in the network. Cross correlation methods generally performed more poorly than extended TE, but were useful when data length was short. A computational performance analysis demonstrated that the algorithm for extended TE, when used on currently available desktop computers, could extract effective connectivity from 1 hr recordings containing 200 neurons in ∼5 min. We conclude that extending TE to multiple delays and message lengths improves its ability to assess effective connectivity between spiking neurons. These extensions to TE soon could become practical tools for experimentalists who record hundreds of spiking neurons

Multivariate Frequency Domain Analysis of Causal Interactions in Physiological Time Series

The mission of this chapter is to enhance the theoretical interpretability of the available frequency domain measures of coupling and causality derived from the MVAR representation of multiple time series