Causal conditioning and instantaneous coupling in causality graphs

The paper investigates the link between Granger causality graphs recently formalized by Eichler and directed information theory developed by Massey and Kramer. We particularly insist on the implication of two notions of causality that may occur in physical systems. It is well accepted that dynamical causality is assessed by the conditional transfer entropy, a measure appearing naturally as a part of directed information. Surprisingly the notion of instantaneous causality is often overlooked, even if it was clearly understood in early works. In the bivariate case, instantaneous coupling is measured adequately by the instantaneous information exchange, a measure that supplements the transfer entropy in the decomposition of directed information. In this paper, the focus is put on the multivariate case and conditional graph modeling issues. In this framework, we show that the decomposition of directed information into the sum of transfer entropy and information exchange does not hold anymore. Nevertheless, the discussion allows to put forward the two measures as pillars for the inference of causality graphs. We illustrate this on two synthetic examples which allow us to discuss not only the theoretical concepts, but also the practical estimation issues.Comment: submitte

Identifying phase synchronization clusters in spatially extended dynamical systems

We investigate two recently proposed multivariate time series analysis techniques that aim at detecting phase synchronization clusters in spatially extended, nonstationary systems with regard to field applications. The starting point of both techniques is a matrix whose entries are the mean phase coherence values measured between pairs of time series. The first method is a mean field approach which allows to define the strength of participation of a subsystem in a single synchronization cluster. The second method is based on an eigenvalue decomposition from which a participation index is derived that characterizes the degree of involvement of a subsystem within multiple synchronization clusters. Simulating multiple clusters within a lattice of coupled Lorenz oscillators we explore the limitations and pitfalls of both methods and demonstrate (a) that the mean field approach is relatively robust even in configurations where the single cluster assumption is not entirely fulfilled, and (b) that the eigenvalue decomposition approach correctly identifies the simulated clusters even for low coupling strengths. Using the eigenvalue decomposition approach we studied spatiotemporal synchronization clusters in long-lasting multichannel EEG recordings from epilepsy patients and obtained results that fully confirm findings from well established neurophysiological examination techniques. Multivariate time series analysis methods such as synchronization cluster analysis that account for nonlinearities in the data are expected to provide complementary information which allows to gain deeper insights into the collective dynamics of spatially extended complex systems

From brain to earth and climate systems: Small-world interaction networks or not?

We consider recent reports on small-world topologies of interaction networks derived from the dynamics of spatially extended systems that are investigated in diverse scientific fields such as neurosciences, geophysics, or meteorology. With numerical simulations that mimic typical experimental situations we have identified an important constraint when characterizing such networks: indications of a small-world topology can be expected solely due to the spatial sampling of the system along with commonly used time series analysis based approaches to network characterization

Causal connectivity of evolved neural networks during behavior

To show how causal interactions in neural dynamics are modulated by behavior, it is valuable to analyze these interactions without perturbing or lesioning the neural mechanism. This paper proposes a method, based on a graph-theoretic extension of vector autoregressive modeling and 'Granger causality,' for characterizing causal interactions generated within intact neural mechanisms. This method, called 'causal connectivity analysis' is illustrated via model neural networks optimized for controlling target fixation in a simulated head-eye system, in which the structure of the environment can be experimentally varied. Causal connectivity analysis of this model yields novel insights into neural mechanisms underlying sensorimotor coordination. In contrast to networks supporting comparatively simple behavior, networks supporting rich adaptive behavior show a higher density of causal interactions, as well as a stronger causal flow from sensory inputs to motor outputs. They also show different arrangements of 'causal sources' and 'causal sinks': nodes that differentially affect, or are affected by, the remainder of the network. Finally, analysis of causal connectivity can predict the functional consequences of network lesions. These results suggest that causal connectivity analysis may have useful applications in the analysis of neural dynamics

Multivariate Granger Causality and Generalized Variance

Granger causality analysis is a popular method for inference on directed interactions in complex systems of many variables. A shortcoming of the standard framework for Granger causality is that it only allows for examination of interactions between single (univariate) variables within a system, perhaps conditioned on other variables. However, interactions do not necessarily take place between single variables, but may occur among groups, or "ensembles", of variables. In this study we establish a principled framework for Granger causality in the context of causal interactions among two or more multivariate sets of variables. Building on Geweke's seminal 1982 work, we offer new justifications for one particular form of multivariate Granger causality based on the generalized variances of residual errors. Taken together, our results support a comprehensive and theoretically consistent extension of Granger causality to the multivariate case. Treated individually, they highlight several specific advantages of the generalized variance measure, which we illustrate using applications in neuroscience as an example. We further show how the measure can be used to define "partial" Granger causality in the multivariate context and we also motivate reformulations of "causal density" and "Granger autonomy". Our results are directly applicable to experimental data and promise to reveal new types of functional relations in complex systems, neural and otherwise.Comment: added 1 reference, minor change to discussion, typos corrected; 28 pages, 3 figures, 1 table, LaTe

Weak convergence of marked point processes generated by crossings of multivariate jump processes. Applications to neural network modeling

We consider the multivariate point process determined by the crossing times of the components of a multivariate jump process through a multivariate boundary, assuming to reset each component to an initial value after its boundary crossing. We prove that this point process converges weakly to the point process determined by the crossing times of the limit process. This holds for both diffusion and deterministic limit processes. The almost sure convergence of the first passage times under the almost sure convergence of the processes is also proved. The particular case of a multivariate Stein process converging to a multivariate Ornstein-Uhlenbeck process is discussed as a guideline for applying diffusion limits for jump processes. We apply our theoretical findings to neural network modeling. The proposed model gives a mathematical foundation to the generalization of the class of Leaky Integrate-and-Fire models for single neural dynamics to the case of a firing network of neurons. This will help future study of dependent spike trains.Comment: 20 pages, 1 figur