Bits from Biology for Computational Intelligence

Computational intelligence is broadly defined as biologically-inspired computing. Usually, inspiration is drawn from neural systems. This article shows how to analyze neural systems using information theory to obtain constraints that help identify the algorithms run by such systems and the information they represent. Algorithms and representations identified information-theoretically may then guide the design of biologically inspired computing systems (BICS). The material covered includes the necessary introduction to information theory and the estimation of information theoretic quantities from neural data. We then show how to analyze the information encoded in a system about its environment, and also discuss recent methodological developments on the question of how much information each agent carries about the environment either uniquely, or redundantly or synergistically together with others. Last, we introduce the framework of local information dynamics, where information processing is decomposed into component processes of information storage, transfer, and modification -- locally in space and time. We close by discussing example applications of these measures to neural data and other complex systems

Multivariate Granger Causality and Generalized Variance

Granger causality analysis is a popular method for inference on directed interactions in complex systems of many variables. A shortcoming of the standard framework for Granger causality is that it only allows for examination of interactions between single (univariate) variables within a system, perhaps conditioned on other variables. However, interactions do not necessarily take place between single variables, but may occur among groups, or "ensembles", of variables. In this study we establish a principled framework for Granger causality in the context of causal interactions among two or more multivariate sets of variables. Building on Geweke's seminal 1982 work, we offer new justifications for one particular form of multivariate Granger causality based on the generalized variances of residual errors. Taken together, our results support a comprehensive and theoretically consistent extension of Granger causality to the multivariate case. Treated individually, they highlight several specific advantages of the generalized variance measure, which we illustrate using applications in neuroscience as an example. We further show how the measure can be used to define "partial" Granger causality in the multivariate context and we also motivate reformulations of "causal density" and "Granger autonomy". Our results are directly applicable to experimental data and promise to reveal new types of functional relations in complex systems, neural and otherwise.Comment: added 1 reference, minor change to discussion, typos corrected; 28 pages, 3 figures, 1 table, LaTe

Dynamic imaging of coherent sources reveals different network connectivity underlying the generation and perpetuation of epileptic seizures

The concept of focal epilepsies includes a seizure origin in brain regions with hyper synchronous activity (epileptogenic zone and seizure onset zone) and a complex epileptic network of different brain areas involved in the generation, propagation, and modulation of seizures. The purpose of this work was to study functional and effective connectivity between regions involved in networks of epileptic seizures. The beginning and middle part of focal seizures from ictal surface EEG data were analyzed using dynamic imaging of coherent sources (DICS), an inverse solution in the frequency domain which describes neuronal networks and coherences of oscillatory brain activities. The information flow (effective connectivity) between coherent sources was investigated using the renormalized partial directed coherence (RPDC) method. In 8/11 patients, the first and second source of epileptic activity as found by DICS were concordant with the operative resection site; these patients became seizure free after epilepsy surgery. In the remaining 3 patients, the results of DICS / RPDC calculations and the resection site were discordant; these patients had a poorer post-operative outcome. The first sources as found by DICS were located predominantly in cortical structures; subsequent sources included some subcortical structures: thalamus, Nucl. Subthalamicus and cerebellum. DICS seems to be a powerful tool to define the seizure onset zone and the epileptic networks involved. Seizure generation seems to be related to the propagation of epileptic activity from the primary source in the seizure onset zone, and maintenance of seizures is attributed to the perpetuation of epileptic activity between nodes in the epileptic network. Despite of these promising results, this proof of principle study needs further confirmation prior to the use of the described methods in the clinical praxis

Graph analysis of functional brain networks: practical issues in translational neuroscience

The brain can be regarded as a network: a connected system where nodes, or units, represent different specialized regions and links, or connections, represent communication pathways. From a functional perspective communication is coded by temporal dependence between the activities of different brain areas. In the last decade, the abstract representation of the brain as a graph has allowed to visualize functional brain networks and describe their non-trivial topological properties in a compact and objective way. Nowadays, the use of graph analysis in translational neuroscience has become essential to quantify brain dysfunctions in terms of aberrant reconfiguration of functional brain networks. Despite its evident impact, graph analysis of functional brain networks is not a simple toolbox that can be blindly applied to brain signals. On the one hand, it requires a know-how of all the methodological steps of the processing pipeline that manipulates the input brain signals and extract the functional network properties. On the other hand, a knowledge of the neural phenomenon under study is required to perform physiological-relevant analysis. The aim of this review is to provide practical indications to make sense of brain network analysis and contrast counterproductive attitudes

Macaque's Cortical Functional Connectivity Dynamics at the Onset of Propofol-Induced Anesthesia

Propofol, when administered for general anesthesia, induces oscillatory dynamic brain states that are thought to underlie the drug's pharmacological effects. Despite the elucidation of propofol's mechanisms of action at the molecular level, its effects on neural circuits and overall cortical functioning, which eventually lead to unconsciousness, are still unclear. To identify possible mechanisms, the spatial-temporal patterns of functional connectivity established among specialized cortical areas in anesthetized subjects need to be described. Within this context, the present research involved the analysis of dense sub-dural ECoG electrode array recordings from macaques under propofol anesthetic induction. Granger causality methodology was used to infer functional connectivity interactions in five physiological frequency bands serially over time, every five seconds throughout the experiment. The time-resolved networks obtained permitted us to observe the unfolding of the anesthetic induction and compare the networks obtained under different experimental conditions. About one minute after administering propofol, functional connectivity started to increase for 4-5 minutes, then decreased until the LOC was achieved. A predominant Granger causality flow from the occipital and temporal areas towards the frontal and parietal regions was also evidenced during the transition. During general anesthesia, the local connectivity of the occipital lobe increased, as did the interactions between the occipital and temporal lobes. Conversely, the functional connectivity from the frontal and parietal lobes toward the temporal and occipital regions was mainly impaired. The research is one of the first studies to describe the dynamics of the functional connectivity during the transitional state that precedes the LOC.Comment: 20 pages, 5 figure

Assessing the strength of directed influences among neural signals : An approach to noisy data

Acknowledgements This work was supported by the German Science Foundation (Ti315/4-2), the German Federal Ministry of Education and Research (BMBF grant 01GQ0420), and the Excellence Initiative of the German Federal and State Governments. B.S. is indebted to the Kosterlitz Centre for the financial support of this research project.Peer reviewedPreprin