EEG-fMRI Based Information Theoretic Characterization of the Human Perceptual Decision System

The modern metaphor of the brain is that of a dynamic information processing device. In the current study we investigate how a core cognitive network of the human brain, the perceptual decision system, can be characterized regarding its spatiotemporal representation of task-relevant information. We capitalize on a recently developed information theoretic framework for the analysis of simultaneously acquired electroencephalography (EEG) and functional magnetic resonance imaging data (fMRI) (Ostwald et al. (2010), NeuroImage 49: 498–516). We show how this framework naturally extends from previous validations in the sensory to the cognitive domain and how it enables the economic description of neural spatiotemporal information encoding. Specifically, based on simultaneous EEG-fMRI data features from n = 13 observers performing a visual perceptual decision task, we demonstrate how the information theoretic framework is able to reproduce earlier findings on the neurobiological underpinnings of perceptual decisions from the response signal features' marginal distributions. Furthermore, using the joint EEG-fMRI feature distribution, we provide novel evidence for a highly distributed and dynamic encoding of task-relevant information in the human brain

Functional Source Separation for EEG-fMRI Fusion: Application to Steady-State Visual Evoked Potentials

Neurorobotics is one of the most ambitious fields in robotics, driving integration of interdisciplinary data and knowledge. One of the most productive areas of interdisciplinary research in this area has been the implementation of biologically-inspired mechanisms in the development of autonomous systems. Specifically, enabling such systems to display adaptive behavior such as learning from good and bad outcomes, has been achieved by quantifying and understanding the neural mechanisms of the brain networks mediating adaptive behaviors in humans and animals. For example, associative learning from aversive or dangerous outcomes is crucial for an autonomous system, to avoid dangerous situations in the future. A body of neuroscience research has suggested that the neurocomputations in the human brain during associative learning involve re-shaping of sensory responses. The nature of these adaptive changes in sensory processing during learning however are not yet well enough understood to be readily implemented into on-board algorithms for robotics application. Toward this overall goal, we record the simultaneous electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI), characterizing one candidate mechanism, i.e., large-scale brain oscillations. The present report examines the use of Functional Source Separation (FSS) as an optimization step in EEG-fMRI fusion that harnesses timing information to constrain the solutions that satisfy physiological assumptions. We applied this approach to the voxel-wise correlation of steady-state visual evoked potential (ssVEP) amplitude and blood oxygen level-dependent imaging (BOLD), across both time series. The results showed the benefit of FSS for the extraction of robust ssVEP signals during simultaneous EEG-fMRI recordings. Applied to data from a 3-phase aversive conditioning paradigm, the correlation maps across the three phases (habituation, acquisition, extinction) show converging results, notably major overlapping areas in both primary and extended visual cortical regions, including calcarine sulcus, lingual cortex, and cuneus. In addition, during the acquisition phase when aversive learning occurs, we observed additional correlations between ssVEP and BOLD in the anterior cingulate cortex (ACC) as well as the precuneus and superior temporal gyrus

Multimodal Functional Network Connectivity: An EEG-fMRI Fusion in Network Space

EEG and fMRI recordings measure the functional activity of multiple coherent networks distributed in the cerebral cortex. Identifying network interaction from the complementary neuroelectric and hemodynamic signals may help to explain the complex relationships between different brain regions. In this paper, multimodal functional network connectivity (mFNC) is proposed for the fusion of EEG and fMRI in network space. First, functional networks (FNs) are extracted using spatial independent component analysis (ICA) in each modality separately. Then the interactions among FNs in each modality are explored by Granger causality analysis (GCA). Finally, fMRI FNs are matched to EEG FNs in the spatial domain using network-based source imaging (NESOI). Investigations of both synthetic and real data demonstrate that mFNC has the potential to reveal the underlying neural networks of each modality separately and in their combination. With mFNC, comprehensive relationships among FNs might be unveiled for the deep exploration of neural activities and metabolic responses in a specific task or neurological state

Functional Source Separation for EEG-fMRI Fusion: Application to Steady-State Visual Evoked Potentials

Neurorobotics is one of the most ambitious fields in robotics, driving integration of interdisciplinary data and knowledge. One of the most productive areas of interdisciplinary research in this area has been the implementation of biologically-inspired mechanisms in the development of autonomous systems. Specifically, enabling such systems to display adaptive behavior such as learning from good and bad outcomes, has been achieved by quantifying and understanding the neural mechanisms of the brain networks mediating adaptive behaviors in humans and animals. For example, associative learning from aversive or dangerous outcomes is crucial for an autonomous system, to avoid dangerous situations in the future. A body of neuroscience research has suggested that the neurocomputations in the human brain during associative learning involve re-shaping of sensory responses. The nature of these adaptive changes in sensory processing during learning however are not yet well enough understood to be readily implemented into on-board algorithms for robotics application. Toward this overall goal, we record the simultaneous electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI), characterizing one candidate mechanism, i.e., large-scale brain oscillations. The present report examines the use of Functional Source Separation (FSS) as an optimization step in EEG-fMRI fusion that harnesses timing information to constrain the solutions that satisfy physiological assumptions. We applied this approach to the voxel-wise correlation of steady-state visual evoked potential (ssVEP) amplitude and blood oxygen level-dependent imaging (BOLD), across both time series. The results showed the benefit of FSS for the extraction of robust ssVEP signals during simultaneous EEG-fMRI recordings. Applied to data from a 3-phase aversive conditioning paradigm, the correlation maps across the three phases (habituation, acquisition, extinction) show converging results, notably major overlapping areas in both primary and extended visual cortical regions, including calcarine sulcus, lingual cortex, and cuneus. In addition, during the acquisition phase when aversive learning occurs, we observed additional correlations between ssVEP and BOLD in the anterior cingulate cortex (ACC) as well as the precuneus and superior temporal gyrus

It's about Time

The purpose of this review/opinion paper is to argue that human cognitive neuroscience has focused too little attention on how the brain may use time and time-based coding schemes to represent, process, and transfer information within and across brain regions. Instead, the majority of cognitive neuroscience studies rest on the assumption of functional localization. Although the functional localization approach has brought us a long way towards a basic characterization of brain functional organization, there are methodological and theoretical limitations of this approach. Further advances in our understanding of neurocognitive function may come from examining how the brain performs computations and forms transient functional neural networks using the rich multi-dimensional information available in time. This approach rests on the assumption that information is coded precisely in time but distributed in space; therefore, measures of rapid neuroelectrophysiological dynamics may provide insights into brain function that cannot be revealed using localization-based approaches and assumptions. Space is not an irrelevant dimension for brain organization; rather, a more complete understanding of how brain dynamics lead to behavior dynamics must incorporate how the brain uses time-based coding and processing schemes

Graph analysis of TMS–EEG connectivity reveals hemispheric differences following occipital stimulation

(1) Background: Transcranial magnetic stimulation combined with electroencephalography (TMS–EEG) provides a unique opportunity to investigate brain connectivity. However, possible hemispheric asymmetries in signal propagation dynamics following occipital TMS have not been investigated. (2) Methods: Eighteen healthy participants underwent occipital single-pulse TMS at two different EEG sites, corresponding to early visual areas. We used a state-of-the-art Bayesian estimation approach to accurately estimate TMS-evoked potentials (TEPs) from EEG data, which has not been previously used in this context. To capture the rapid dynamics of information flow patterns, we implemented a self-tuning optimized Kalman (STOK) filter in conjunction with the information partial directed coherence (iPDC) measure, enabling us to derive time-varying connectivity matrices. Subsequently, graph analysis was conducted to assess key network properties, providing insight into the overall network organization of the brain network. (3) Results: Our findings revealed distinct lateralized effects on effective brain connectivity and graph networks after TMS stimulation, with left stimulation facilitating enhanced communication between contralateral frontal regions and right stimulation promoting increased intra-hemispheric ipsilateral connectivity, as evidenced by statistical test (p < 0.001). (4) Conclusions: The identified hemispheric differences in terms of connectivity provide novel insights into brain networks involved in visual information processing, revealing the hemispheric specificity of neural responses to occipital stimulation

Network perspectives on epilepsy using EEG/MEG source connectivity

The evolution of EEG/MEG source connectivity is both, a promising, and controversial advance in the characterization of epileptic brain activity. In this narrative review we elucidate the potential of this technology to provide an intuitive view of the epileptic network at its origin, the different brain regions involved in the epilepsy, without the limitation of electrodes at the scalp level. Several studies have confirmed the added value of using source connectivity to localize the seizure onset zone and irritative zone or to quantify the propagation of epileptic activity over time. It has been shown in pilot studies that source connectivity has the potential to obtain prognostic correlates, to assist in the diagnosis of the epilepsy type even in the absence of visually noticeable epileptic activity in the EEG/MEG, and to predict treatment outcome. Nevertheless, prospective validation studies in large and heterogeneous patient cohorts are still lacking and are needed to bring these techniques into clinical use. Moreover, the methodological approach is challenging, with several poorly examined parameters that most likely impact the resulting network patterns. These fundamental challenges affect all potential applications of EEG/MEG source connectivity analysis, be it in a resting, spiking, or ictal state, and also its application to cognitive activation of the eloquent area in presurgical evaluation. However, such method can allow unique insights into physiological and pathological brain functions and have great potential in (clinical) neuroscience