Multimodal imaging of human brain activity: rational, biophysical aspects and modes of integration

Until relatively recently the vast majority of imaging and electrophysiological studies of human brain activity have relied on single-modality measurements usually correlated with readily observable or experimentally modified behavioural or brain state patterns. Multi-modal imaging is the concept of bringing together observations or measurements from different instruments. We discuss the aims of multi-modal imaging and the ways in which it can be accomplished using representative applications. Given the importance of haemodynamic and electrophysiological signals in current multi-modal imaging applications, we also review some of the basic physiology relevant to understanding their relationship

Top-down effects on early visual processing in humans: a predictive coding framework

An increasing number of human electroencephalography (EEG) studies examining the earliest component of the visual evoked potential, the so-called C1, have cast doubts on the previously prevalent notion that this component is impermeable to top-down effects. This article reviews the original studies that (i) described the C1, (ii) linked it to primary visual cortex (V1) activity, and (iii) suggested that its electrophysiological characteristics are exclusively determined by low-level stimulus attributes, particularly the spatial position of the stimulus within the visual field. We then describe conflicting evidence from animal studies and human neuroimaging experiments and provide an overview of recent EEG and magnetoencephalography (MEG) work showing that initial V1 activity in humans may be strongly modulated by higher-level cognitive factors. Finally, we formulate a theoretical framework for understanding top-down effects on early visual processing in terms of predictive coding

Contact heat evoked potentials using simultaneous EEG and fMRI and their correlation with evoked pain

BACKGROUND: The Contact Heat Evoked Potential Stimulator (CHEPS) utilises rapidly delivered heat pulses with adjustable peak temperatures to stimulate the differential warm/heat thresholds of receptors expressed by Adelta and C fibres. The resulting evoked potentials can be recorded and measured, providing a useful clinical tool for the study of thermal and nociceptive pathways. Concurrent recording of contact heat evoked potentials using electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI) has not previously been reported with CHEPS. Developing simultaneous EEG and fMRI with CHEPS is highly desirable, as it provides an opportunity to exploit the high temporal resolution of EEG and the high spatial resolution of fMRI to study the reaction of the human brain to thermal and nociceptive stimuli. METHODS: In this study we have recorded evoked potentials stimulated by 51° C contact heat pulses from CHEPS using EEG, under normal conditions (baseline), and during continuous and simultaneous acquisition of fMRI images in ten healthy volunteers, during two sessions. The pain evoked by CHEPS was recorded on a Visual Analogue Scale (VAS). RESULTS: Analysis of EEG data revealed that the latencies and amplitudes of evoked potentials recorded during continuous fMRI did not differ significantly from baseline recordings. fMRI results were consistent with previous thermal pain studies, and showed Blood Oxygen Level Dependent (BOLD) changes in the insula, post-central gyrus, supplementary motor area (SMA), middle cingulate cortex and pre-central gyrus. There was a significant positive correlation between the evoked potential amplitude (EEG) and the psychophysical perception of pain on the VAS. CONCLUSION: The results of this study demonstrate the feasibility of recording contact heat evoked potentials with EEG during continuous and simultaneous fMRI. The combined use of the two methods can lead to identification of distinct patterns of brain activity indicative of pain and pro-nociceptive sensitisation in healthy subjects and chronic pain patients. Further studies are required for the technique to progress as a useful tool in clinical trials of novel analgesics

Acoustic Oddball during NREM Sleep: A Combined EEG/fMRI Study

Background: A condition vital for the consolidation and maintenance of sleep is generally reduced responsiveness to external stimuli. Despite this, the sleeper maintains a level of stimulus processing that allows to respond to potentially dangerous environmental signals. The mechanisms that subserve these contradictory functions are only incompletely understood. Methodology/Principal Findings: Using combined EEG/fMRI we investigated the neural substrate of sleep protection by applying an acoustic oddball paradigm during light NREM sleep. Further, we studied the role of evoked K-complexes (KCs), an electroencephalographic hallmark of NREM sleep with a still unknown role for sleep protection. Our main results were: (1) Other than in wakefulness, rare tones did not induce a blood oxygenation level dependent (BOLD) signal increase in the auditory pathway but a strong negative BOLD response in motor areas and the amygdala. (2) Stratification of rare tones by the presence of evoked KCs detected activation of the auditory cortex, hippocampus, superior and middle frontal gyri and posterior cingulate only for rare tones followed by a KC. (3) The typical high frontocentral EEG deflections of KCs were not paralleled by a BOLD equivalent. Conclusions/Significance: We observed that rare tones lead to transient disengagement of motor and amygdala responses during light NREM sleep. We interpret this as a sleep protective mechanism to delimit motor responses and to reduce the sensitivity of the amygdala towards further incoming stimuli. Evoked KCs are suggested to originate from a brain state wit

When Is Simultaneous Recording Necessary? A Guide for Researchers Considering Combined EEG-fMRI.

Electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) provide non-invasive measures of brain activity at varying spatial and temporal scales, offering different views on brain function for both clinical and experimental applications. Simultaneous recording of these measures attempts to maximize the respective strengths of each method, while compensating for their weaknesses. However, combined recording is not necessary to address all research questions of interest, and experiments may have greater statistical power to detect effects by maximizing the signal-to-noise ratio in separate recording sessions. While several existing papers discuss the reasons for or against combined recording, this article aims to synthesize these arguments into a flow chart of questions that researchers can consider when deciding whether to record EEG and fMRI separately or simultaneously. Given the potential advantages of simultaneous EEG-fMRI, the aim is to provide an initial overview of the most important concepts and to direct readers to relevant literature that will aid them in this decision

Within-Subject Joint Independent Component Analysis of Simultaneous fMRI/ERP in an Auditory Oddball Paradigm

The integration of event-related potential (ERP) and functional magnetic resonance imaging (fMRI) can contribute to characterizing neural networks with high temporal and spatial resolution. This research aimed to determine the sensitivity and limitations of applying joint independent component analysis (jICA) within-subjects, for ERP and fMRI data collected simultaneously in a parametric auditory frequency oddball paradigm. In a group of 20 subjects, an increase in ERP peak amplitude ranging 1–8 μV in the time window of the P300 (350–700 ms), and a correlated increase in fMRI signal in a network of regions including the right superior temporal and supramarginal gyri, was observed with the increase in deviant frequency difference. JICA of the same ERP and fMRI group data revealed activity in a similar network, albeit with stronger amplitude and larger extent. In addition, activity in the left pre- and post-central gyri, likely associated with right hand somato-motor response, was observed only with the jICA approach. Within-subject, the jICA approach revealed significantly stronger and more extensive activity in the brain regions associated with the auditory P300 than the P300 linear regression analysis. The results suggest that with the incorporation of spatial and temporal information from both imaging modalities, jICA may be a more sensitive method for extracting common sources of activity between ERP and fMRI

Spatiotemporal dynamics of single-letter reading: a combined ERP-FMRI study

This work investigates the neural correlates of single-letter reading by combining event-related potentials (ERPs) and functional magnetic resonance imaging (fMRI), thus exploiting their complementary spatiotemporal resolutions. Three externally-paced reading tasks were administered with an event-related design: passive observation of letters and symbols and active reading aloud of letters. ERP and fMRI data were separately recorded from 8 healthy adults during the same experimental conditions. Due to the presence of artifacts in the EEG signals, two subjects were discarded from further analysis. Independent Component Analysis was applied to ERPs, after dimensionality reduction by Principal Component Analysis: some independent components were clearly related to specific reading functions and the associated current density distributions in the brain were estimated with Low Resolution Electromagnetic Tomography Analysis method (LORETA). The impulse hemodynamic response function was modeled as a linear combination of linear B-spline functions and fMRI statistical analysis was performed by multiple linear regression. fMRI and LORETA maps were superimposed in order to identify the overlapping activations and the activated regions specifically revealed by each modality. The results showed the existence of neuronal networks functionally specific for letter processing and for explicit verbal-motor articulation, including the temporo-parietal and frontal regions. Overlap between fMRI and LORETA results was observed in the inferior temporal-middle occipital gyrus, suggesting that this area has a crucial and multifunctional role for linguistic and reading processes, likely because its spatial location and strong interconnection with the main visual and auditory sensory systems may have favored its specialization in grapheme-phoneme matching