Multimodal imaging of human brain activity: rational, biophysical aspects and modes of integration

Until relatively recently the vast majority of imaging and electrophysiological studies of human brain activity have relied on single-modality measurements usually correlated with readily observable or experimentally modified behavioural or brain state patterns. Multi-modal imaging is the concept of bringing together observations or measurements from different instruments. We discuss the aims of multi-modal imaging and the ways in which it can be accomplished using representative applications. Given the importance of haemodynamic and electrophysiological signals in current multi-modal imaging applications, we also review some of the basic physiology relevant to understanding their relationship

EEG in the classroom: Synchronised neural recordings during video presentation

We performed simultaneous recordings of electroencephalography (EEG) from multiple students in a classroom, and measured the inter-subject correlation (ISC) of activity evoked by a common video stimulus. The neural reliability, as quantified by ISC, has been linked to engagement and attentional modulation in earlier studies that used high-grade equipment in laboratory settings. Here we reproduce many of the results from these studies using portable low-cost equipment, focusing on the robustness of using ISC for subjects experiencing naturalistic stimuli. The present data shows that stimulus-evoked neural responses, known to be modulated by attention, can be tracked in for groups of students with synchronized EEG acquisition. This is a step towards real-time inference of engagement in the classroom.Comment: 14 pages, 5 figures, 3 tables. Preprint version. Revision of original preprint. Supplementary materials added as ancillary fil

The spatio-temporal mapping of epileptic networks: Combination of EEG–fMRI and EEG source imaging

Simultaneous EEG–fMRI acquisitions in patients with epilepsy often reveal distributed patterns of Blood Oxygen Level Dependant (BOLD) change correlated with epileptiform discharges. We investigated if electrical source imaging (ESI) performed on the interictal epileptiform discharges (IED) acquired during fMRI acquisition could be used to study the dynamics of the networks identified by the BOLD effect, thereby avoiding the limitations of combining results from separate recordings. Nine selected patients (13 IED types identified) with focal epilepsy underwent EEG–fMRI. Statistical analysis was performed using SPM5 to create BOLD maps. ESI was performed on the IED recorded during fMRI acquisition using a realistic head model (SMAC) and a distributed linear inverse solution (LAURA). ESI could not be performed in one case. In 10/12 remaining studies, ESI at IED onset (ESIo) was anatomically close to one BOLD cluster. Interestingly, ESIo was closest to the positive BOLD cluster with maximal statistical significance in only 4/12 cases and closest to negative BOLD responses in 4/12 cases. Very small BOLD clusters could also have clinical relevance in some cases. ESI at later time frame (ESIp) showed propagation to remote sources co-localised with other BOLD clusters in half of cases. In concordant cases, the distance between maxima of ESI and the closest EEG–fMRI cluster was less than 33 mm, in agreement with previous studies. We conclude that simultaneous ESI and EEG–fMRI analysis may be able to distinguish areas of BOLD response related to initiation of IED from propagation areas. This combination provides new opportunities for investigating epileptic networks

Aberrant activity in conceptual networks underlies N400 deficits and unusual thoughts in schizophrenia.

BackgroundThe N400 event-related potential (ERP) is triggered by meaningful stimuli that are incongruous, or unmatched, with their semantic context. Functional magnetic resonance imaging (fMRI) studies have identified brain regions activated by semantic incongruity, but their precise links to the N400 ERP are unclear. In schizophrenia (SZ), N400 amplitude reduction is thought to reflect overly broad associations in semantic networks, but the abnormalities in brain networks underlying deficient N400 remain unknown. We utilized joint independent component analysis (JICA) to link temporal patterns in ERPs to neuroanatomical patterns from fMRI and investigate relationships between N400 amplitude and neuroanatomical activation in SZ patients and healthy controls (HC).MethodsSZ patients (n = 24) and HC participants (n = 25) performed a picture-word matching task, in which words were either matched (APPLE→apple) by preceding pictures, or were unmatched by semantically related (in-category; IC, APPLE→lemon) or unrelated (out of category; OC, APPLE→cow) pictures, in separate ERP and fMRI sessions. A JICA "data fusion" analysis was conducted to identify the fMRI brain regions specifically associated with the ERP N400 component. SZ and HC loading weights were compared and correlations with clinical symptoms were assessed.ResultsJICA identified an ERP-fMRI "fused" component that captured the N400, with loading weights that were reduced in SZ. The JICA map for the IC condition showed peaks of activation in the cingulate, precuneus, bilateral temporal poles and cerebellum, whereas the JICA map from the OC condition was linked primarily to visual cortical activation and the left temporal pole. Among SZ patients, fMRI activity from the IC condition was inversely correlated with unusual thought content.ConclusionsThe neural networks associated with the N400 ERP response to semantic violations depends on conceptual relatedness. These findings are consistent with a distributed network underlying neural responses to semantic incongruity including unimodal visual areas as well as integrative, transmodal areas. Unusual thoughts in SZ may reflect impaired processing in transmodal hub regions such as the precuneus, leading to overly broad semantic associations

Characterization of Neuroimage Coupling Between EEG and FMRI Using Within-Subject Joint Independent Component Analysis

The purpose of this dissertation was to apply joint independent component analysis (jICA) to electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) to characterize the neuroimage coupling between the two modalities. EEG and fMRI are complimentary imaging techniques which have been used in conjunction to investigate neural activity. Understanding how these two imaging modalities relate to each other not only enables better multimodal analysis, but also has clinical implications as well. In particular, Alzheimer’s, Parkinson’s, hypertension, and ischemic stroke are all known to impact the cerebral blood flow, and by extension alter the relationship between EEG and fMRI. By characterizing the relationship between EEG and fMRI within healthy subjects, it allows for comparison with a diseased population, and may offer ways to detect some of these conditions earlier. The correspondence between fMRI and EEG was first examined, and a methodological approach which was capable of informing to what degree the fMRI and EEG sources corresponded to each other was developed. Once it was certain that the EEG activity observed corresponded to the fMRI activity collected a methodological approach was developed to characterize the coupling between fMRI and EEG. Finally, this dissertation addresses the question of whether the use of jICA to perform this analysis increases the sensitivity to subcortical sources to determine to what degree subcortical sources should be taken into consideration for future studies. This dissertation was the first to propose a way to characterize the relationship between fMRI and EEG signals using blind source separation. Additionally, it was the first to show that jICA significantly improves the detection of subcortical activity, particularly in the case when both physiological noise and a cortical source are present. This new knowledge can be used to design studies to investigate subcortical signals, as well as to begin characterizing the relationship between fMRI and EEG across various task conditions

Simultaneous EEG-fMRI Analysis with Application to Detection of Seizure Signal Sources

Non