Within-Subject Joint Independent Component Analysis of Simultaneous fMRI/ERP in an Auditory Oddball Paradigm

The integration of event-related potential (ERP) and functional magnetic resonance imaging (fMRI) can contribute to characterizing neural networks with high temporal and spatial resolution. This research aimed to determine the sensitivity and limitations of applying joint independent component analysis (jICA) within-subjects, for ERP and fMRI data collected simultaneously in a parametric auditory frequency oddball paradigm. In a group of 20 subjects, an increase in ERP peak amplitude ranging 1–8 μV in the time window of the P300 (350–700 ms), and a correlated increase in fMRI signal in a network of regions including the right superior temporal and supramarginal gyri, was observed with the increase in deviant frequency difference. JICA of the same ERP and fMRI group data revealed activity in a similar network, albeit with stronger amplitude and larger extent. In addition, activity in the left pre- and post-central gyri, likely associated with right hand somato-motor response, was observed only with the jICA approach. Within-subject, the jICA approach revealed significantly stronger and more extensive activity in the brain regions associated with the auditory P300 than the P300 linear regression analysis. The results suggest that with the incorporation of spatial and temporal information from both imaging modalities, jICA may be a more sensitive method for extracting common sources of activity between ERP and fMRI

Neural Dynamics of Phonological Processing in the Dorsal Auditory Stream

Neuroanatomical models hypothesize a role for the dorsal auditory pathway in phonological processing as a feedforward efferent system (Davis and Johnsrude, 2007; Rauschecker and Scott, 2009; Hickok et al., 2011). But the functional organization of the pathway, in terms of time course of interactions between auditory, somatosensory, and motor regions, and the hemispheric lateralization pattern is largely unknown. Here, ambiguous duplex syllables, with elements presented dichotically at varying interaural asynchronies, were used to parametrically modulate phonological processing and associated neural activity in the human dorsal auditory stream. Subjects performed syllable and chirp identification tasks, while event-related potentials and functional magnetic resonance images were concurrently collected. Joint independent component analysis was applied to fuse the neuroimaging data and study the neural dynamics of brain regions involved in phonological processing with high spatiotemporal resolution. Results revealed a highly interactive neural network associated with phonological processing, composed of functional fields in posterior temporal gyrus (pSTG), inferior parietal lobule (IPL), and ventral central sulcus (vCS) that were engaged early and almost simultaneously (at 80–100 ms), consistent with a direct influence of articulatory somatomotor areas on phonemic perception. Left hemispheric lateralization was observed 250 ms earlier in IPL and vCS than pSTG, suggesting that functional specialization of somatomotor (and not auditory) areas determined lateralization in the dorsal auditory pathway. The temporal dynamics of the dorsal auditory pathway described here offer a new understanding of its functional organization and demonstrate that temporal information is essential to resolve neural circuits underlying complex behaviors

Neural pathways for visual speech perception

This paper examines the questions, what levels of speech can be perceived visually, and how is visual speech represented by the brain? Review of the literature leads to the conclusions that every level of psycholinguistic speech structure (i.e., phonetic features, phonemes, syllables, words, and prosody) can be perceived visually, although individuals differ in their abilities to do so; and that there are visual modality-specific representations of speech qua speech in higher-level vision brain areas. That is, the visual system represents the modal patterns of visual speech. The suggestion that the auditory speech pathway receives and represents visual speech is examined in light of neuroimaging evidence on the auditory speech pathways. We outline the generally agreed-upon organization of the visual ventral and dorsal pathways and examine several types of visual processing that might be related to speech through those pathways, specifically, face and body, orthography, and sign language processing. In this context, we examine the visual speech processing literature, which reveals widespread diverse patterns activity in posterior temporal cortices in response to visual speech stimuli. We outline a model of the visual and auditory speech pathways and make several suggestions: (1) The visual perception of speech relies on visual pathway representations of speech qua speech. (2) A proposed site of these representations, the temporal visual speech area (TVSA) has been demonstrated in posterior temporal cortex, ventral and posterior to multisensory posterior superior temporal sulcus (pSTS). (3) Given that visual speech has dynamic and configural features, its representations in feedforward visual pathways are expected to integrate these features, possibly in TVSA

Differential rates of perinatal maturation of human primary and nonprimary auditory cortex

Abstract Primary and nonprimary cerebral cortex mature along different timescales; however, the differences between the rates of maturation of primary and nonprimary cortex are unclear. Cortical maturation can be measured through changes in tissue microstructure detectable by diffusion magnetic resonance imaging (MRI). In this study, diffusion tensor imaging (DTI) was used to characterize the maturation of Heschl’s gyrus (HG), which contains both primary auditory cortex (pAC) and nonprimary auditory cortex (nAC), in 90 preterm infants between 26 and 42 weeks postmenstrual age (PMA). The preterm infants were in different acoustical environments during their hospitalization: 46 in open ward beds and 44 in single rooms. A control group consisted of 15 term-born infants. Diffusion parameters revealed that (1) changes in cortical microstructure that accompany cortical maturation had largely already occurred in pAC by 28 weeks PMA, and (2) rapid changes were taking place in nAC between 26 and 42 weeks PMA. At term equivalent PMA, diffusion parameters for auditory cortex were different between preterm infants and term control infants, reflecting either delayed maturation or injury. No effect of room type was observed. For the preterm group, disturbed maturation of nonprimary (but not primary) auditory cortex was associated with poorer language performance at age two years

Detection of experimental ERP effects in combined EEG-fMRI: evaluating the benefits of interleaved acquisition and Independent Component Analysis

Copyright © 2011 Elsevier. NOTICE: this is the author’s version of a work that was accepted for publication in Clinical Neurophysiology . Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Clinical Neurophysiology, 2011 Vol. 122 Issue 2, pp. 267-77 DOI: http://dx.doi.org/10.1016/j.clinph.2010.06.033Objective The present study examined the benefit of rapid alternation of EEG and fMRI (a common strategy for avoiding artifact caused by rapid switching of MRI gradients) for detecting experimental modulations of ERPs in combined EEG–fMRI. The study also assessed the advantages of aiding the extraction of specific ERP components by means of signal decomposition using Independent Component Analysis (ICA). Methods ‘Go–nogo’ task stimuli were presented either during fMRI scanning or in the gaps between fMRI scans, resulting in ‘gradient’ and ‘no-gradient’ ERPs. ‘Go–nogo’ differences in the N2 and P3 components were subjected to conventional ERP analysis, as well as single-trial and reliability analyses. Results Comparable N2 and P3 enhancement on ‘nogo’ trials was found in the ‘gradient’ and ‘no-gradient’ ERPs. ICA-based signal decomposition resulted in better validity (as indicated by topography), greater stability and lower measurement error of the predicted ERP effects. Conclusions While there was little or no benefit of acquiring ERPs in the gaps between fMRI scans, ICA decomposition did improve the detection of experimental ERP modulations. Significance Simultaneous and continuous EEG–fMRI acquisition is preferable to interleaved protocols. ICA-based decomposition is useful not only for artifact cancellation, but also for the extraction of specific ERP components

The orientation dependence of cavity-modified chemistry

Recent theoretical studies have explored how ultra-strong light--matter coupling can be used as a handle to control chemical transformations. {\em Ab initio} cavity quantum electrodynamics (QED) calculations demonstrate that large changes to reaction energies or barrier heights can be realized by coupling electronic degrees of freedom to vacuum fluctuations associated with an optical cavity mode, provided that large enough coupling strengths can be achieved. In many cases, the cavity effects display a pronounced orientational dependence. In this Perspective, we highlight the critical role that geometry relaxation can play in such studies. As an example, we consider recent work [Nat.~Commun.~{\bf 14}, 2766 (2023)] that explored the influence of an optical cavity on Diels-Alder cycloaddition reactions and reported large changes to reaction enthalpies and barrier heights, as well as the observation that changes in orientation can inhibit the reaction or select for one reaction product or another. Those calculations used fixed molecular geometries optimized in the absence of the cavity and fixed relative orientations of the molecules and the cavity mode polarization axis. Here, we show that, when given a chance to relax in the presence of the cavity, the molecular species reorient in a way that eliminates the orientational dependence. Moreover, in this case, we find that qualitatively different conclusions regarding the impact of the cavity on the thermodynamics of the reaction can be drawn from calculations that consider relaxed versus unrelaxed molecular structures