Combined diffusion-weighted and functional magnetic resonance imaging reveals a temporal-occipital network involved in auditory-visual object processing

Functional magnetic resonance imaging (MRI) showed that the superior temporal and occipital cortex are involved in multisensory integration. Probabilistic fiber tracking based on diffusion-weighted MRI suggests that multisensory processing is supported by white matter connections between auditory cortex and the temporal and occipital lobe. Here, we present a combined functional MRI and probabilistic fiber tracking study that reveals multisensory processing mechanisms that remained undetected by either technique alone. Ten healthy participants passively observed visually presented lip or body movements, heard speech or body action sounds, or were exposed to a combination of both. Bimodal stimulation engaged a temporal-occipital brain network including the multisensory superior temporal sulcus (msSTS), the lateral superior temporal gyrus (lSTG), and the extrastriate body area (EBA). A region-of-interest (ROI) analysis showed multisensory interactions (e.g., subadditive responses to bimodal compared to unimodal stimuli) in the msSTS, the lSTG, and the EBA region. Moreover, sounds elicited responses in the medial occipital cortex. Probabilistic tracking revealed white matter tracts between the auditory cortex and the medial occipital cortex, the inferior occipital cortex (IOC), and the superior temporal sulcus (STS). However, STS terminations of auditory cortex tracts showed limited overlap with the msSTS region. Instead, msSTS was connected to primary sensory regions via intermediate nodes in the temporal and occipital cortex. Similarly, the lSTG and EBA regions showed limited direct white matter connections but instead were connected via intermediate nodes. Our results suggest that multisensory processing in the STS is mediated by separate brain areas that form a distinct network in the lateral temporal and inferior occipital cortex

Occipital Cortex of Blind Individuals Is Functionally Coupled with Executive Control Areas of Frontal Cortex

In congenital blindness, the occipital cortex responds to a range of nonvisual inputs, including tactile, auditory, and linguistic stimuli. Are these changes in functional responses to stimuli accompanied by altered interactions with nonvisual functional networks? To answer this question, we introduce a data-driven method that searches across cortex for functional connectivity differences across groups. Replicating prior work, we find increased fronto-occipital functional connectivity in congenitally blind relative to blindfolded sighted participants. We demonstrate that this heightened connectivity extends over most of occipital cortex but is specific to a subset of regions in the inferior, dorsal, and medial frontal lobe. To assess the functional profile of these frontal areas, we used an n-back working memory task and a sentence comprehension task. We find that, among prefrontal areas with overconnectivity to occipital cortex, one left inferior frontal region responds to language over music. By contrast, the majority of these regions responded to working memory load but not language. These results suggest that in blindness occipital cortex interacts more with working memory systems and raise new questions about the function and mechanism of occipital plasticity.David & Lucile Packard FoundationNational Science Foundation (U.S.). Graduate Research Fellowship Progra

Sensory over-responsivity and social cognition in ASD: Effects of aversive sensory stimuli and attentional modulation on neural responses to social cues.

Sensory over-responsivity (SOR) is a common condition in autism spectrum disorders (ASD) that is associated with greater social impairment. However, the mechanisms through which sensory stimuli may affect social functioning are not well understood. This study used fMRI to examine brain activity while interpreting communicative intent in 15 high-functioning youth with ASD and 16 age- and IQ-matched typically-developing (TD) controls. Participants completed the task with and without a tactile sensory distracter, and with and without instructions directing their attention to relevant social cues. When completing the task in the presence of the sensory distracter, TD youth showed increased activity in auditory language and frontal regions whereas ASD youth showed decreased activation in these areas. Instructions mitigated this effect such that ASD youth did not decrease activation during tactile stimulation; instead, the ASD group showed increased medial prefrontal activity. SOR severity modulated the effect of the tactile stimulus on social processing. Results demonstrate for the first time a neural mechanism through which sensory stimuli cause disruption of social cognition, and that attentional modulation can restore neural processing of social cues through prefrontal regulation. Findings have implications for novel, integrative interventions that incorporate attentional directives to target both sensory and social symptoms

Attentional load and sensory competition in human vision: Modulation of fMRI responses by load fixation during task-irrelevant stimulation in the peripheral visual field.

Perceptual suppression of distractors may depend on both endogenous and exogenous factors, such as attentional load of the current task and sensory competition among simultaneous stimuli, respectively. We used functional magnetic resonance imaging (fMRI) to compare these two types of attentional effects and examine how they may interact in the human brain. We varied the attentional load of a visual monitoring task performed on a rapid stream at central fixation without altering the central stimuli themselves, while measuring the impact on fMRI responses to task-irrelevant peripheral checkerboards presented either unilaterally or bilaterally. Activations in visual cortex for irrelevant peripheral stimulation decreased with increasing attentional load at fixation. This relative decrease was present even in V1, but became larger for successive visual areas through to V4. Decreases in activation for contralateral peripheral checkerboards due to higher central load were more pronounced within retinotopic cortex corresponding to 'inner' peripheral locations relatively near the central targets than for more eccentric 'outer' locations, demonstrating a predominant suppression of nearby surround rather than strict 'tunnel vision' during higher task load at central fixation. Contralateral activations for peripheral stimulation in one hemifield were reduced by competition with concurrent stimulation in the other hemifield only in inferior parietal cortex, not in retinotopic areas of occipital visual cortex. In addition, central attentional load interacted with competition due to bilateral versus unilateral peripheral stimuli specifically in posterior parietal and fusiform regions. These results reveal that task-dependent attentional load, and interhemifield stimulus-competition, can produce distinct influences on the neural responses to peripheral visual stimuli within the human visual system. These distinct mechanisms in selective visual processing may be integrated within posterior parietal areas, rather than earlier occipital cortex

Rapid modulation of sensory processing induced by stimulus conflict

Humans are constantly confronted with environmental stimuli that conflict with task goals and can interfere with successful behavior. Prevailing theories propose the existence of cognitive control mechanisms that can suppress the processing of conflicting input and enhance that of the relevant input. However, the temporal cascade of brain processes invoked in response to conflicting stimuli remains poorly understood. By examining evoked electrical brain responses in a novel, hemifield-specific, visual-flanker task, we demonstrate that task-irrelevant conflicting stimulus input is quickly detected in higher level executive regions while simultaneously inducing rapid, recurrent modulation of sensory processing in the visual cortex. Importantly, however, both of these effects are larger for individuals with greater incongruency-related RT slowing. The combination of neural activation patterns and behavioral interference effects suggest that this initial sensory modulation induced by conflicting stimulus inputs reflects performance-degrading attentional distraction because of their incompatibility rather than any rapid task-enhancing cognitive control mechanisms. The present findings thus provide neural evidence for a model in which attentional distraction is the key initial trigger for the temporal cascade of processes by which the human brain responds to conflicting stimulus input in the environment

Avoiding unseen obstacles : Subcortical vision is not sufficient to maintain normal obstacle avoidance behaviour during reaching

Acknowledgement This work was funded by the RS MacDonald Charitable Trust (awarded to C. Hesse in June 2013). T. Schenk was supported by a grant from the German Research Council (DFG – SCHE 735/3-1). The authors would like to thank Dr Stefanie Biehl for her valuable advice on lesion localisation based on the CT and MRI scans of the patients. We would also like to thank all the patients for taking part in our experiments and for giving up so much of their free time.Peer reviewedPostprin

Bottom-up retinotopic organization supports top-down mental imagery

Finding a path between locations is a routine task in daily life. Mental navigation is often used to plan a route to a destination that is not visible from the current location. We first used functional magnetic resonance imaging (fMRI) and surface-based averaging methods to find high-level brain regions involved in imagined navigation between locations in a building very familiar to each participant. This revealed a mental navigation network that includes the precuneus, retrosplenial cortex (RSC), parahippocampal place area (PPA), occipital place area (OPA), supplementary motor area (SMA), premotor cortex, and areas along the medial and anterior intraparietal sulcus. We then visualized retinotopic maps in the entire cortex using wide-field, natural scene stimuli in a separate set of fMRI experiments. This revealed five distinct visual streams or ‘fingers’ that extend anteriorly into middle temporal, superior parietal, medial parietal, retrosplenial and ventral occipitotemporal cortex. By using spherical morphing to overlap these two data sets, we showed that the mental navigation network primarily occupies areas that also contain retinotopic maps. Specifically, scene-selective regions RSC, PPA and OPA have a common emphasis on the far periphery of the upper visual field. These results suggest that bottom-up retinotopic organization may help to efficiently encode scene and location information in an eye-centered reference frame for top-down, internally generated mental navigation. This study pushes the border of visual cortex further anterior than was initially expected