Seeing with the mind’s eye: top-down, bottom-up, and conscious awareness

With the advent of functional brain imaging techniques and recent developments in the analysis of cortical connectivity, the focus of mental imagery studies has shifted from a semi-modular approach to an integrated cortical network perspective. Functional magnetic resonance imaging studies of visual imagery of faces and objects show that activation of content-specific representations stored in the ventral visual stream is top-down-modulated by parietal and frontal regions. Recent findings in patients with conscious awareness disorders reveal that mental imagery can be used to map patterns of residual cognitive function in their brain and to provide diagnostic and prognostic indicators

Effective Connectivity within the Distributed Cortical Network for Face Perception

Face perception elicits activation within a distributed cortical network in the human brain. The network includes visual ("core”) regions, as well as limbic and prefrontal ("extended”) regions, which process invariant facial features and changeable aspects of faces, respectively. We used functional Magnetic Resonance Imaging and Dynamic Causal Modeling to investigate effective connectivity and functional organization between and within the core and the extended systems. We predicted a ventral rather than dorsal connection between the core and the extended systems during face viewing and tested whether valence and fame would alter functional coupling within the network. We found that the core system is hierarchically organized in a predominantly feed-forward fashion, and that the fusiform gyrus (FG) exerts the dominant influence on the extended system. Moreover, emotional faces increased the coupling between the FG and the amygdala, whereas famous faces increased the coupling between the FG and the orbitofrontal cortex. Our results demonstrate content-specific dynamic alterations in the functional coupling between visual-limbic and visual-prefrontal face-responsive pathway

Training Facilitates Object Recognition in Cubist Paintings

To the naïve observer, cubist paintings contain geometrical forms in which familiar objects are hardly recognizable, even in the presence of a meaningful title. We used fMRI to test whether a short training session about Cubism would facilitate object recognition in paintings by Picasso, Braque and Gris. Subjects, who had no formal art education, were presented with titled or untitled cubist paintings and scrambled images, and performed object recognition tasks. Relative to the control group, trained subjects recognized more objects in the paintings, their response latencies were significantly shorter, and they showed enhanced activation in the parahippocampal cortex, with a parametric increase in the amplitude of the fMRI signal as a function of the number of recognized objects. Moreover, trained subjects were slower to report not recognizing any familiar objects in the paintings and these longer response latencies were correlated with activation in a fronto-parietal network. These findings suggest that trained subjects adopted a visual search strategy and used contextual associations to perform the tasks. Our study supports the proactive brain framework, according to which the brain uses associations to generate predictions

Recollection- and Familiarity-Based Decisions Reflect Memory Strength

We used event-related fMRI to investigate whether recollection- and familiarity-based memory judgments are modulated by the degree of visual similarity between old and new art paintings. Subjects performed a flower detection task, followed by a Remember/Know/New surprise memory test. The old paintings were randomly presented with new paintings, which were either visually similar or visually different. Consistent with our prediction, subjects were significantly faster and more accurate to reject new, visually different paintings than new, visually similar ones. The proportion of false alarms, namely remember and know responses to new paintings, was significantly reduced with decreased visual similarity. The retrieval task evoked activation in multiple visual, parietal and prefrontal regions, within which remember judgments elicited stronger activation than know judgments. New, visually different paintings evoked weaker activation than new, visually similar items in the intraparietal sulcus. Contrasting recollection with familiarity revealed activation predominantly within the precuneus, where the BOLD response elicited by recollection peaked significantly earlier than the BOLD response evoked by familiarity judgments. These findings suggest that successful memory retrieval of pictures is mediated by activation in a distributed cortical network, where memory strength is manifested by differential hemodynamic profiles. Recollection- and familiarity-based memory decisions may therefore reflect strong memories and weak memories, respectively

Mapping the Human Brain: New Insights from fMRI Data Sharing

The sharing of primary data in the field of neuroscience has received considerable scrutiny from scientific societies and from science journals. Many see this as value added for science publishing that can enhance and inform secondary examination of data and results. Still others worry that data sharing is an undue burden for researchers with little long term value to science. But examples of how data sharing can be done successfully do exist. The fMRI Data Center, established at Dartmouth College in 2000 and now based at the University of California Santa Barbara, has worked to facilitate the open sharing of neuroimaging data from peer-reviewed papers to foster progress in cognitive science. The fMRI study on the representation of objects in the human occipital and temporal cortex, published in 2000 in the Journal of Cognitive Neuroscience (JOCN), marked the first deposition in the new database. Despite initial concerns about fMRI data sharing, this data set was frequently downloaded. We describe the original results of distributed brain activation patterns elicited by faces and objects in the human visual system, and overview several secondary analyses by independent investigators. A philosopher tested Husserl's temporal components of consciousness, whereas other brain imagers deployed new analytic tools, from Dynamic Causal Modeling, which estimates the neural interactions between cortical regions, to a novel method for constructing reproducibility maps. These re-analyses revealed new findings not reported in the original study, provided new perspectives on visual perception, generated new predictions, and resulted in new collaborations and publications in high profile journal

Famous Faces Activate Contextual Associations in the Parahippocampal Cortex

The parahippocampal cortex (PHC) has been traditionally implicated both in place processing and in episodic memory. How could the same cortical region mediate these cognitive functions that seem quite different? We have recently proposed that the PHC should be seen as more generally mediating contextual associative processing, which is required for both navigation and memory. We therefore predicted that any associative objects should activate the PHC. To test this generalization, we investigated the extent to which common stimuli that are nonspatial by nature, namely faces, activate the PHC, although their perception is typically associated with other cortical structures. Specifically, we compared the activation elicited by famous faces, which are highly associated with rich pictorial and contextual information (e.g., Tom Cruise) and are not associated with a specific place, with activation elicited by unfamiliar faces. Consistent with our prediction, contrasting famous with unfamiliar faces revealed significant activation within the PHC. Taken collectively, these findings indicate that the PHC should be regarded as mediating contextual associations in general and not necessarily spatial or episodic informatio

Expertise reduces neural cost but does not modulate repetition suppression

The extent to which repetition suppression is modulated by expertise is currently unknown. We used event-related fMRI to test whether architecture students would respond faster to buildings and would exhibit stronger repetition suppression in the fusiform gyrus (FG) and parahippocampa cortex (PHC) than students from other disciplines. Behaviorally, we found shorter response latencies with target repetition in all subjects. Moreover, the repetition of targets and distracters was associated with decreased neural responses in the FG and PHC in all subjects. In control, but not in architecture students, reaction times during the first repetition of the target were correlated with activation in the cuneus, lingual gyrus, inferior parietal lobule, insula, and anterior cingulate cortex, indicating that the non-experts had to recruit additional regions in order to perform the task. Our findings suggest that due to their expertise, architects were able to encode and detect building stimuli at a lower neural cost

Where Bottom-up Meets Top-down: Neuronal Interactions during Perception and Imagery

Functional magnetic resonance imaging (fMRI) studies have identified category-selective regions in ventral occipito-temporal cortex that respond preferentially to faces and other objects. The extent to which these patterns of activation are modulated by bottom-up or top-down mechanisms is currently unknown. We combined fMRI and dynamic causal modelling to investigate neuronal interactions between occipito-temporal, parietal and frontal regions, during visual perception and visual imagery of faces, houses and chairs. Our results indicate that, during visual perception, category-selective patterns of activation in extrastriate cortex are mediated by content-sensitive forward connections from early visual areas. In contrast, during visual imagery, category-selective activation is mediated by content-sensitive backward connections from prefrontal cortex. Additionally, we report content-unrelated connectivity between parietal cortex and the category-selective regions, during both perception and imagery. Thus, our investigation revealed that neuronal interactions between occipito-temporal, parietal and frontal regions are task- and stimulus-dependent. Sensory representations of faces and objects are mediated by bottom-up mechanisms arising in early visual areas and top-down mechanisms arising in prefrontal cortex, during perception and imagery respectively. Additionally non-selective, top-down processes, originating in superior parietal areas, contribute to the generation of mental images, regardless of their content, and their maintenance in the ‘mind's eye