Reading the mind's eye: Decoding category information during mental imagery

Category information for visually presented objects can be read out from multi-voxel patterns of fMRI activity in ventral–temporal cortex. What is the nature and reliability of these patterns in the absence of any bottom–up visual input, for example, during visual imagery? Here, we first ask how well category information can be decoded for imagined objects and then compare the representations evoked during imagery and actual viewing. In an fMRI study, four object categories (food, tools, faces, buildings) were either visually presented to subjects, or imagined by them. Using pattern classification techniques, we could reliably decode category information (including for non-special categories, i.e., food and tools) from ventral–temporal cortex in both conditions, but only during actual viewing from retinotopic areas. Interestingly, in temporal cortex when the classifier was trained on the viewed condition and tested on the imagery condition, or vice versa, classification performance was comparable to within the imagery condition. The above results held even when we did not use information in the specialized category-selective areas. Thus, the patterns of representation during imagery and actual viewing are in fact surprisingly similar to each other. Consistent with this observation, the maps of “diagnostic voxels” (i.e., the classifier weights) for the perception and imagery classifiers were more similar in ventral–temporal cortex than in retinotopic cortex. These results suggest that in the absence of any bottom–up input, cortical back projections can selectively re-activate specific patterns of neural activity

FMRI and ERP investigations of body representations in the human lateral and ventral occipitotemporal cortex

EThOS - Electronic Theses Online ServiceGBUnited Kingdo

Prior experience modulates top-down predictive processing in the ventral visual areas

Repetition suppression(RS)refers to that the reduction of neural activities for repeated presentations of a given stimulus compared to its first presentation. Summerfield et al(2008) found the magnitude of RS is affected by the repetition probability of stimuli, called as P(rep) effect. Based on the predictive coding theory, prior experience about the sensory inputs is necessary to optimally achieve cognitive processes. But it remains unclear how prior experience modulates predictive processes. To address this issue, in Study I, we estimated the P(rep) effects for Chinese characters and German words in native Chinese and German participants to test whether prior experience affects the P(rep) effect of lexical stimuli. The results showed that the P(rep) effect is only manifest for words of a language with which participants had prior experience. Study II performed fMRI measurements before and after a 10-day perceptual learning (PL) training for cars to test the modulation of short-term experience on the P(rep) effect. The results replicated the P(rep) effect for faces and cars. More interestingly, the P(rep) effect can be temporarily abolished by the short-term PL experience. The third study investigated how prior experience modulates sensory inputs. Study 3a adopted a classic stimulus repetition paradigm to measure RS for faces, together with either concurrent short-term memory (STM) load or a control condition. The results showed that RS is significantly attenuated when visual STM is loaded. Study 3b manipulates attention by a face inversion detection task. The results showed that the RS effect appears in the STM condition when participants attend to faces. The main conclusions: i) predictive processes, as measured by the P(rep) effect, require extensive prior experiences with stimuli, but ii) these can also be modulated by short-term learning experience. Further, iii) STM and attention are two modulators of prior experiences on predictive processes

Multivariate Patterns in Object-Selective Cortex Dissociate Perceptual and Physical Shape Similarity

Prior research has identified the lateral occipital complex (LOC) as a critical cortical region for the representation of object shape in humans. However, little is known about the nature of the representations contained in the LOC and their relationship to the perceptual experience of shape. We used human functional MRI to measure the physical, behavioral, and neural similarity between pairs of novel shapes to ask whether the representations of shape contained in subregions of the LOC more closely reflect the physical stimuli themselves, or the perceptual experience of those stimuli. Perceptual similarity measures for each pair of shapes were obtained from a psychophysical same-different task; physical similarity measures were based on stimulus parameters; and neural similarity measures were obtained from multivoxel pattern analysis methods applied to anterior LOC (pFs) and posterior LOC (LO). We found that the pattern of pairwise shape similarities in LO most closely matched physical shape similarities, whereas shape similarities in pFs most closely matched perceptual shape similarities. Further, shape representations were similar across participants in LO but highly variable across participants in pFs. Together, these findings indicate that activation patterns in subregions of object-selective cortex encode objects according to a hierarchy, with stimulus-based representations in posterior regions and subjective and observer-specific representations in anterior regions

Revealing Connections in Object and Scene Processing Using Consecutive TMS and fMR-Adaptation

When processing the visual world, our brain must perform many computations that may occur across several regions. It is important to understand communications between regions in order to understand perceptual processes underlying processing of our environment. We sought to determine the connectivity of object and scene processing regions of the cortex, which are not fully established. In order to determine these connections repetitive transcranial magnetic stimulation (rTMS) and functional magnetic resonance-adaptation (fMR-A) were paired together. rTMS was applied to object-selective lateral occipital (LO) and scene-selective transverse occipital sulcus (TOS). Immediately after stimulation, participants underwent fMR-A, and pre- and post-TMS responses were compared. TMS disrupted remote regions revealing connections from LO and TOS to remote object and scene-selective regions in the occipital cortex. In addition, we report important neural correlates regarding the transference of object related information between modalities, from LO to outside the ventral network to parietal and frontal areas