Specificity of Action Representations in the Lateral Occipitotemporal Cortex

The ability to recognize actions is important for cognitive development and social cognition. Areas in the lateral occipitotemporal cortex show increased activity when subjects view action sequences; however, whether this activity distinguishes between specific actions as necessary for action recognition is unclear. We used a functional magnetic resonance imaging adaptation paradigm to test for brain regions that exhibit action-specific activity. Subjects watched a series of action sequences in which the action performed or the person performing the action could be repeated from a previous scan. Three regions—the superior temporal sulcus (pSTS), human motion-sensitive cortex (MT/MST), and extrastriate body area (EBA)—showed decreased activity for previously seen actions, even when the actions were novel exemplars because the persons involved had not been seen previously. These action-specific adaptation effects provide compelling evidence that representations in the pSTS, MT/MST, and EBA abstract actions from the agents involved and distinguish between different particular actions

Semantic memory

The Encyclopedia of Human Behavior, Second Edition is a comprehensive three-volume reference source on human action and reaction, and the thoughts, feelings, and physiological functions behind those actions

Theta synchronization over occipito‐temporal cortices during visual perception of body parts

Categorical clustering in the visual system is thought to have evolved as a function of intrinsic (intra-areal) and extrinsic (interareal) connectivity and experience. In the visual system, the extrastriate body area (EBA), an occipito-temporal region, responds to full body and body part images under the organizational principle of their functional/semantic meaning. Although frequency-specific modulations of neural activity associated with perceptive and cognitive functions are increasingly attracting the interest of neurophysiologists and cognitive neuroscientists, perceiving single body parts with different functional meaning and full body images induces time-frequency modulations over occipito-temporal electrodes are yet to be described. Here, we studied this issue by measuring EEG in participants who passively observed fingers, hands, arms and faceless full body images with four control plant stimuli, each bearing hierarchical analogy with the body stimuli. We confirmed that occipito-temporal electrodes (compatible with the location of EBA) show a larger event-related potential (ERP, N190) for body-related images. Furthermore, we identified a body part-specific (i.e. selective for hands and arms) theta event-related synchronization increase under the same electrodes. This frequency modulation associated with the perception of body effectors over occipito-temporal cortices is in line with recent findings of categorical organization of neural responses to human effectors in the visual system

Neural correlates of hand-tool interaction

Background: The recent advent of non-invasive functional magnetic resonance image (fMRI) has helped us understand how visual information is processed in the visual system, and the functional organising principles of high-order visual areas beyond striate cortex. In particular, evidence has been reported for a constellation of high-order visual areas that are highly specialised for the visual processing of different object domains such as faces, bodies, and tools. A number of accounts of the underlying principle of functional specialisation in high-order visual cortex propose that visual properties and object domain drive the category selectivity of these areas. However, recent evidence has challenged such accounts, showing that non-visual object properties and connectivity constraints between specialised brain networks can, in part, account for the visual system’s functional organisation. Methodology: Here I will use fMRI to examine how areas along the visual ventral stream and dorsal action stream process visually presented hands and tools. These categories are visually dissimilar but share similar functions. By using different statistical analyses, such as univariate group and single-subject region of interest (ROI) analyses, multivariate multivoxel pattern analyses, and functional connectivity analyses, I will investigate the topics of category-selectivity and the principles underlying the organisation of high-order visual areas in left occipitotemporal and left parietal cortex. Principle Findings: In the first part of this thesis I report novel evidence that, similar to socially relevant faces and bodies, the human high-order visual areas in left occipitotemporal and left parietal cortex houses areas that are selective for the visual processing of human hands. In the second part of this thesis, I show that the visual representation of hands and tools in these areas show large anatomical overlap and high similarity in the response patterns to these categories. As hands and tools differ in visual appearance and object domain yet share action-related properties, the results demonstrate that these category-selective responses in the visual system reflect responses to non-visual action-related object properties common to hands and tools rather than to purely visual properties or object domain. This proposition is further supported by evidence of selective functional connectivity patterns between hand/tool occipitotemporal and parietal areas. Conclusions/Significance: Overall these results indicate that high-order visual cortex is functionally organised to process both visual properties and non-visual object dimensions (e.g., action-related properties). I propose that this correspondence between hand and tool representations in ventral ‘visual’ and parietal ‘action’ areas is constrained by the necessity to connect visual object information to functionally-specific downstream networks (e.g., frontoparietal action network) to facilitate hand-tool action-related processing

Representational content of occipitotemporal and parietal tool areas

It is now established that the perception of tools engages a left-lateralized network of frontoparietal and occipitotemporal cortical regions. Nevertheless, the precise computational role played by these areas is not yet well understood. To address this question, we used functional MRI to investigate the distribution of responses to pictures of tools and hands relative to other object categories in the so-called “tool” areas. Although hands and tools are visually not alike and belong to different object categories, these are both functionally linked when considering the common role of hands and tools in object manipulation. This distinction can provide insight into the differential functional role of areas within the “tool” network. Results demonstrated that images of hands and tools activate a common network of brain areas in the left intraparietal sulcus (IPS), left lateral occipitotemporal cortex (LOTC) and ventral occipitotemporal cortex (VOTC). Importantly, multivoxel pattern analysis revealed that the distribution of hand and tool response patterns in these regions differs. These observations provide support for the idea that the left IPS, left LOTC and VOTC might have distinct computational roles with regard to tool use. Specifically, these results suggest that while left IPS supports tool action-related computations and VOTC primarily encodes category specific aspects of objects, left LOTC bridges ventro occipitotemporal perception-related and parietal action-related representations by encoding both types of object information

Decoding the neural mechanisms of human tool use.

Sophisticated tool use is a defining characteristic of the primate species but how is it supported by the brain, particularly the human brain? Here we show, using functional MRI and pattern classification methods, that tool use is subserved by multiple distributed action-centred neural representations that are both shared with and distinct from those of the hand. In areas of frontoparietal cortex we found a common representation for planned hand- and tool-related actions. In contrast, in parietal and occipitotemporal regions implicated in hand actions and body perception we found that coding remained selectively linked to upcoming actions of the hand whereas in parietal and occipitotemporal regions implicated in tool-related processing the coding remained selectively linked to upcoming actions of the tool. The highly specialized and hierarchical nature of this coding suggests that hand- and tool-related actions are represented separately at earlier levels of sensorimotor processing before becoming integrated in frontoparietal cortex. DOI:http://dx.doi.org/10.7554/eLife.00425.001

FMRI and ERP investigations of body representations in the human lateral and ventral occipitotemporal cortex

EThOS - Electronic Theses Online ServiceGBUnited Kingdo