Action in cognition: the case of language

Empirical research has shown that the processing of words and sentences is accompanied by activation of the brain's motor system in language users. The degree of precision observed in this activation seems to be contingent upon (1) the meaning of a linguistic construction and (2) the depth with which readers process that construction. In addition, neurological evidence shows a correspondence between a disruption in the neural correlates of overt action and the disruption of semantic processing of language about action. These converging lines of evidence can be taken to support the hypotheses that motor processes (1) are recruited to understand language that focuses on actions and (2) contribute a unique element to conceptual representation. This article explores the role of this motor recruitment in language comprehension. It concludes that extant findings are consistent with the theorized existence of multimodal, embodied representations of the referents of words and the meaning carried by language. Further, an integrative conceptualization of “fault tolerant comprehension” is proposed

What's "up"? Impaired Spatial Preposition Processing in Posterior Cortical Atrophy.

This study seeks to confirm whether lesions in posterior regions of the brain involved in visuo-spatial processing are of functional relevance to the processing of words with spatial meaning. We investigated whether patients with Posterior Cortical Atrophy (PCA), an atypical form of Alzheimer's Disease which predominantly affects parieto-occipital brain regions, is associated with deficits in working memory for spatial prepositions. Case series of patients with PCA and matched healthy controls performed tests of immediate and delayed serial recall on words from three lexico-semantic word categories: number words (twelve), spatial prepositions (behind) and function words (e.g., shall). The three word categories were closely matched for a number of psycholinguistic and semantic variables including length, bi-/tri-gram frequency, word frequency, valence and arousal. Relative to controls, memory performance of PCA patients on short word lists was significantly impaired on spatial prepositions in the delayed serial recall task. These results suggest that lesions in posterior parieto-occipital regions specifically impair the processing of spatial prepositions. Our findings point to a pertinent role of posterior cortical regions in the semantic processing of words with spatial meaning and provide strong support for modality-specific semantic theories that recognize the necessary contributions of sensorimotor regions to conceptual semantic processing

Anterior temporal lobe is necessary for efficient lateralised processing of spoken word identity.

In the healthy human brain, the processing of language is strongly lateralised, usually to the left hemisphere, while the processing of complex non-linguistic sounds recruits brain regions bilaterally. Here we asked whether the anterior temporal lobes, strongly implicated in semantic processing, are critical to this special treatment of spoken words. Nine patients with semantic dementia (SD) and fourteen age-matched controls underwent magnetoencephalography and structural MRI. Voxel based morphometry demonstrated the stereotypical pattern of SD: severe grey matter loss restricted to the anterior temporal lobes, with the left side more affected. During magnetoencephalography, participants listened to word sets in which identity and meaning were ambiguous until word completion, for example PLAYED versus PLATE. Whereas left-hemispheric responses were similar across groups, patients demonstrated increased right hemisphere activity 174-294 msec after stimulus disambiguation. Source reconstructions confirmed recruitment of right-sided analogues of language regions in SD: atrophy of anterior temporal lobes was associated with increased activity in right temporal pole, middle temporal gyrus, inferior frontal gyrus and supramarginal gyrus. Overall, the results indicate that anterior temporal lobes are necessary for normal and efficient lateralised processing of word identity by the language network.The study was primarily funded by the MRC Cognition and Brain Sciences Unit with additional support from the Cambridge NIHR Biomedical Research Centre (the views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care). TEC was supported by the Association of British Neurologists, the Patrick Berthoud Charitable trust, and the NIHR. YS was supported by the Medical Research Council (MC-A060-5PQ90), Lundbeck Foundation (R164-2013-15801, project 18690), Danish Council for Independent Research (6110-00486, project 23776), HSE Basic Research Program and the RF Academic Excellence Project '5-100'. JBR was supported by the Wellcome Trust (103838), and the Medical Research Council (MC-A060-5PQ30 & SUAG/004 RG91365)

On staying grounded and avoiding Quixotic dead ends

The 15 articles in this special issue on The Representation of Concepts illustrate the rich variety of theoretical positions and supporting research that characterize the area. Although much agreement exists among contributors, much disagreement exists as well, especially about the roles of grounding and abstraction in conceptual processing. I first review theoretical approaches raised in these articles that I believe are Quixotic dead ends, namely, approaches that are principled and inspired but likely to fail. In the process, I review various theories of amodal symbols, their distortions of grounded theories, and fallacies in the evidence used to support them. Incorporating further contributions across articles, I then sketch a theoretical approach that I believe is likely to be successful, which includes grounding, abstraction, flexibility, explaining classic conceptual phenomena, and making contact with real-world situations. This account further proposes that (1) a key element of grounding is neural reuse, (2) abstraction takes the forms of multimodal compression, distilled abstraction, and distributed linguistic representation (but not amodal symbols), and (3) flexible context-dependent representations are a hallmark of conceptual processing

Ultra-rapid access to words in the brain.

Rapid information processing in the human brain is vital to survival in a highly dynamic environment. The key tool humans use to exchange information is spoken language, but the exact speed of the neuronal mechanisms underpinning speech comprehension is still unknown. Here we investigate the time course of neuro-lexical processing by analyzing neuromagnetic brain activity elicited in response to psycholinguistically and acoustically matched groups of words and pseudowords. We show an ultra-early dissociation in cortical activation elicited by these stimulus types, emerging ∼50 ms after acoustic information required for word identification first becomes available. This dissociation is the earliest brain signature of lexical processing of words so far reported, and may help explain the evolutionary advantage of human spoken language

Combining rTMS With Intensive Language-Action Therapy in Chronic Aphasia : A Randomized Controlled Trial

Neuromodulation technologies, such as transcranial magnetic stimulation (TMS), are promising tools for neurorehabilitation, aphasia therapy included, but not yet in common clinical use. Combined with behavioral techniques, in particular treatment-efficient Intensive Language-Action Therapy (ILAT, previously CIAT or CILT), TMS could substantially amplify the beneficial effect of such behavioral therapy alone (Thiel et al., 2013; Martin et al., 2014; Mendoza et al., 2016; Kapoor, 2017). In this randomized study of 17 subjects with post-stroke aphasia in the chronic stage, we studied the combined effect of ILAT and 1-Hz placebo-controlled navigated repetitive TMS (rTMS) to the right-hemispheric inferior frontal cortex-that is, to the anterior part of the non-dominant hemisphere's homolog Broca's area (pars triangularis). Patients were randomized to groups A and B. Patients in group A received a 2-week period of rTMS during naming training where they named pictures displayed on the screen once every 10 s, followed by 2 weeks of rTMS and naming combined with ILAT. Patients in group B received the same behavioral therapy but TMS was replaced by sham stimulation. The primary outcome measures for changes in language performance were the Western Aphasia Battery's aphasia quotient AQ; the secondary outcome measures were the Boston naming test (BNT) and the Action naming test (Action BNT, ANT). All subjects completed the study. At baseline, no statistically significant group differences were discovered for age, post-stroke time or diagnosis. ILAT was associated with significant improvement across groups, as documented by both primary and secondary outcome measures. No significant effect of rTMS could be documented. Our results agree with previous results proving ILAT's ability to improve language in patients with chronic aphasia. In contrast with earlier claims, however, a beneficial effect of rTMS in chronic post-stroke aphasia rehabilitation was not detected in this study.Peer reviewe

Ultra-rapid access to words in chronic aphasia: the effects of intensive language action therapy (ILAT).

Effects of intensive language action therapy (ILAT) on automatic language processing were assessed using Magnetoencephalography (MEG). Auditory magnetic mismatch negativity (MMNm) responses to words and pseudowords were recorded in twelve patients with chronic aphasia before and immediately after two weeks of ILAT. Following therapy, Patients showed significant clinical improvements of auditory comprehension as measured by the Token Test and in word retrieval and naming as measured by the Boston Naming Test. Neuromagnetic responses dissociated between meaningful words and meaningless word-like stimuli ultra-rapidly, approximately 50 ms after acoustic information first allowed for stimulus identification. Over treatment, there was a significant increase in the left-lateralisation of this early word-elicited activation, observed in perilesional fronto-temporal regions. No comparable change was seen for pseudowords. The results may reflect successful, therapy-induced, language restitution in the left hemisphere

Grip Force Reveals the Context Sensitivity of Language-Induced Motor Activity during “Action Words

Studies demonstrating the involvement of motor brain structures in language processing typically focus on \ud time windows beyond the latencies of lexical-semantic access. Consequently, such studies remain inconclusive regarding whether motor brain structures are recruited directly in language processing or through post-linguistic conceptual imagery. In the present study, we introduce a grip-force sensor that allows online measurements of language-induced motor activity during sentence listening. We use this tool to investigate whether language-induced motor activity remains constant or is modulated in negative, as opposed to affirmative, linguistic contexts. Our findings demonstrate that this simple experimental paradigm can be used to study the online crosstalk between language and the motor systems in an ecological and economical manner. Our data further confirm that the motor brain structures that can be called upon during action word processing are not mandatorily involved; the crosstalk is asymmetrically\ud governed by the linguistic context and not vice versa

Neurophysiological evidence for rapid processing of verbal and gestural information in understanding communicative actions

During everyday social interaction, gestures are a fundamental part of human communication. The communicative pragmatic role of hand gestures and their interaction with spoken language has been documented at the earliest stage of language development, in which two types of indexical gestures are most prominent: the pointing gesture for directing attention to objects and the give-me gesture for making requests. Here we study, in adult human participants, the neurophysiological signatures of gestural-linguistic acts of communicating the pragmatic intentions of naming and requesting by simultaneously presenting written words and gestures. Already at ~150 ms, brain responses diverged between naming and request actions expressed by word-gesture combination, whereas the same gestures presented in isolation elicited their earliest neurophysiological dissociations significantly later (at ~210 ms). There was an early enhancement of request-evoked brain activity as compared with naming, which was due to sources in the frontocentral cortex, consistent with access to action knowledge in request understanding. In addition, an enhanced N400-like response indicated late semantic integration of gesture-language interaction. The present study demonstrates that word-gesture combinations used to express communicative pragmatic intentions speed up the brain correlates of comprehension processes – compared with gesture-only understanding – thereby calling into question current serial linguistic models viewing pragmatic function decoding at the end of a language comprehension cascade. Instead, information about the social-interactive role of communicative acts is processed instantaneously

Body-part-specific Representations of Semantic Noun Categories.

Word meaning processing in the brain involves ventrolateral temporal cortex, but a semantic contribution of the dorsal stream, especially frontocentral sensorimotor areas, has been controversial. We here examine brain activation during passive reading of object-related nouns from different semantic categories, notably animal, food, and tool words, matched for a range of psycholinguistic features. Results show ventral stream activation in temporal cortex along with category-specific activation patterns in both ventral and dorsal streams, including sensorimotor systems and adjacent pFC. Precentral activation reflected action-related semantic features of the word categories. Cortical regions implicated in mouth and face movements were sparked by food words, and hand area activation was seen for tool words, consistent with the actions implicated by the objects the words are used to speak about. Furthermore, tool words specifically activated the right cerebellum, and food words activated the left orbito-frontal and fusiform areas. We discuss our results in the context of category-specific semantic deficits in the processing of words and concepts, along with previous neuroimaging research, and conclude that specific dorsal and ventral areas in frontocentral and temporal cortex index visual and affective–emotional semantic attributes of object-related nouns and action-related affordances of their referent objects