Neural connectivity in syntactic movement processing

Linguistic theory suggests non-canonical sentences subvert the dominant agent-verb-theme order in English via displacement of sentence constituents to argument (NP-movement) or non-argument positions (wh-movement). Both processes have been associated with the left inferior frontal gyrus and posterior superior temporal gyrus, but differences in neural activity and connectivity between movement types have not been investigated. In the current study, functional magnetic resonance imaging data were acquired from 21 adult participants during an auditory sentence-picture verification task using passive and active sentences contrasted to isolate NP-movement, and object- and subject-cleft sentences contrasted to isolate wh-movement. Then, functional magnetic resonance imaging data from regions common to both movement types were entered into a dynamic causal modeling analysis to examine effective connectivity for wh-movement and NP-movement. Results showed greater left inferior frontal gyrus activation for Wh > NP-movement, but no activation for NP > Wh-movement. Both types of movement elicited activity in the opercular part of the left inferior frontal gyrus, left posterior superior temporal gyrus, and left medial superior frontal gyrus. The dynamic causal modeling analyses indicated that neither movement type significantly modulated the connection from the left inferior frontal gyrus to the left posterior superior temporal gyrus, nor vice-versa, suggesting no connectivity differences between wh- and NP-movement. These findings support the idea that increased complexity of wh-structures, compared to sentences with NP-movement, requires greater engagement of cognitive resources via increased neural activity in the left inferior frontal gyrus, but both movement types engage similar neural networks.This work was supported by the NIH-NIDCD, Clinical Research Center Grant, P50DC012283 (PI: CT), and the Graduate Research Grant and School of Communication Graduate Ignition Grant from Northwestern University (awarded to EE). (P50DC012283 - NIH-NIDCD, Clinical Research Center Grant; Graduate Research Grant and School of Communication Graduate Ignition Grant from Northwestern University)Published versio

Brain regions that process case: Evidence from basque

The aim of this event-related fMRI study was to investigate the cortical networks involved in case processing, an operation that is crucial to language comprehension yet whose neural underpinnings are not well-understood. What is the relationship of these networks to those that serve other aspects of syntactic and semantic processing? Participants read Basque sentences that contained case violations, number agreement violations or semantic anomalies, or that were both syntactically and semantically correct. Case violations elicited activity increases, compared to correct control sentences, in a set of parietal regions including the posterior cingulate, the precuneus, and the left and right inferior parietal lobules. Number agreement violations also elicited activity increases in left and right inferior parietal regions, and additional activations in the left and right middle frontal gyrus. Regions-of-interest analyses showed that almost all of the clusters that were responsive to case or number agreement violations did not differentiate between these two. In contrast, the left and right anterior inferior frontal gyrus and the dorsomedial prefrontal cortex were only sensitive to semantic violations. Our results suggest that whereas syntactic and semantic anomalies clearly recruit distinct neural circuits, case, and number violations recruit largely overlapping neural circuits and that the distinction between the two rests on the relative contributions of parietal and prefrontal regions, respectively. Furthermore, our results are consistent with recently reported contributions of bilateral parietal and dorsolateral brain regions to syntactic processing, pointing towards potential extensions of current neurocognitive theories of language. Hum Brain Mapp, 2012. © 2011 Wiley Periodicals, Inc

Neural correlates of the processing of co-speech gestures

In communicative situations, speech is often accompanied by gestures. For example, speakers tend to illustrate certain contents of speech by means of iconic gestures which are hand movements that bear a formal relationship to the contents of speech. The meaning of an iconic gesture is determined both by its form as well as the speech context in which it is performed. Thus, gesture and speech interact in comprehension. Using fMRI, the present study investigated what brain areas are involved in this interaction process. Participants watched videos in which sentences containing an ambiguous word (e.g. She touched the mouse) were accompanied by either a meaningless grooming movement, a gesture supporting the more frequent dominant meaning (e.g. animal) or a gesture supporting the less frequent subordinate meaning (e.g. computer device). We hypothesized that brain areas involved in the interaction of gesture and speech would show greater activation to gesture-supported sentences as compared to sentences accompanied by a meaningless grooming movement. The main results are that when contrasted with grooming, both types of gestures (dominant and subordinate) activated an array of brain regions consisting of the left posterior superior temporal sulcus (STS), the inferior parietal lobule bilaterally and the ventral precentral sulcus bilaterally. Given the crucial role of the STS in audiovisual integration processes, this activation might reflect the interaction between the meaning of gesture and the ambiguous sentence. The activations in inferior frontal and inferior parietal regions may reflect a mechanism of determining the goal of co-speech hand movements through an observation-execution matching process

Neural overlap of L1 and L2 semantic representations across visual and auditory modalities : a decoding approach/

This study investigated whether brain activity in Dutch-French bilinguals during semantic access to concepts from one language could be used to predict neural activation during access to the same concepts from another language, in different language modalities/tasks. This was tested using multi-voxel pattern analysis (MVPA), within and across language comprehension (word listening and word reading) and production (picture naming). It was possible to identify the picture or word named, read or heard in one language (e.g. maan, meaning moon) based on the brain activity in a distributed bilateral brain network while, respectively, naming, reading or listening to the picture or word in the other language (e.g. lune). The brain regions identified differed across tasks. During picture naming, brain activation in the occipital and temporal regions allowed concepts to be predicted across languages. During word listening and word reading, across-language predictions were observed in the rolandic operculum and several motor-related areas (pre- and postcentral, the cerebellum). In addition, across-language predictions during reading were identified in regions typically associated with semantic processing (left inferior frontal, middle temporal cortex, right cerebellum and precuneus) and visual processing (inferior and middle occipital regions and calcarine sulcus). Furthermore, across modalities and languages, the left lingual gyrus showed semantic overlap across production and word reading. These findings support the idea of at least partially language- and modality-independent semantic neural representations

Conflict monitoring in speech processing: an fMRI study of error detection in speech production and perception

To minimize the number of errors in speech, and thereby facilitate communication, speech is monitored before articulation. It is, however, unclear at which level during speech production monitoring takes place, and what mechanisms are used to detect and correct errors. The present study investigated whether internal verbal monitoring takes place through the speech perception system, as proposed by perception-based theories of speech monitoring, or whether mechanisms independent of perception are applied, as proposed by production-based theories of speech monitoring. With the use of fMRI during a tongue twister task we observed that error detection in internal speech during noise-masked overt speech production and error detection in speech perception both recruit the same neural network, which includes pre-supplementary motor area (pre-SMA), dorsal anterior cingulate cortex (dACC), anterior insula (AI), and inferior frontal gyrus (IFG). Although production and perception recruit similar areas, as proposed by perception-based accounts, we did not find activation in superior temporal areas (which are typically associated with speech perception) during internal speech monitoring in speech production as hypothesized by these accounts. On the contrary, results are highly compatible with a domain general approach to speech monitoring, by which internal speech monitoring takes place through detection of conflict between response options, which is subsequently resolved by a domain general executive center (e.g., the ACC)

Disentangling meaning in the brain: Left temporal involvement in agreement processing

Published online 18 November 2016Sentence comprehension is successfully accomplished by means of a form-to-meaning mapping procedure that relies on the extraction of morphosyntactic information from the input and its mapping to higher-level semantic–discourse representations. In this study, we sought to determine whether neuroanatomically distinct brain regions are involved in the processing of different types of information contained in the propositional meaning of a sentence, namely person and number. While person information indexes the role that an individual has in discourse (i.e., the speaker, the addressee or the entity being talked about by speaker and addressee), number indicates its cardinality (i.e., a single entity vs a multitude of entities). An event-related functional magnetic resonance imaging (fMRI) experiment was run using agreement-Correct and Person- and Number-violated sentences in Spanish, to disentangle the processing mechanisms and neural substrates associated with the building of discourse and cardinality representations. The contrast between Person and Number Violations showed qualitative and quantitative differences. A greater response for person compared to number was found in the left middle temporal gyrus (LMTG). However, critically, a posterior-to-anterior functional gradient emerged within this region. While the posterior portion of the LMTG was sensitive to both Person and Number Violations, the anterior portion of this region showed selective response for Person Violations. These results confirm that the comprehension of the propositional meaning of a sentence results from a composite, feature-sensitive mechanism of form-to-meaning mapping in which the nodes of the language network are differentially involved.BCBL acknowledges funding from Ayuda Centro de Excelencia Severo Ochoa SEV-2015-0490. S.M. acknowledges funding from the Gipuzkoako Foru Aldundia Fellowship Program and from grant PI_2014_38 from the Basque Government. N.M. was funded by grant PSI2012- 32350 and PSI2015-65694-P from the Spanish Ministry of Economy and Competitiveness. M.C was funded by grant PSI2012-31448 from the Spanish Ministry of Science and Innovation and ERC-2011-ADG-295362 from the European Research Council

From minimal dependencies to sentence contexts: neural correlates of agreement processing

289 p.Language comprehension is incremental, involving the integration of formal and conceptual information from different words, together with the need to resolve conflicting cues when unexpected information occurs. However, despite the extensive amount of findings regarding how the brain deals with these information, two essential and still open questions are 1whether the neural circuit(s) for coding syntactic and semantic information embedded in our linguistic code are the same or different, and 2whether the possible interaction(s) between these two different types of information leaves a trace in the brain response. The current thesis seeks to segregate the neuro-anatomical substrates of these processes by taking advantage of the Spanish agreement system. This system comprised those procedural mechanisms concerning the regular assignment of the number [singular, plural], person [first, second and third] and/or gender [feminine, masculine] information, associated with different sentence constituents. Experimental manipulations concerning different agreement features and the elements involved in an agreement relation, allowed us to characterize the neural network underlying agreement processing. This thesis comprised five experiments: while experiments I and II explored nominal dependencies in local as well as non-local relations, experiments III, IV and V explored subject-verb relations in a more complex sentence context. To distinguish between purely syntactic mechanisms and those where semantic and syntactic factors would interact during language comprehension, different types of agreement relations and/or agreement features were manipulated in well- and ill-formed constructions. The interaction effect between the different factors included in each experiment was always the critical comparison. In general, our results include firstly a functional dissociation between well-formed and ill-formed constructions: while ill-formed constructions recruited a bilateral distributed fronto-parietal network associated to conflict monitoring operations, not language specific, well-formed constructions recruited a left lateralized fronto-temporo-parietal network that seems to be specifically related to different aspects of phrase and sentence processing. Secondly, there was an anterior to posterior functional gradient associated to the middle and superior temporal cortex that consistently appears across experiments. Specifically, while the posterior portion of the left MTG-STG seems to be related to the storage and retrieval of lexical and morpho-syntactic information, the anterior portion of this region was related to syntactic-combinatorial building mechanisms. Critically, in the most anterior part of the left temporal cortex, corresponding with the middle and superior temporal pole, form-to-meaning mapping processes seems to be represented. Thirdly, the response of the left temporal cortex appears to be controlled by left inferior frontal regions (LIFG). Finally, left parietal regions such us the angular gyrus showed increased activation for those manipulations involving semantic factors (e.g., conceptual gender and Unagreement constructions), highlighting its crucial role in the processing of different types of semantic information (e.g., conceptual integration and semantic-discourse integration). Overall, these findings highlight the sensitivity of the agreement system to syntactic and semantic factors embedded into an agreement relation, opening new windows to the study of agreement computation and language comprehension.bcbl: basque center on cognition, brain and languag

From minimal dependencies to sentence contexts: neural correlates of agreement processing

289 p.Language comprehension is incremental, involving the integration of formal and conceptual information from different words, together with the need to resolve conflicting cues when unexpected information occurs. However, despite the extensive amount of findings regarding how the brain deals with these information, two essential and still open questions are 1whether the neural circuit(s) for coding syntactic and semantic information embedded in our linguistic code are the same or different, and 2whether the possible interaction(s) between these two different types of information leaves a trace in the brain response. The current thesis seeks to segregate the neuro-anatomical substrates of these processes by taking advantage of the Spanish agreement system. This system comprised those procedural mechanisms concerning the regular assignment of the number [singular, plural], person [first, second and third] and/or gender [feminine, masculine] information, associated with different sentence constituents. Experimental manipulations concerning different agreement features and the elements involved in an agreement relation, allowed us to characterize the neural network underlying agreement processing. This thesis comprised five experiments: while experiments I and II explored nominal dependencies in local as well as non-local relations, experiments III, IV and V explored subject-verb relations in a more complex sentence context. To distinguish between purely syntactic mechanisms and those where semantic and syntactic factors would interact during language comprehension, different types of agreement relations and/or agreement features were manipulated in well- and ill-formed constructions. The interaction effect between the different factors included in each experiment was always the critical comparison. In general, our results include firstly a functional dissociation between well-formed and ill-formed constructions: while ill-formed constructions recruited a bilateral distributed fronto-parietal network associated to conflict monitoring operations, not language specific, well-formed constructions recruited a left lateralized fronto-temporo-parietal network that seems to be specifically related to different aspects of phrase and sentence processing. Secondly, there was an anterior to posterior functional gradient associated to the middle and superior temporal cortex that consistently appears across experiments. Specifically, while the posterior portion of the left MTG-STG seems to be related to the storage and retrieval of lexical and morpho-syntactic information, the anterior portion of this region was related to syntactic-combinatorial building mechanisms. Critically, in the most anterior part of the left temporal cortex, corresponding with the middle and superior temporal pole, form-to-meaning mapping processes seems to be represented. Thirdly, the response of the left temporal cortex appears to be controlled by left inferior frontal regions (LIFG). Finally, left parietal regions such us the angular gyrus showed increased activation for those manipulations involving semantic factors (e.g., conceptual gender and Unagreement constructions), highlighting its crucial role in the processing of different types of semantic information (e.g., conceptual integration and semantic-discourse integration). Overall, these findings highlight the sensitivity of the agreement system to syntactic and semantic factors embedded into an agreement relation, opening new windows to the study of agreement computation and language comprehension.bcbl: basque center on cognition, brain and languag