Event-related brain potential evidence for animacy processing asymmetries during sentence comprehension

The animacy distinction is deeply rooted in the language faculty. A key example is differential object marking, the phenomenon where animate sentential objects receive specific marking. We used event-related potentials to examine the neural processing consequences of case-marking violations on animate and inanimate direct objects in Spanish. Inanimate objects with incorrect prepositional case marker ‘a’ (‘al suelo’) elicited a P600 effect compared to unmarked objects, consistent with previous literature. However, animate objects without the required prepositional case marker (‘el obispo’) only elicited an N400 effect compared to marked objects. This novel finding, an exclusive N400 modulation by a straightforward grammatical rule violation, does not follow from extant neurocognitive models of sentence processing, and mirrors unexpected “semantic P600” effects for thematically problematic sentences. These results may reflect animacy asymmetry in competition for argument prominence: following the article, thematic interpretation difficulties are elicited only by unexpectedly animate objects

Sentence context prevails over word association in aphasia patients with spared comprehension : evidence from N400 event-related potential

Behavioral and event-related potential (ERP) studies on aphasia patients showed that lexical information is not lost but rather its integration into the working context is hampered. Studies have been conducted on the processing of sentence-level information (meaningful versus meaningless) and of word-level information (related versus unrelated) in aphasia patients, but we are not aware of any study that assesses the relationship between the two. In healthy subjects the processing of a single word in a sentence context has been studied using the N400 ERP. It was shown that, even when there is only a weak expectation of a final word in a sentence, this expectation will dominate word relatedness. In order to study the effect of semantic relatedness between words in sentence processing in aphasia patients, we conducted a crossed design ERP study, crossing the factors of word relatedness and sentence congruity. We tested aphasia patients with mild to minimum comprehension deficit and healthy young and older (age-matched with our patients) controls on a semantic anomaly judgment task when simultaneously recording EEG. Our results show that our aphasia patient's N400 amplitudes in response to the sentences of our crossed-design study were similar to those of our age-matched healthy subjects. However, we detected an increase in the N400 ERP latency in those patients, indicating a delay in the integration of the new word into the working context. Additionally, we observed a positive correlation between comprehension level of those patients and N400 effect in response to meaningful sentences without word relatedness contrasted to meaningless sentences without word relatedness

An event-related potential study on changes of violation and error responses during morphosyntactic learning

Based on recent findings showing electrophysiological changes in adult language learners after relatively short periods of training, we hypothesized that adult Dutch learners of German would show responses to German gender and adjective declension violations after brief instruction. Adjective declension in German differs from previously studied morphosyntactic regularities in that the required suffixes depend not only on the syntactic case, gender, and number features to be expressed, but also on whether or not these features are already expressed on linearly preceding elements in the noun phrase. Violation phrases and matched controls were presented over three test phases (pretest and training on the first day, and a posttest one week later). During the pretest, no electrophysiological differences were observed between violation and control conditions, and participants’ classification performance was near chance. During the training and posttest phases, classification improved, and there was a P600-like violation response to declension but not gender violations. An error-related response during training was associated with improvement in grammatical discrimination from pretest to posttest. The results show that rapid changes in neuronal responses can be observed in adult learners of a complex morphosyntactic rule, and also that error-related electrophysiological responses may relate to grammar acquisition

Is the LAN effect in morphosyntactic processing an ERP artifact?

Available online 4 February 2019.The left anterior negativity (LAN) is an ERP component that has been often associated with morphosyntactic processing, but recent reports have questioned whether the LAN effect, in fact, exists. The present project examined whether the LAN effect, observed in the grand average response to local agreement violations, is the result of the overlap between two different ERP effects (N400, P600) at the level of subjects (n = 80), items (n = 120), or trials (n = 6160). By-subject, by-item, and by-trial analyses of the ERP effect between 300 and 500 ms showed a LAN for 55% of the participants, 46% of the items, and 49% of the trials. Many examples of the biphasic LAN-P600 response were observed. Mixed-linear models showed that the LAN effect size was not reduced after accounting for subject variability. The present results suggest that there are cases where the grand average LAN effect represents the brain responses of individual participants, items, and trials.This work was supported by the Spanish Ministry [PSI 2014-54500- P; IJCI-2016-27702; PSI2017-82941-P]; the Basque Government [PI_2015_1_25]; and the Severo Ochoa [SEV-2015-0490]

p600 Plays Essential Roles in Fetal Development

p600 is a multifunctional protein implicated in cytoskeletal organization, integrin-mediated survival signaling, calcium-calmodulin signaling and the N-end rule pathway of ubiquitin-proteasome-mediated proteolysis. While push, the Drosophila counterpart of p600, is dispensable for development up to adult stage, the role of p600 has not been studied during mouse development. Here we generated p600 knockout mice to investigate the in vivo functions of p600. Interestingly, we found that homozygous deletion of p600 results in lethality between embryonic days 11.5 and 13.5 with severe defects in both embryo and placenta. Since p600 is required for placental development, we performed conditional disruption of p600, which deletes selectively p600 in the embryo but not in the placenta. The conditional mutant embryos survive longer than knockout embryos but ultimately die before embryonic day 14.5. The mutant embryos display severe cardiac problems characterized by ventricular septal defects and thin ventricular walls. These anomalies are associated with reduced activation of FAK and decreased expression of MEF2, which is regulated by FAK and plays a crucial role in cardiac development. Moreover, we observed pleiotropic defects in the liver and brain. In sum, our study sheds light on the essential roles of p600 in fetal development

Understanding language-elicited EEG data by predicting it from a fine-tuned language model

Electroencephalography (EEG) recordings of brain activity taken while participants read or listen to language are widely used within the cognitive neuroscience and psycholinguistics communities as a tool to study language comprehension. Several time-locked stereotyped EEG responses to word-presentations -- known collectively as event-related potentials (ERPs) -- are thought to be markers for semantic or syntactic processes that take place during comprehension. However, the characterization of each individual ERP in terms of what features of a stream of language trigger the response remains controversial. Improving this characterization would make ERPs a more useful tool for studying language comprehension. We take a step towards better understanding the ERPs by fine-tuning a language model to predict them. This new approach to analysis shows for the first time that all of the ERPs are predictable from embeddings of a stream of language. Prior work has only found two of the ERPs to be predictable. In addition to this analysis, we examine which ERPs benefit from sharing parameters during joint training. We find that two pairs of ERPs previously identified in the literature as being related to each other benefit from joint training, while several other pairs of ERPs that benefit from joint training are suggestive of potential relationships. Extensions of this analysis that further examine what kinds of information in the model embeddings relate to each ERP have the potential to elucidate the processes involved in human language comprehension.Comment: To appear in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistic

Inconsistent use of gesture space during abstract pointing impairs language comprehension

Pointing toward concrete objects is a well-known and efficient communicative strategy. Much less is known about the communicative effectiveness of abstract pointing where the pointing gestures are directed to “empty space.” McNeill's (2003) observations suggest that abstract pointing can be used to establish referents in gesture space, without the referents being physically present. Recently, however, it has been shown that abstract pointing typically provides redundant information to the uttered speech thereby suggesting a very limited communicative value (So et al., 2009). In a first approach to tackle this issue we were interested to know whether perceivers are sensitive at all to this gesture cue or whether it is completely discarded as irrelevant add-on information. Sensitivity to for instance a gesture-speech mismatch would suggest a potential communicative function of abstract pointing. Therefore, we devised a mismatch paradigm in which participants watched a video where a female was interviewed on various topics. During her responses, she established two concepts in space using abstract pointing (e.g., pointing to the left when saying Donald, and pointing to the right when saying Mickey). In the last response to each topic, the pointing gesture accompanying a target word (e.g., Donald) was either consistent or inconsistent with the previously established location. Event related brain potentials showed an increased N400 and P600 when gesture and speech referred to different referents, indicating that inconsistent use of gesture space impairs language comprehension. Abstract pointing was found to influence comprehension even though gesture was not crucial to understanding the sentences or conducting the experimental task. These data suggest that a referent was retrieved via abstract pointing and that abstract pointing can potentially be used for referent indication in a discourse. We conclude that abstract pointing has a potential communicative function

Beyond gender stereotypes in language comprehension: self sex-role descriptions affect the brain’s potentials associated with agreement processing

We recorded Event-Related Potentials to investigate differences in the use of gender information during the processing of reflexive pronouns. Pronouns either matched the gender provided by role nouns (such as “king” or “engineer”) or did not. We compared two types of gender information, definitional information, which is semantic in nature (a mother is female), or stereotypical (a nurse is likely to be female). When they followed definitional role-nouns, gender-mismatching pronouns elicited a P600 effect reflecting a failure in the agreement process. When instead the gender violation occurred after stereotypical role-nouns the Event Related Potential response was biphasic, being positive in parietal electrodes and negative in anterior left electrodes. The use of a correlational approach showed that those participants with more “feminine” or “expressive” self sex-role descriptions showed a P600 response for stereotype violations, suggesting that they experienced the mismatch as an agreement violation; whereas less “expressive” participants showed an Nref effect, indicating more effort spent in linking the pronouns with the possible, although less likely, counter-stereotypical referent