Effects of Emotional State on Processing Conceptual Mismatches: ERPs in a Picture-Sentence Matching Task

Event-related potential (ERP) studies demonstrated that emotional state immediately affects the processing of different linguistic mismatches (e.g., semantic and syntactic mismatches) in sentences. Furthermore, mood has been shown to impact discourse processing. In these studies, a strong expectancy was evoked by a linguistic context. In the present study, a strong expectancy was induced by a visual (non-linguistic) context paired with a sentence. A spatial array was followed by a sentence that matched (□○—The square stands in front of the circle) or mismatched the picture (intra-dimensional mismatch: □○—The square stands behind the circle; extra-dimensional mismatch: □○—The square stands above the circle). The main question was whether mood effects on the processing of visually induced expectancies are similar or different from mood effects on the processing of linguistically induced expectancies. To this aim, we presented conceptual (mis)matches that differed in saliency: intra-dimensional vs. extra-dimensional mismatches which are both reported to elicit an N2b/N400 and P600, reflecting reanalysis. EEG was recorded while participants read for comprehension. Mood (happy vs. sad) was effectively induced by film clips. Neither for N2b/N400 nor for P600, an interaction between mood and match was observed. Thus, in contrast with studies investigating the effects of pure linguistic mismatches (linguistic context paired with unexpected lexical item), mood did not modulate the processing of conceptual mismatches. However, a main effect of match revealed different ERP patterns for the two mismatches. While an increase in N2b/ N400 occurred for the intra-dimensional and extra-dimensional mismatches, a P600 only occurred to the extra-dimensional (more salient) mismatches. This finding is taken as support that being in an emotional state (positive or negative mood) influences processes of reanalysis. That is, when being in an emotional state, a reanalysis (monitoring) process is exclusively triggered by salient mismatches.status: publishe

Are we ON the same page? Monolingual and bilingual acquisition of familiar and novel relational language

Verbs and prepositions pose significant challenges in second language learning, as languages differ in how they map these relational terms onto events. Second language learners must put aside their language-specific lens to uncover how a new language operates, perhaps having to rediscover semantic distinctions typically ignored in the first language. The current study examines how the acquisition of these novel mappings are affected by characteristics of the learner and of the language to be learned. English monolinguals and Dutch- English bilinguals learned novel terms that corresponded to containment and support relations of either English, Dutch, or Japanese. Results show that English distinctions are learned best across groups, potentially reflecting predispositions in human cognition. No differences were found between monolinguals and bilinguals in any language condition. The characteristics of the language to be learned appear to play a prominent role in the acquisition of novel semantic categories

The Interplay between Prosody and Syntax in Sentence Processing: The case of subject-control versus object-control verbs

Contains fulltext : 90630.pdf (publisher's version ) (Open Access)This study addresses the question whether prosodic information can affect the choice for a syntactic analysis in auditory sentence processing. We manipulated the prosody (in the form of a prosodic break; PB) of locally ambiguous Dutch sentences to favor one of two interpretations. The experimental items contained two different types of so-called control verbs (subject and object control) in the matrix clause and were syntactically disambiguated by a transitive or by an intransitive verb. In Experiment 1, we established the default off-line preference of the items for a transitive or an intransitive disambiguating verb with a visual and an auditory fragment completion test. The results suggested that subject- and object-control verbs differently affect the syntactic structure that listeners expect. In Experiment 2, we investigated these two types of verbs separately in an on-line ERP study. Consistent with the literature, the PB elicited a closure positive shift. Furthermore, in subject-control items, an N400 effect for intransitive relative to transitive disambiguating verbs was found, both for sentences with and for sentences without a PB. This result suggests that the default preference for subject-control verbs goes in the same direction as the effect of the PB. In object-control items, an N400 effect for intransitive relative to transitive disambiguating verbs was found for sentences with a PB but no effect in the absence of a PB. This indicates that a PB can affect the syntactic analysis that listeners pursue

Contributions of emotional state and attention to the processing of syntactic agreement errors: Evidence from P600

© 2015 Verhees, Chwilla, Tromp and Vissers. The classic account of language is that language processing occurs in isolation from other cognitive systems, like perception, motor action and emotion. The central theme of this paper is the relationship between a participant's emotional state and language comprehension. Does emotional context affect how we process neutral words? Recent studies showed that processing of word meaning - traditionally conceived as an automatic process - is affected by emotional state. The influence of emotional state on syntactic processing is less clear. One study reported a mood-related P600 modulation, while another study did not observe an effect of mood on syntactic processing. The goals of this study were: First, to clarify whether and if so how mood affects syntactic processing. Second, to shed light on the underlying mechanisms by separating possible effects of mood from those of attention on syntactic processing. ERPs were recorded while participants read syntactically correct or incorrect sentences. Mood (happy vs. sad) was manipulated by presenting film clips. Attention was manipulated by directing attention to syntactic features vs. physical features. The mood induction was effective. Interactions between mood, attention and syntactic correctness were obtained, showing that mood and attention modulated P600. The mood manipulation led to a reduction in P600 for sad as compared to happy mood when attention was directed at syntactic features. The attention manipulation led to a reduction in P600 when attention was directed at physical features compared to syntactic features for happy mood. From this we draw two conclusions: First, emotional state does affect syntactic processing. We propose mood-related differences in the reliance on heuristics as the underlying mechanism. Second, attention can contribute to emotion-related ERP effects in syntactic language processing. Therefore, future studies on the relation between language and emotion will have to control for effects of attention.status: publishe

EEG data for "Conversation electrified: ERP correlates of speech act recognition in underspecified utterances"

<p>Please refer to the publication in Plos One for a description of the experiment and data analysis:   Gisladottir RS, Chwilla DJ, Levinson SC (2015) Conversation Electrified: ERP Correlates of Speech Act Recognition in Underspecified Utterances. PLoS ONE 10(3): e0120068. doi: 10.1371/journal.pone.0120068</p

Early utterance time-window.

<p>A) Grand-averaged ERPs time-locked to the onset of the first word. Representative electrodes showing the relevant effects are highlighted in dashed boxes. B) Scalp distribution of the ERP effects in the early utterance time-window. All waveforms were low-pass filtered (10 Hz) for illustration purposes only. Negativity is plotted upwards.</p

Timeline.

<p>Mean onset of the first word, verb and final word in target utterances and a rough timeline for the early and late utterance time-windows.</p