Putting things in new places: Linguistic experience modulates the predictive power of placement verb semantics

A central question regarding predictive language processing concerns the extent to which linguistic experience modulates the process. We approached this question by investigating sentence processing in advanced second language (L2) users with different native language (L1) backgrounds. Using a visual world eye tracking paradigm, we investigated to what extent L1 and L2 participants showed anticipatory eye movements to objects while listening to Dutch placement event descriptions. L2 groups differed in the degree of similarity between Dutch and their L1 with respect to placement verb semantics: German, like Dutch, specifies object position in placement verbs (put.STAND vs. put.LIE), whereas English and French typically leave position underspecified (put). Results showed that German L2 listeners, like native Dutch listeners, anticipate objects that match the verbally encoded position immediately upon encountering the verb. French/English L2 participants, however, did not show any prediction effects, despite proper understanding of Dutch placement verbs. Our findings suggest that prior experience with a specific semantic contrast in one’s L1 facilitates prediction in L2, and hence adds to the evidence that linguistic experience modulates predictive sentence processin

‘Right now, Sophie ∗swims in the pool?!’: Brain potentials of grammatical aspect processing.

We investigated whether brain potentials of grammatical aspect processing resemble semantic or morpho-syntactic processing, or whether they instead are characterized by an entirely distinct pattern in the same individuals. We studied aspect from the perspective of agreement between the temporal information in the context (temporal adverbials, e.g., Right now) and a morpho-syntactic marker of grammatical aspect (e.g., progressive is swimming). Participants read questions providing a temporal context that was progressive (What is Sophie doing in the pool right now?) or habitual (What does Sophie do in the pool every Monday?). Following a lead-in sentence context such as Right now, Sophie…, we measured event-related brain potentials (ERPs) time-locked to verb phrases in four different conditions, e.g., (a) is swimming (control); (b) ∗is cooking (semantic violation); (c) ∗are swimming (morpho-syntactic violation); or (d)?swims (aspect mismatch); …in the pool.” The collected ERPs show typical N400 and P600 effects for semantics and morpho-syntax, while aspect processing elicited an Early Negativity (250–350 ms). The aspect-related Negativity was short-lived and had a central scalp distribution with an anterior onset. This differentiates it not only from the semantic N400 effect, but also from the typical LAN (Left Anterior Negativity), that is frequently reported for various types of agreement processing. Moreover, aspect processing did not show a clear P600 modulation. We argue that the specific context for each item in this experiment provided a trigger for agreement checking with temporal information encoded on the verb, i.e., morphological aspect marking. The aspect-related Negativity obtained for aspect agreement mismatches reflects a violated expectation concerning verbal inflection (in the example above, the expected verb phrase was Sophie is X-ing rather than Sophie X-s in condition d). The absence of an additional P600 for aspect processing suggests that the mismatch did not require additional reintegration or processing costs. This is consistent with participants’ post hoc grammaticality judgements of the same sentences, which overall show a high acceptability of aspect mismatch sentences

Minding the manner: attention to motion events in Turkish–Dutch early bilinguals

Languages differ in the way motion events are encoded. In satellite-framed languages, motion verbs typically encode manner, while in verb-framed languages, path. We investigated the ways in which satellite-framed Dutch and verb-framed Turkish co-determine one’s attention to motion events in early bilinguals. In an EEG oddball paradigm, Turkish–Dutch bilinguals (n = 25) and Dutch controls (n = 27) watched short video clips of motion events, followed by a still picture that matched the preceding video in four ways (oddball design: 10% full match, 10% manner match, 10% endpoint match, and 70% full mismatch). We found that both groups showed similar oddball P300 effects, associated with task-related attention. Group differences were revealed in a late positivity (LP): The endpoint-match elicited a larger LP than the manner-match in the bilinguals, which may reflect language-driven attention. Our results indicate that cross-linguistic manner encoding difference impacts attention at a later stage

The Potential of Immersive Virtual Reality for the Study of Event Perception

In everyday life, we actively engage in different activities from a first-person perspective. However, experimental psychological research in the field of event perception is often limited to relatively passive, third-person computer-based paradigms. In the present study, we tested the feasibility of using immersive virtual reality in combination with eye tracking with participants in active motion. Behavioral research has shown that speakers of aspectual and non-aspectual languages attend to goals (endpoints) in motion events differently, with speakers of non-aspectual languages showing relatively more attention to goals (endpoint bias). In the current study, native speakers of German (non-aspectual) and English (aspectual) walked on a treadmill across 3-D terrains in VR, while their eye gaze was continuously tracked. Participants encountered landmark objects on the side of the road, and potential endpoint objects at the end of it. Using growth curve analysis to analyze fixation patterns over time, we found no differences in eye gaze behavior between German and English speakers. This absence of cross-linguistic differences was also observed in behavioral tasks with the same participants. Methodologically, based on the quality of the data, we conclude that our dynamic eye-tracking setup can be reliably used to study what people look at while moving through rich and dynamic environments that resemble the real world

Grammatical aspect influences motion event perception: Evidence from a cross-linguistic non-verbal recognition task

Using eye-tracking as a window on cognitive processing, this study investigates language effects on attention to motion events in a non-verbal task. We compare gaze allocation patterns by native speakers of German and Modern Standard Arabic (MSA), two languages that differ with regard to the grammaticalization of temporal concepts. Findings of the non-verbal task, in which speakers watch dynamic event scenes while performing an auditory distracter task, are compared to gaze allocation patterns which were obtained in an event description task, using the same stimuli. We investigate whether differences in the grammatical aspectual systems of German and MSA affect the extent to which endpoints of motion events are linguistically encoded and visually processed in the two tasks. In the linguistic task, we find clear language differences in endpoint encoding and in the eye-tracking data (attention to event endpoints) as well: German speakers attend to and linguistically encode endpoints more frequently than speakers of MSA. The fixation data in the non-verbal task show similar language effects, providing relevant insights with regard to the language-and-thought debate. The present study is one of the few studies that focus explicitly on language effects related to grammatical concepts, as opposed to lexical concepts