Negation in context: evidence from the visual world paradigm

Literature assumes that negation is more difficult to understand than affirmation, but this might depend on the pragmatic context. The goal of this paper is to show that pragmatic knowledge modulates the unfolding processing of negation due to the previous activation of the negated situation. To test this, we used the visual world paradigm. In this task, we presented affirmative (e.g., her dad was rich) and negative sentences (e.g., her dad was not poor) while viewing two images of the affirmed and denied entities. The critical sentence in each item was preceded by one of three types of contexts: an inconsistent context (e.g., She supposed that her dad had little savings) that activates the negated situation (a poor man), a consistent context (e.g., She supposed that her dad had enough savings) that activates the actual situation (a rich man), or a neutral context (e.g., her dad lived on the other side of town) that activates neither of the two models previously suggested. The results corroborated our hypothesis. Pragmatics is implicated in the unfolding processing of negation. We found an increase in fixations on the target compared to the baseline for negative sentences at 800 ms in the neutral context, 600 ms in the inconsistent context, and 1450 ms in the consistent context. Thus, when the negated situation has been previously introduced via an inconsistent context, negation is facilitated

Prediction during simultaneous interpreting:Evidence from the visual-world paradigm

We report the results of an eye-tracking study which used the Visual World Paradigm (VWP) to investigate the time-course of prediction during a simultaneous interpreting task. Twenty-four L1 French professional conference interpreters and twenty-four L1 French professional translators untrained in simultaneous interpretation listened to sentences in English and interpreted them simultaneously into French while looking at a visual scene. Sentences contained a highly predictable word (e.g., The dentist asked the man to open his mouth a little wider). The visual scene comprised four objects, one of which depicted either the target object (mouth; bouche), an English phonological competitor (mouse; souris), a French phonological competitor (cork; bouchon), or an unrelated word (bone; os). We considered 1) whether interpreters and translators predict upcoming nouns during a simultaneous interpreting task, 2) whether interpreters and translators predict the form of these nouns in English and in French and 3) whether interpreters and translators manifest different predictive behaviour. Our results suggest that both interpreters and translators predict upcoming nouns, but neither group predicts the word-form of these nouns. In addition, we did not find significant differences between patterns of prediction in interpreters and translators. Thus, evidence from the visual-world paradigm shows that prediction takes place in simultaneous interpreting, regardless of training and experience. However, we were unable to establish whether word-form was predicted

Comparing infrared and webcam eye tracking in the Visual World Paradigm

Visual World eye tracking is a temporally fine-grained method of monitoring attention, making it a popular tool in the study of online sentence processing. Recently, while infrared eye tracking was mostly unavailable, various web-based experiment platforms have rapidly developed webcam eye tracking functionalities, which are now in urgent need of testing and evaluation. We replicated a recent Visual World study on the incremental processing of verb aspect in English using ‘out of the box’ webcam eye tracking software (jsPsych; de Leeuw, 2015) and crowdsourced participants, and fully replicated both the offline and online results of the original study. We furthermore discuss factors influencing the quality and interpretability of webcam eye tracking data, particularly with regards to temporal and spatial resolution; and conclude that remote webcam eye tracking can serve as an affordable and accessible alternative to lab-based infrared eye tracking, even for questions probing the time-course of language processing

The effect of salience on Chinese pun comprehension : a visual world paradigm study

The present study adopted the printed-word visual world paradigm to investigate the salience effect on Chinese pun comprehension. In such an experiment, participants listen to a spoken sentence while looking at a visual display of four printed words (including a semantic competitor, a phonological competitor, and two unrelated distractors). Previous studies based on alphabetic languages have found robust phonological effects (participants fixated more at phonological competitors than distractors during the unfolding of the spoken target words), while controversy remains regarding the existence of a similar semantic effect. A recent Chinese study reported reliable semantic effects in two experiments using this paradigm, suggesting that Chinese participants could actively map the semantic input from the auditory modality with the semantic information retrieved from printed words. In light of their study, we designed an experiment with two conditions: a replication condition to test the validity of using the printed-word world paradigm in Chinese semantic research, and a pun condition to assess the role played by salience during pun comprehension. Indeed, global analyses have revealed robust semantic effects in both experimental conditions, where participants were found more attracted to the semantic competitors than to the distractors with the emergence of target words. More importantly, the local analyses from the pun condition have shown that the participants were more attracted to the semantic competitors related to the salient meaning of the ambiguous word in a pun than to those related to the less salient meanings within 200 ms after target word offset. This finding suggests that the salient meaning of the ambiguous word in a pun is activated and assessed faster than its less salient counterpart. The initial advantage observed in the present study is consistent with the prediction of the graded salience hypothesis rather than the direct access model

Tracking Eye Movements as a Window on Language Processing: The Visual World Paradigm

This entry overviews the pioneering experimental studies exploiting eye movement data to investigate language processing in real time. After examining how vision and language were found to be closely related, herein focus the discussion on the evolution of eye-tracking methodologies to investigate children’s language development. To conclude, herein provide some insights about the use of eye-tracking technology for research purposes, focusing on data collection and data analysis

Prediction in the processing of repair disfluencies: Evidence from the visual-world paradigm

Two visual-world eye-tracking experiments investigated the role of prediction in the processing of repair disfluencies (e.g., “The chef reached for some salt uh I mean some ketchup . . .”). Experiment 1 showed that listeners were more likely to fixate a critical distractor item (e.g., pepper) during the processing of repair disfluencies compared with the processing of coordination structures (e.g., “. . . some salt and also some ketchup . . .”). Experiment 2 replicated the findings of Experiment 1 for disfluency versus coordination constructions and also showed that the pattern of fixations to the critical distractor for disfluency constructions was similar to the fixation patterns for sentences employing contrastive focus (e.g., “. . . not some salt but rather some ketchup . . .”). The results suggest that similar mechanisms underlie the processing of repair disfluencies and contrastive focus, with listeners generating sets of entities that stand in semantic contrast to the reparandum in the case of disfluencies or the negated entity in the case of contrastive focus

Anaphora resolution and reanalysis during L2 sentence processing: evidence from the visual world paradigm

In a visual world paradigm study, we manipulated gender congruence between a subject pronoun and two antecedents to investigate whether L2 learners with a null subject first language (L1) acquire and process overt subject pronouns in a non-null subject L2 in a nativelike way. We also investigated whether L2 speakers revise an initial interpretation assigned to an ambiguous pronoun when information in the visual context subsequently biased against it. Our results indicated both L1 English speakers and Greek L2 English speakers rapidly used gender information to guide pronoun resolution. Both groups also preferentially coindexed ambiguous pronouns to a sentence subject and current discourse topic, despite the fact that overt subject pronouns in the learners’ L1 index a topic shift. We also observed that L2 English speakers were less likely to revise their initial interpretation than L1 English speakers. These results indicate that L2 speakers from a null subject background can acquire the interpretive preferences of overt pronouns in a non-null subject L2. The eye-movement data indicate that anaphora processing can become qualitatively similar in native and non-native speakers in the domain of subject pronoun resolution, but indicate reanalysis may cause difficulty during L2 processing

Negation affects processing of correct and incorrect information: A visual world paradigm for misinformation

The current study investigated how language changes the meaning of facts. Much is known about the acquiring of misconceptions, but little is known about how subtle changes in language affect the retrieval of accurate facts and misconceptions. Participants read vignettes and were exposed to four different kinds of texts that varied by affirmative or negated and whether the fact was true or false. After participants read several of these facts, their eye movements were tracked in a visual world paradigm with 4 written plausible answers on the screen in each corner to choose from. Fixations to each kind of response were recorded and presence of misinformation was found to temper the processing of misconceptions and led to an observed suppression of inaccurate information. Mechanisms of processing true and false concepts and the interplay between language and conceptual formation are discussed

On-line processing of English which-questions by children and adults: a visual world paradigm study

Previous research has shown that children demonstrate similar sentence processing reflexes to those observed in adults, but they have difficulties revising an erroneous initial interpretation when they process garden-path sentences, passives, and wh -questions. We used the visual-world paradigm to examine children's use of syntactic and non-syntactic information to resolve syntactic ambiguity by extending our understanding of number features as a cue for interpretation to which -subject and which -object questions. We compared children's and adults’ eye-movements to understand how this information shapes children's commitment to and revision of possible interpretations of these questions. The results showed that English-speaking adults and children both exhibit an initial preference to interpret an object- which question as a subject question. While adults quickly override this preference, children take significantly longer, showing an overall processing difficulty for object questions. Crucially, their recovery from an initially erroneous interpretation is speeded when disambiguating number agreement features are present