Predictability's aftermath: Downstream consequences of word predictability as revealed by repetition effects

Stimulus processing in language and beyond is shaped by context, with predictability having a particularly well-attested influence on the rapid processes that unfold during the presentation of a word. But does predictability also have downstream consequences for the quality of the constructed representations? On the one hand, the ease of processing predictablewordsmight free up time or cognitive resources, allowing for relatively thorough processing of the input. On the other hand, predictabilitymight allowthe systemto run in a top-down “verificationmode”, at the expense of thorough stimulus processing. This electroencephalogram (EEG) study manipulated word predictability, which reduced N400 amplitude and inter-trial phase clustering (ITPC), and then probed the fate of the (un)predictable words in memory by presenting them again. More thorough processing of predictable words should increase repetition effects, whereas less thorough processing should decrease them. Repetition was reflected in N400 decreases, late positive complex (LPC) enhancements, and late alpha/beta band power decreases. Critically, prior predictability tended to reduce the repetition effect on the N400, suggesting less priming, and eliminated the repetition effect on the LPC, suggesting a lack of episodic recollection. These findings converge on a top-down verification account, on which the brain processes more predictable input less thoroughly. More generally, the results demonstrate that predictability hasmultifaceted downstreamconsequences beyond processing in the momen

Communicating hands: ERPs elicited by meaningful symbolic hand postures.

Meaningful and meaningless hand postures were presented to subjects who had to carry out a semantic discrimination task while electrical brain responses were recorded. Both meaningful and control sets of hand postures were matched as closely as possible. The ERPs elicited by meaningless hand postures showed an anteriorly distributed N300 and a centro-posteriorly distributed N400 component. The N300 probably reflects picture-specific processes, whereas the N400-effect probably reflects processing in an amodal semantic network. The scalp-distribution of the N400-effect, which is more posterior than usually reported in picture processing, suggests that the semantic representations of the concepts expressed by meaningful hand postures have similar properties to those of abstract words

Task demands modulate decision and eye movement responses in the chimeric face test: examining the right hemisphere processing account

A large and growing body of work, conducted in both brain-intact and brain-damaged populations, has used the free viewing chimeric face test as a measure of hemispheric dominance for the extraction of emotional information from faces. These studies generally show that normal right-handed individuals tend to perceive chimeric faces as more emotional if the emotional expression is presented on the half of the face to the viewer's left (“left hemiface”). However, the mechanisms underlying this lateralized bias remain unclear. Here, we examine the extent to which this bias is driven by right hemisphere processing advantages vs. default scanning biases in a unique way—by changing task demands. In particular, we compare the original task with one in which right-hemisphere-biased processing cannot provide a decision advantage. Our behavioral and eye movement data are inconsistent with the predictions of a default scanning bias account and support the idea that the left hemiface bias found in the chimeric face test is largely due to strategic use of right hemisphere processing mechanisms

Reanalyzing language expectations: Native language knowledge modulates the sensitivity to intervening cues during anticipatory processing

Issue Online:21 September 2018We investigated how native language experience shapes anticipatory language processing. Two groups of bilinguals (either Spanish or Basque natives) performed a word matching task (WordMT) and a picture matching task (PictureMT). They indicated whether the stimuli they visually perceived matched with the noun they heard. Spanish noun endings were either diagnostic of the gender (transparent) or ambiguous (opaque). ERPs were time-locked to an intervening gender-marked determiner preceding the predicted noun. The determiner always gender agreed with the following noun but could also introduce a mismatching noun, so that it was not fully task diagnostic. Evoked brain activity time-locked to the determiner was considered as reflecting updating/reanalysis of the task-relevant preactivated representation. We focused on the timing of this effect by estimating the comparison between a gender-congruent and a gender-incongruent determiner. In the WordMT, both groups showed a late N400 effect. Crucially, only Basque natives displayed an earlier P200 effect for determiners preceding transparent nouns. In the PictureMT, both groups showed an early P200 effect for determiners preceding opaque nouns. The determiners of transparent nouns triggered a negative effect at similar to 430 ms in Spanish natives, but at similar to 550 ms in Basque natives. This pattern of results supports a "retracing hypothesis" according to which the neurocognitive system navigates through the intermediate (sublexical and lexical) linguistic representations available from previous processing to evaluate the need of an update in the linguistic expectation concerning a target lexical item.Spanish Ministry of Economy and Competitiveness (MINECO), Agencia Estatal de Investigación (AEI), Fondo Europeo de Desarrollo Regional (FEDER) (grant PSI2015‐65694‐P to N. M.), Spanish Ministry of Economy and Competitiveness “Severo Ochoa” Programme for Centres/Units of Excellence in R&D (grant SEV‐2015‐490

Anticipation in real-world scenes: The role of visual context and visual memory

The human sentence processor is able to make rapid predictions about upcoming linguistic input. For example, upon hearing the verb eat, anticipatory eye-movements are launched toward edible objects in a visual scene (Altmann & Kamide, 1999). However, the cognitive mechanisms that underlie anticipation remain to be elucidated in ecologically valid contexts. Previous research has, in fact, mainly used clip-art scenes and object arrays, raising the possibility that anticipatory eye-movements are limited to displays containing a small number of objects in a visually impoverished context. In Experiment 1, we confirm that anticipation effects occur in real-world scenes and investigate the mechanisms that underlie such anticipation. In particular, we demonstrate that real-world scenes provide contextual information that anticipation can draw on: When the target object is not present in the scene, participants infer and fixate regions that are contextually appropriate (e.g., a table upon hearing eat). Experiment 2 investigates whether such contextual inference requires the co-presence of the scene, or whether memory representations can be utilized instead. The same real-world scenes as in Experiment 1 are presented to participants, but the scene disappears before the sentence is heard. We find that anticipation occurs even when the screen is blank, including when contextual inference is required. We conclude that anticipatory language processing is able to draw upon global scene representations (such as scene type) to make contextual inferences. These findings are compatible with theories assuming contextual guidance, but posit a challenge for theories assuming object-based visual indices

World knowledge and novel information integration during L2speech comprehension.

Published online: 22 January 2016In this study we explore whether world knowledge (WK) processing differs between individuals listening to their native (L1) or their non-native (L2) language. We recorded event-related brain potentials in L1 and L2 speakers of Spanish while they listened to sentences uttered by native speakers of Spanish. Sentences were either congruent or incongruent with participants’ WK. In addition, participants also listened to sentences in which upcoming words could not be anticipated on the basis of WK. WK violations elicited a late negativity of greater magnitude and duration in the L2 than the L1 group. However, sentences in which WK was not helpful regarding word anticipation elicited similar N400 modulations in both groups. These results suggest that WK processing requires a deeper lexical search in L2 comprehension than in L1 comprehensionThis research was approved by the ethics committee of the Spanish Ministry of Economy and Finance, which funded this study.We thank Silvia Blanch and Xavier Mayoral for their technical support, and Meritxell Ayguasanosa for assistance in testing participants. This research was funded by an FPI grant (BES-2012-056668) and two project grants (PSI2011-23033 and Consolider INGENIO CSD2007- 00012) awarded by the Spanish Government; by one grant from the Catalan Government (SGR 2009-1521); and by one grant from the European Research Council under the European Community’s Seventh Framework (FP7/2007-2013 Cooperation grant agreement 613465-AThEME). C.D.M. is supported by the IKERBASQUE institution and the Basque Center on Cognition, Brain and Language. A.C. is supported by the ICREA institution and the Center for Brain and Cognition

Foreign-accented speech modulates linguistic anticipatory processes

Available online 25 March 2016Listeners are able to anticipate upcoming words during sentence comprehension, and, as a result, they also pre-activate semantically related words. In the present study, we aim at exploring whether these anticipatory processes are modulated by indexical properties of the speakers, such as a speaker's accent. Event-related brain potentials were obtained while native speakers of Spanish listened to native (Experiment 1) or foreign-accented speakers (Experiment 2) of Spanish producing highly constrained sentences. The sentences ended in: (1) the highest cloze probability completion, (2) a word semantically related to the expected ending, or (3) a word with no semantic overlap with the expected ending. In Experiment 1, we observed smaller N400 mean amplitudes for the semantically related words as compared to the words with no semantic overlap, replicating previous findings. In Experiment 2, we observed no difference in integrating semantically related and unrelated words when listening to accented speech. These results suggest that linguistic anticipatory processes are affected by indexical properties of the speakers, such as the speaker's accent.This research was funded by an FPI Grant(BES-2012- 056668)and three project Grants(PSI2014-54500,PSI2011-23033 and Consolider INGENIO CSD2007-00012)awarded by the Spanish Government;by one grant from the Catalan Government(SGR 2014-1210); by one grant from the Basque Government (PI_2015_1_25); and by one grant from the European Research Council under the European Community's Seventh Framework (FP7/2007-2013 Cooperation grant agreement 613465-AThEME). C.D.M. is supported by the IKERBASQUE Institution,the Basque Center on Cognition,Brain and Language,and by the Severo Ochoa Program Grant SEV-2015-049. A.Caecostenetroides is supported by the ICREA Institution and the Center for Brain and Cognition

“If a lion could speak …”: Online sensitivity to propositional truth-value of unrealistic counterfactual sentences

People can establish whether a sentence is hypothetically true even if what it describes can never be literally true given the laws of the natural world. Two event-related potential (ERP) experiments examined electrophysiological responses to sentences about unrealistic counterfactual worlds that require people to construct novel conceptual combinations and infer their consequences as the sentence unfolds in time (e.g., “If dogs had gills…”). Experiment 1 established that without this premise, described consequences (e.g., “Dobermans would breathe under water …”) elicited larger N400 responses than real-world true sentences. Incorporation of the counterfactual premise in Experiment 2 generated similar N400 effects of propositional truth-value in counterfactual and real-world sentences, suggesting that the counterfactual context eliminated the interpretive problems posed by locally anomalous sentences. This result did not depend on cloze probability of the sentences. In contrast to earlier findings regarding online comprehension of logical operators and counterfactuals, these results show that ongoing processing can be directly impacted by propositional truth-value, even that of unrealistic counterfactuals

Towards a shared ontology: a generic classification of cognitive processes in conceptual design

Towards addressing ontological issues in design cognition research, this paper presents the first generic classification of cognitive processes investigated in protocol studies on conceptual design cognition. The classification is based on a systematic review of 47 studies published over the past 30 years. Three viewpoints on the nature of design cognition are outlined (search, exploration and design activities), highlighting considerable differences in the concepts and terminology applied to describe cognition. To provide a more unified view of the cognitive processes fundamentally under study, we map specific descriptions of cognitive processes provided in protocol studies to more generic, established definitions in the cognitive psychology literature. This reveals a set of 6 categories of cognitive process that appear to be commonly studied and are therefore likely to be prevalent in conceptual design: (1) long-term memory; (2) semantic processing; (3) visual perception; (4) mental imagery processing; (5) creative output production and (6) executive functions. The categories and their constituent processes are formalised in the generic classification. The classification provides the basis for a generic, shared ontology of cognitive processes in design that is conceptually and terminologically consistent with the ontology of cognitive psychology and neuroscience. In addition, the work highlights 6 key avenues for future empirical research: (1) the role of episodic and semantic memory; (2) consistent definitions of semantic processes; (3) the role of sketching from alternative theoretical perspectives on perception and mental imagery; (4) the role of working memory; (5) the meaning and nature of synthesis and (6) unidentified cognitive processes implicated in conceptual design elsewhere in the literature