Situation models, mental simulations, and abstract concepts in discourse comprehension

This article sets out to examine the role of symbolic and sensorimotor representations in discourse comprehension. It starts out with a review of the literature on situation models, showing how mental representations are constrained by linguistic and situational factors. These ideas are then extended to more explicitly include sensorimotor representations. Following Zwaan and Madden (2005), the author argues that sensorimotor and symbolic representations mutually constrain each other in discourse comprehension. These ideas are then developed further to propose two roles for abstract concepts in discourse comprehension. It is argued that they serve as pointers in memory, used (1) cataphorically to integrate upcoming information into a sensorimotor simulation, or (2) anaphorically integrate previously presented information into a sensorimotor simulation. In either case, the sensorimotor representation is a specific instantiation of the abstract concept

The influence of direct and indirect speech on source memory

People perceive the same situation described in direct speech (e.g., John said, “I like the food at this restaurant”) as more vivid and perceptually engaging than described in indirect speech (e.g., John said that he likes the food at the restaurant). So, if direct speech enhances the perception of vividness relative to indirect speech, what are the effects of using indirect speech? In four experiments, we examined whether the use of direct and indirect speech influences the comprehender’s memory for the identity of the speaker. Participants read a direct or an indirect speech version of a story and then addressed statements to one of the four protagonists of the story in a memory task. We found better source memory at the level of protagonist gender after indirect than direct speech (Exp. 1–3). When the story was rewritten to make the protagonists more distinctive, we also found an effect of speech type on source memory at the level of the individual, with better memory after indirect than direct speech (Exp. 3–4). Memory for the content of the story, however, was not influenced by speech type (Exp. 4). While previous research showed that direct speech may enhance memory for how something was said, we conclude that indirect speech enhances memory for who said what

Hand Shape Affects Access to Memories

The present study examined the ways that body posture facilitated retrieval of autobiographical memories in more detail by focusing on two aspects of congruence in position of a specific body part: hand shape and hand orientation. Hand shape is important in the tactile perception and manipulation of objects. We manipulated two aspects of hand shape: orientation (vertical vs. horizontal) and aperture (grip vs. no-grip). We manipulated orientation and aperture to create memory-congruent and memory-incongruent hand shapes. For example, a horizontal-grip shape is congruent with pushing a shopping cart, but inconsistent with doing a karate chop. We predicted that memory-congruent hand shapes would produce faster access to autobiographical memories than memory-incongruent hand shapes

Is color an integral part of a rich mental simulation?

Research suggests that language comprehenders simulate visual features such as shape during language comprehension. In sentence-picture verification tasks, whenever pictures match the shape or orientation implied by the previous sentence, responses are faster than when the pictures mismatch implied visual aspects. However, mixed results have been demonstrated when the sentence-picture paradigm was applied to color (Connell, Cognition, 102(3), 476–485, 2007; Zwaan & Pecher, PLOS ONE, 7(12), e51382, 2012). One of the aims of the current investigation was to resolve this issue. This was accomplished by conceptually replicating the original study on color, using the same paradigm but a different stimulus set. The second goal of this study was to assess how much perceptual information is included in a mental simulation. We examined this by reducing color saturation, a manipulation that does not sacrifice object identifiability. If reduction of one aspect of color does not alter the match effect, it would suggest that not all perceptual information is relevant for a mental simulation. Our results did not support this: We found a match advantage when objects were shown at normal levels of saturation, but this match advantage disappeared when saturation was reduced, yet still aided in object recognition compared to when color was entirely removed. Taken together, these results clearly show a strong match effect for color, and the perceptual richness of mental simulations during language comprehension

The last line effect explained

Micro-clones are tiny duplicated pieces of code; they typically comprise only few statements or lines. In this paper, we study the “Last Line Effect,” the phenomenon that the last line or statement in a micro-clone is much more likely to contain an error than the previous lines or statements. We do this by analyzing 219 open source projects and reporting on 263 faulty micro-clones and interviewing six authors of real-world faulty micro-clones. In an interdisciplinary collaboration, we examine the underlying psychological mechanisms for the presence of these relatively trivial errors. Based on the interviews and further technical analyses, we suggest that so-called “action slips” play a pivotal role for the existence of the last line effect: Developers’ attention shifts away at the end of a micro-clone creation task due to noise and the routine nature of the task. Moreover, all micro-clones whose origin we could determine were introduced in unusually large commits. Practitioners benefit from this knowledge twofold: 1) They can spot situations in which they are likely to introduce a faulty micro-clone and 2) they can use PVS-Studio, our automated micro-clone detector, to help find erroneous micro-clones

Language concatenates perceptual features into representations during comprehension

Action Contro

Understanding how grammatical aspect influences legal judgment

Recent evidence suggests that grammatical aspect can bias how individuals perceive criminal intentionality during discourse comprehension. Given that criminal intentionality is a common criterion for legal definitions (e.g., first-degree murder), the present study explored whether grammatical aspect may also impact legal judgments. In a series of four experiments participants were provided with a legal definition and a description of a crime in which the grammatical aspect of provocation and murder events were manipulated. Participants were asked to make a decision (first- vs. second-degree murder) and then indicate factors that impacted their decision. Findings suggest that legal judgments can be affected by grammatical aspect but the most robust effects were limited to temporal dynamics (i.e., imperfective aspect results in more murder actions than perfective aspect), which may in turn influence other representational systems (i.e., number of murder actions positively predicts perceived intentionality). In addition, findings demonstrate that the influence of grammatical aspect on situation model construction and evaluation is dependent upon the larger linguistic and semantic context. Together, the results suggest grammatical aspect has indirect influences on legal judgments to the extent that variability in aspect changes the features of the situation model that align with criteria for making legal judgments

Toward a more embedded/extended perspective on the cognitive function of gestures

Gestures are often considered to be demonstrative of the embodied nature of the mind (Hostetter and Alibali, 2008). In this article, we review current theories and research targeted at the intra-cognitive role of gestures. We ask the question how can gestures support internal cognitive processes of the gesturer? We suggest that extant theories are in a sense disembodied, because they focus solely on embodiment in terms of the sensorimotor neural precursors of gestures. As a result, current theories on the intra-cognitive role of gestures are lacking in explanatory scope to address how gestures-as-bodily-acts fulfill a cognitive function. On the basis of recent theoretical appeals that focus on the possibly embedded/extended cognitive role of gestures (Clark, 2013), we suggest that gestures are external physical tools of the cognitive system that replace and support otherwise solely internal cognitive processes. That is gestures provide the cognitive system with a stable external physical and visual presence that can provide means to think with. We show that there is a considerable amount of overlap between the way the human cognitive system has been found to use its environment, and how gestures are used during cognitive processes. Lastly, we provide several suggestions of how to investigate the embedded/extended perspective of the cognitive function of gestures

How are mental simulations updated across sentences?

We examined how grounded mental simulations are updated when there is an implied change of shape, over the course of two (Experiment 1) and four (Experiment 2) sentences. In each preregistered experiment, 84 psychology students completed a sentence–picture verification task in which they judged as quickly and accurately as possible whether the pictured object was mentioned in the previous sentence. Participants had significantly higher accuracy scores and significantly shorter response times when pictures matched the shape implied by the previous sentence than when pictures mismatched the implied shape. These findings suggest that during language comprehension, mental simulations can be actively updated to reflect new incoming information