Exploring modality switching effects in negated sentences: further evidence for grounded representations

Theories of embodied cognition (e.g., Perceptual Symbol Systems Theory; Barsalou, 1999, 2009) suggest that modality specific simulations underlie the representation of concepts. Supporting evidence comes from modality switch costs: participants are slower to verify a property in one modality (e.g., auditory, BLENDER-loud) after verifying a property in a different modality (e.g., gustatory, CRANBERRIES-tart) compared to the same modality (e.g., LEAVES-rustling, Pecher et al., 2003). Similarly, modality switching costs lead to a modulation of the N400 effect in event-related potentials (ERPs; Collins et al., 2011; Hald et al., 2011). This effect of modality switching has also been shown to interact with the veracity of the sentence (Hald et al., 2011). The current ERP study further explores the role of modality match/mismatch on the processing of veracity as well as negation (sentences containing “not”). Our results indicate a modulation in the ERP based on modality and veracity, plus an interaction. The evidence supports the idea that modality specific simulations occur during language processing, and furthermore suggest that these simulations alter the processing of negation

Modality switching and negation: ERP evidence for modality-specific simulations during negation processing

The Perceptual Symbol System Theory of cognition (Barsalou, 1999) suggests that modality-specific simulations underlie representation of concepts. This is evidenced by processing costs for switching modalities. That is, participants are slower to verify a property in the auditory modality (e.g., BLENDER-loud) after verifying a property in a different modality (e.g., CRANBERRIES-tart) and faster when verifying a property in the same modality (e.g., LEAVES-rustling). The modality switch cost has also been shown to lead to a modulation of the N400 event-related potential (ERP) (Collins, Pecher, Zeelenberg & Coulson, 2011 using a property verification task; Hald, Marshall, Janssen & Garnham, 2011 using a sentence verification task). In a separate line of research, ERP studies have indicated that without a discourse context, negated sentences are more difficult to process than affirmative sentences, leading to a different N400 pattern for negative sentences than for affirmative sentences (e.g., Fischler, Bloom, Childers, Roucos, & Perry, 1983.) Unlike affirmative sentences, sentences containing negation show a larger N400 for correct, semantically coherent single sentences (i.e., factually true sentences) than for semantically incorrect sentences (i.e., false sentences). However, Nieuwland and Kuperberg (2008,) found that the pragmatics of the sentence can change this N400 pattern to one closer to affirmative sentences. The goal of the current study was to explore whether the processing of negation could be aided by modality matching information. Other evidence suggests that comprehenders create a simulation of negative sentences (Kaup, Yaxley, Madden, Zwaan, & Lüdtke, 2007), but it is unclear whether modality matching information could modulate the processing cost of negation. Essentially, can modality matching information as reported by Collins et al., (2011) and Hald et al., (2011) lead to a modulation of the N400 for true negated sentences similar to that seen when discourse pragmatics supports negation? Furthermore, we were interested in whether the modality switch effect would lead to a similar pattern in the ERPs as that found with affirmative sentences (Collins et al., 2011 & Hald et al., 2011). Using a within-subjects design we used 160 pairs of experimental pairs which were either of the same or of a different modality. All experimental items were either visual or tactile modality and were drawn from existing sets of materials (Pecher, et al., 2003; Van Dantzig, et al., 2008). For example, a different modality pair was “A light bulb is very hot” followed by “Rice isn’t black” versus a same visual modality pair “A giraffe is spotted” followed by “Rice isn’t black”. We predicted that the underlined word is where a modulation in the N400 may be seen. Additionally, we explored veracity by making half of the experimental target sentences false (“Rice isn’t white”). Participants were asked to judge whether each sentence was typically true or false. Our initial results indicate a modulation in the ERP based on both modality and veracity. For true (“Rice isn’t black”) and false target statements (“Rice isn’t white”) different modality pairs elicit a larger frontal-central N400 like effect compared to same modality pairs (Figure 1), replicating Hald et al., (2011). When comparing true versus false, the different modality pairs elicit a large posterior N400 for true compared to false sentences (replicating the effect for negated sentences, i.e., Fischler et al., 1983). However for same modality pairs there is a reduction in the N400 to true statements; no difference is seen between true and false statements in the ERP (Figure 2). These results replicate and extend previous ERP findings using the modality switch paradigm. The evidence suggests that not only do modality-specific simulations occur but they can even aid the processing of negation

A lightweight, pattern-based approach to identification and formalisation of TimeML expressions in clinical narratives

General Architecture for Text Engineering (GATE) components for identifying clinical events and temporal expressions are developed and evaluated against a corpus of 120 discharge summaries

From simple predicators to clausal functors : The english modals through time and the primitives of modality

The ultimate goal of this paper is to find a representation of modality compatible with some basic conditions on the syntax-semantic interface. Such conditions are anchored, for instance, in Chomsky's (1995) principle of full interpretation (FI). Abstract interpretation of modality is, however - be it "only" in semantic terms - already a hard nut to crack, way too vast to be dealt with in any comprehensive way here. What is pursued instead is a case-study-centered analysis. The case in point are the English modals (EM) viewed in their development through time - a locus classicus for a number of linguistic theories and frameworks. The idea will be to start out from two lines of research - continuous grammaticalization vs. cataclysmic change - and to explain some of their incongruities. The first non-trivial point here consists in deriving more fundamental questions from this research. The second, possibly even less trivial one consists in answering them. Specifically, I will argue that regardless of the actual numerical rate of change, there is an underlying and more structured way to account for the notions of change and continuity within the modal system, respectively

An Empirical Analysis of the Role of Amplifiers, Downtoners, and Negations in Emotion Classification in Microblogs

The effect of amplifiers, downtoners, and negations has been studied in general and particularly in the context of sentiment analysis. However, there is only limited work which aims at transferring the results and methods to discrete classes of emotions, e. g., joy, anger, fear, sadness, surprise, and disgust. For instance, it is not straight-forward to interpret which emotion the phrase "not happy" expresses. With this paper, we aim at obtaining a better understanding of such modifiers in the context of emotion-bearing words and their impact on document-level emotion classification, namely, microposts on Twitter. We select an appropriate scope detection method for modifiers of emotion words, incorporate it in a document-level emotion classification model as additional bag of words and show that this approach improves the performance of emotion classification. In addition, we build a term weighting approach based on the different modifiers into a lexical model for the analysis of the semantics of modifiers and their impact on emotion meaning. We show that amplifiers separate emotions expressed with an emotion- bearing word more clearly from other secondary connotations. Downtoners have the opposite effect. In addition, we discuss the meaning of negations of emotion-bearing words. For instance we show empirically that "not happy" is closer to sadness than to anger and that fear-expressing words in the scope of downtoners often express surprise.Comment: Accepted for publication at The 5th IEEE International Conference on Data Science and Advanced Analytics (DSAA), https://dsaa2018.isi.it

Trace checking of Metric Temporal Logic with Aggregating Modalities using MapReduce

Modern complex software systems produce a large amount of execution data, often stored in logs. These logs can be analyzed using trace checking techniques to check whether the system complies with its requirements specifications. Often these specifications express quantitative properties of the system, which include timing constraints as well as higher-level constraints on the occurrences of significant events, expressed using aggregate operators. In this paper we present an algorithm that exploits the MapReduce programming model to check specifications expressed in a metric temporal logic with aggregating modalities, over large execution traces. The algorithm exploits the structure of the formula to parallelize the evaluation, with a significant gain in time. We report on the assessment of the implementation - based on the Hadoop framework - of the proposed algorithm and comment on its scalability.Comment: 16 pages, 6 figures, Extended version of the SEFM 2014 pape