Combining quantitative narrative analysis and predictive modeling - an eye tracking study

As a part of a larger interdisciplinary project on Shakespeare sonnets’ reception (Jacobs et al., 2017; Xue et al., 2017), the present study analyzed the eye movement behavior of participants reading three of the 154 sonnets as a function of seven lexical features extracted via Quantitative Narrative Analysis (QNA). Using a machine learning- based predictive modeling approach five ‘surface’ features (word length, orthographic neighborhood density, word frequency, orthographic dissimilarity and sonority score) were detected as important predictors of total reading time and fixation probability in poetry reading. The fact that one phonological feature, i.e., sonority score, also played a role is in line with current theorizing on poetry reading. Our approach opens new ways for future eye movement research on reading poetic texts and other complex literary materials (cf. Jacobs, 2015c)

The SLS-Berlin: Validation of a German Computer-Based Screening Test to Measure Reading Proficiency in Early and Late Adulthood

Reading proficiency, i.e., successfully integrating early word-based information and utilizing this information in later processes of sentence and text comprehension, and its assessment is subject to extensive research. However, screening tests for German adults across the life span are basically non-existent. Therefore, the present article introduces a standardized computerized sentence-based screening measure for German adult readers to assess reading proficiency including norm data from 2,148 participants covering an age range from 16 to 88 years. The test was developed in accordance with the children’s version of the Salzburger LeseScreening (SLS, Wimmer and Mayringer, 2014). The SLS-Berlin has a high reliability and can easily be implemented in any research setting using German language. We present a detailed description of the test and report the distribution of SLS-Berlin scores for the norm sample as well as for two subsamples of younger (below 60 years) and older adults (60 and older). For all three samples, we conducted regression analyses to investigate the relationship between sentence characteristics and SLS-Berlin scores. In a second validation study, SLS-Berlin scores were compared with two (pseudo)word reading tests, a test measuring attention and processing speed and eye-movements recorded during expository text reading. Our results confirm the SLS-Berlin’s sensitivity to capture early word decoding and later text related comprehension processes. The test distinguished very well between skilled and less skilled readers and also within less skilled readers and is therefore a powerful and efficient screening test for German adults to assess interindividual levels of reading proficiency

additive or interactive effects of nouns and adjectives?

The vast majority of studies on affective processes in reading focus on single words. The most robust finding is a processing advantage for positively valenced words, which has been replicated in the rare studies investigating effects of affective features of words during sentence or story comprehension. Here we were interested in how the different valences of words in a sentence influence its processing and supralexical affective evaluation. Using a sentence verification task we investigated how comprehension of simple declarative sentences containing a noun and an adjective depends on the valences of both words. The results are in line with the assumed general processing advantage for positive words. We also observed a clear interaction effect, as can be expected from the affective priming literature: sentences with emotionally congruent words (e.g., The grandpa is clever) were verified faster than sentences containing emotionally incongruent words (e.g., The grandpa is lonely). The priming effect was most prominent for sentences with positive words suggesting that both, early processing as well as later meaning integration and situation model construction, is modulated by affective processing. In a second rating task we investigated how the emotion potential of supralexical units depends on word valence. The simplest hypothesis predicts that the supralexical affective structure is a linear combination of the valences of the nouns and adjectives (Bestgen, 1994). Overall, our results do not support this: The observed clear interaction effect on ratings indicate that especially negative adjectives dominated supralexical evaluation, i.e., a sort of negativity bias in sentence evaluation. Future models of sentence processing thus should take interactive affective effects into account

Influence of Associations on the Reception of Poetry

Reading and understanding poetic texts is often described as an interactive process influenced by the words and phrases building the poems and all associations and images induced by them in the readers mind. Iser, for example, described the understanding process as the closing of a Good Gestalt promoted by mental images. Here we investigate the effect that semantic cohesion, that is the internal connection of a list words, has on understanding and appreciation of poetic texts. To do this word lists are presented as modern micropoems to the participants and the (ease of) extraction of underlying concepts as well as the affective and aesthetic responses are implicitly and explicitly measured. We found that a unifying concept is found more easily and unifying concepts vary significantly less between participants when the words composing a micropoem are semantically related. Moreover these items are liked better and are understood more easily. Our study shows evidence for the assumed relationship between building spontaneous associations, forming mental imagery, and understanding and appreciation of poetic texts. In addition, we introduced a new method well suited to manipulate backgrounding features independently of foregrounding features which allows to disentangle the effects of both on poetry reception

Comprehending negation: A study with adults diagnosed with high functioning autism or Asperger's syndrome

Dieser Beitrag ist mit Zustimmung des Rechteinhabers aufgrund einer (DFG geförderten) Allianz- bzw. Nationallizenz frei zugänglich.This publication is with permission of the rights owner freely accessible due to an Alliance licence and a national licence (funded by the DFG, German Research Foundation) respectively.We investigated whether readers with high-functioning autism or Asperger's syndrome (HA/AS) differ from normal controls with respect to pragmatic aspects of negation processing. We presented short stories to two groups of readers, a group of individuals diagnosed with HA/AS and a group of normal controls. The final sentence of each story either affirmed or negated a particular proposition, which in the pragmatically felicitous context corresponded to a highly plausible assumption for the situation at hand, but in the pragmatically infelicitous context to an implausible assumption. In line with our predictions, the group of healthy controls read the negative but not the affirmative target sentences more slowly in the pragmatically infelicitous than in the pragmatically felicitous contexts. In the pragmatically felicitous context, reading times for negative sentences were as fast as those for affirmative sentences. In contrast, for the clinical group, the context had no effect: Reading times for the negative target sentences were longer than those of the affirmative target sentences in both context versions. These results indicate that individuals with HA/AS indeed differ from normal controls with respect to negation processing. Moreover, these results are in line with the more general hypothesis that the differences between normal individuals and those with HA/AS concern pragmatic aspects of language processing

A neurocognitive poetics investigation of eye movements during the reading of Baudelaire’s ‘Les Chats’

Following Jakobson and Levi-Strauss famous analysis of Baudelaire’s poem ‘Les Chats’ (‘The Cats’), in the present study we investigated the reading of French poetry from a Neurocognitive Poetics perspective. Our study is exploratory and a first attempt in French, most previous work having been done in either German or English (e.g., Jacobs, 2015a, 2018a, b; Müller et al., 2017; Xue et al., 2019). We varied the presentation mode of the poem Les Chats (verse vs. prose form) and measured the eye movements of our readers to test the hypothesis of an interaction between presentation mode and reading behavior. We specifically focussed on rhyme scheme effects on standard eye movement parameters. Our results replicate those from previous English poetry studies in that there is a specific pattern in poetry reading with longer gaze durations and more rereading in the verse than in the prose format. Moreover, presentation mode also matters for making salient the rhyme scheme. This first study generates interesting hypotheses for further research applying quantitative narrative analysis to French poetry and developing the Neurocognitive Poetics Model of literary reading (NCPM; Jacobs, 2015a) into a cross-linguistic model of poetry reading

Predicting subjective ratings of affect and comprehensibility with text features: a reader response study of narrative poetry

Literary reading is an interactive process between a reader and a text that depends on a balance between cognitive effort and emotional rewards. By studying both the crucial features of the text and of the subjective reader reception, a better understanding of this interactive process can be reached. In the present study, subjects ( N =31) read and rated a work of narrative fiction that was written in a poetic style, thereby offering the readers two pathways to cognitive rewards: Aesthetic appreciation and narrative immersion. Using purely text-based quantitative descriptors, we were able to independently and accurately predict the subjective ratings in the dimensions comprehensibility, valence, arousal, and liking across roughly 140 pages of naturalistic text. The specific text features that were most important in predicting each rating dimension are discussed in detail. In addition, the implications of the findings are discussed more generally in the context of existing models of literary processing and future research avenues for empirical literary studies

Rereading Shakespeare’s Sonnets — an Eye Tracking Study

Texts are often reread in everyday life, but most studies of rereading have been based on expository texts, not on literary ones such as poems, though literary texts may be reread more often than others. To correct this bias, the present study is based on two of Shakespeare’s sonnets. Eye movements were recorded, as participants read a sonnet then read it again after a few minutes. After each reading, comprehension and appreciation were measured with the help of a questionnaire. In general, compared to the first reading, rereading improved the fluency of reading (shorter total reading times, shorter regression times, and lower fixation probability) and the depth of comprehension. Contrary to the other rereading studies using literary texts, no increase in appreciation was apparent. Moreover, results from a predictive modeling analysis showed that readers’ eye movements were determined by the same psycholinguistic features throughout the two sessions. Apparently, even in the case of poetry, the process of reading is determined mainly by surface features of the text, unaffected by repetition

An Eye Tracking Study on the Effects of Emotional Vignettes and Pictures

Reading is known to be a highly complex, emotion-inducing process, usually involving connected and cohesive sequences of sentences and paragraphs. However, most empirical results, especially from studies using eye tracking, are either restricted to simple linguistic materials (e.g., isolated words, single sentences) or disregard valence-driven effects. The present study addressed the need for ecologically valid stimuli by examining the emotion potential of and reading behavior in emotional vignettes, often used in applied psychological contexts and discourse comprehension. To allow for a cross-domain comparison in the area of emotion induction, negatively and positively valenced vignettes were constructed based on pre-selected emotional pictures from the Nencki Affective Picture System (NAPS; Marchewka et al., 2014). We collected ratings of perceived valence and arousal for both material groups and recorded eye movements of 42 participants during reading and picture viewing. Linear mixed-effects models were performed to analyze effects of valence (i.e., valence category, valence rating) and stimulus domain (i.e., textual, pictorial) on ratings of perceived valence and arousal, eye movements in reading, and eye movements in picture viewing. Results supported the success of the experimental manipulation: emotionally positive stimuli (i.e., vignettes, pictures) were perceived more positively and less arousing than emotionally negative ones. The cross-domain comparison indicated that vignettes are able to induce stronger valence effects than their pictorial counterparts, no differences between vignettes and pictures regarding effects on perceived arousal were found. Analyses of eye movements in reading replicated results from experiments using isolated words and sentences: perceived positive text valence attracted shorter reading times than perceived negative valence at both the supralexical and lexical level. In line with previous findings, no emotion effects on eye movements in picture viewing were found. This is the first eye tracking study reporting superior valence effects for vignettes compared to pictures and valence-specific effects on eye movements in reading at the supralexical level

The Foregrounding Assessment Matrix: An interface for qualitative-quantitative interdisciplinary research

This paper presents the results of a transdisciplinary research conducted by scholars working in the humanities and experimental psychologists in order to find an interface between the needs of a qualitative approach (mainly based on the evaluation of stylistic features) and those of a quantitative analysis, in order to find useful features for testing different reading behaviors and for new hermeneutical enquiries. The results of our research, which was conducted in two Labs (Dahlem Institute for Neuroimaging of Emotion at the FU Berlin and the NewHums – Neurocognitive and Human Studies at the University of Catania), consistently differ from previous ones, as they focus on the whole multi-layered foregrounded texture of a poem and try to evaluate predictable differences in reading, re-reading behaviour and meaning-making processes. We present the FAM, targeting foregrounding elements in three main categories: the phonological, morpho-syntactic, and rhetoric. To identify those elements, four different text levels were taken into account, the sublexical level of phonemes and syllables, the lexical level of single words, the interlexical level of word combinations across longer distance (e.g. two lines), and the supralexical level of whole stanzas or an entire poem. In contrast to previous quantitative analyses on short, isolated sentences and texts, mostly expository in nature (‘textoids’), or on single words or segments, the text is considered as a whole, marked by density fields that work as milestones along a reading route.This paper presents the results of a transdisciplinary research conducted by scholars working in the humanities and experimental psychologists in order to find an interface between the needs of a qualitative approach (mainly based on the evaluation of stylistic features) and those of a quantitative analysis, in order to find useful features for testing different reading behaviors and for new hermeneutical enquiries. The results of our research, which was conducted in two Labs (Dahlem Institute for Neuroimaging of Emotion at the FU Berlin and the NewHums – Neurocognitive and Human Studies at the University of Catania), consistently differ from previous ones, as they focus on the whole multi-layered foregrounded texture of a poem and try to evaluate predictable differences in reading, re-reading behaviour and meaning-making processes. We present the FAM, targeting foregrounding elements in three main categories: the phonological, morpho-syntactic, and rhetoric. To identify those elements, four different text levels were taken into account, the sublexical level of phonemes and syllables, the lexical level of single words, the interlexical level of word combinations across longer distance (e.g. two lines), and the supralexical level of whole stanzas or an entire poem. In contrast to previous quantitative analyses on short, isolated sentences and texts, mostly expository in nature (‘textoids’), or on single words or segments, the text is considered as a whole, marked by density fields that work as milestones along a reading route.This paper presents the results of a transdisciplinary research conducted by scholars working in the humanities and experimental psychologists in order to find an interface between the needs of a qualitative approach (mainly based on the evaluation of stylistic features) and those of a quantitative analysis, in order to find useful features for testing different reading behaviors and for new hermeneutical enquiries. The results of our research, which was conducted in two Labs (Dahlem Institute for Neuroimaging of Emotion at the FU Berlin and the NewHums – Neurocognitive and Human Studies at the University of Catania), consistently differ from previous ones, as they focus on the whole multi-layered foregrounded texture of a poem and try to evaluate predictable differences in reading, re-reading behaviour and meaning-making processes. We present the FAM, targeting foregrounding elements in three main categories: the phonological, morpho-syntactic, and rhetoric. To identify those elements, four different text levels were taken into account, the sublexical level of phonemes and syllables, the lexical level of single words, the interlexical level of word combinations across longer distance (e.g. two lines), and the supralexical level of whole stanzas or an entire poem. In contrast to previous quantitative analyses on short, isolated sentences and texts, mostly expository in nature (‘textoids’), or on single words or segments, the text is considered as a whole, marked by density fields that work as milestones along a reading route.This paper presents the results of a transdisciplinary research conducted by scholars working in the humanities and experimental psychologists in order to find an interface between the needs of a qualitative approach (mainly based on the evaluation of stylistic features) and those of a quantitative analysis, in order to find useful features for testing different reading behaviors and for new hermeneutical enquiries. The results of our research, which was conducted in two Labs (Dahlem Institute for Neuroimaging of Emotion at the FU Berlin and the NewHums – Neurocognitive and Human Studies at the University of Catania), consistently differ from previous ones, as they focus on the whole multi-layered foregrounded texture of a poem and try to evaluate predictable differences in reading, re-reading behaviour and meaning-making processes. We present the FAM, targeting foregrounding elements in three main categories: the phonological, morpho-syntactic, and rhetoric. To identify those elements, four different text levels were taken into account, the sublexical level of phonemes and syllables, the lexical level of single words, the interlexical level of word combinations across longer distance (e.g. two lines), and the supralexical level of whole stanzas or an entire poem. In contrast to previous quantitative analyses on short, isolated sentences and texts, mostly expository in nature (‘textoids’), or on single words or segments, the text is considered as a whole, marked by density fields that work as milestones along a reading route.This paper presents the results of a transdisciplinary research conducted by scholars working in the humanities and experimental psychologists in order to find an interface between the needs of a qualitative approach (mainly based on the evaluation of stylistic features) and those of a quantitative analysis, in order to find useful features for testing different reading behaviors and for new hermeneutical enquiries. The results of our research, which was conducted in two Labs (Dahlem Institute for Neuroimaging of Emotion at the FU Berlin and the NewHums – Neurocognitive and Human Studies at the University of Catania), consistently differ from previous ones, as they focus on the whole multi-layered foregrounded texture of a poem and try to evaluate predictable differences in reading, re-reading behaviour and meaning-making processes. We present the FAM, targeting foregrounding elements in three main categories: the phonological, morpho-syntactic, and rhetoric. To identify those elements, four different text levels were taken into account, the sublexical level of phonemes and syllables, the lexical level of single words, the interlexical level of word combinations across longer distance (e.g. two lines), and the supralexical level of whole stanzas or an entire poem. In contrast to previous quantitative analyses on short, isolated sentences and texts, mostly expository in nature (‘textoids’), or on single words or segments, the text is considered as a whole, marked by density fields that work as milestones along a reading route