Information properties of morphologically complex words modulate brain activity during word reading

Neuroimaging studies of the reading process point to functionally distinct stages in word recognition. Yet, current understanding of the operations linked to those various stages is mainly descriptive in nature. Approaches developed in the field of computational linguistics may offer a more quantitative approach for understanding brain dynamics. Our aim was to evaluate whether a statistical model of morphology, with well-defined computational principles, can capture the neural dynamics of reading, using the concept of surprisal from information theory as the common measure. The Morfessor model, created for unsupervised discovery of morphemes, is based on the minimum description length principle and attempts to find optimal units of representation for complex words. In a word recognition task, we correlated brain responses to word surprisal values derived from Morfessor and from other psycholinguistic variables that have been linked with various levels of linguistic abstraction. The magnetoencephalography data analysis focused on spatially, temporally and functionally distinct components of cortical activation observed in reading tasks. The early occipital and occipito-temporal responses were correlated with parameters relating to visual complexity and orthographic properties, whereas the later bilateral superior temporal activation was correlated with whole-word based and morphological models. The results show that the word processing costs estimated by the statistical Morfessor model are relevant for brain dynamics of reading during late processing stages.Peer reviewe

Eye tracking as an MT evaluation technique

Eye tracking has been used successfully as a technique for measuring cognitive load in reading, psycholinguistics, writing, language acquisition etc. for some time now. Its application as a technique for measuring the reading ease of MT output has not yet, to our knowledge, been tested. We report here on a preliminary study testing the use and validity of an eye tracking methodology as a means of semi-automatically evaluating machine translation output. 50 French machine translated sentences, 25 rated as excellent and 25 rated as poor in an earlier human evaluation, were selected. Ten native speakers of French were instructed to read the MT sentences for comprehensibility. Their eye gaze data were recorded non-invasively using a Tobii 1750 eye tracker. The average gaze time and fixation count were found to be higher for the “bad” sentences, while average fixation duration and pupil dilations were not found to be substantially different for output rated as good and output rated as bad. Comparisons between HTER scores and eye gaze data were also found to correlate well with gaze time and fixation count, but not with pupil dilation and fixation duration. We conclude that the eye tracking data, in particular gaze time and fixation count, correlate reasonably well with human evaluation of MT output but fixation duration and pupil dilation may be less reliable indicators of reading difficulty for MT output. We also conclude that eye tracking has promise as a semi-automatic MT evaluation technique, which does not require bi-lingual knowledge, and which can potentially tap into the end users’ experience of machine translation output

Assessing Levels of Attention Using Low Cost Eye Tracking

The emergence of mobile eye trackers embedded in next generation smartphones or VR displays will make it possible to trace not only what objects we look at but also the level of attention in a given situation. Exploring whether we can quantify the engagement of a user interacting with a laptop, we apply mobile eye tracking in an in-depth study over 2 weeks with nearly 10.000 observations to assess pupil size changes, related to attentional aspects of alertness, orientation and conflict resolution. Visually presenting conflicting cues and targets we hypothesize that it's feasible to measure the allocated effort when responding to confusing stimuli. Although such experiments are normally carried out in a lab, we are able to differentiate between sustained alertness and complex decision making even with low cost eye tracking "in the wild". From a quantified self perspective of individual behavioral adaptation, the correlations between the pupil size and the task dependent reaction time and error rates may longer term provide a foundation for modifying smartphone content and interaction to the users perceived level of attention.Comment: 12 pages, 6 figures, 2 tables. The final publication will be available at Springer via http://dx.doi.org/DOIxxx, when published as part of the HCI International 2016 Conference Proceeding

Two stages of parafoveal processing during reading: Evidence from a display change detection task

We used a display change detection paradigm (Slattery, Angele, & Rayner Human Perception and Performance, 37, 1924–1938 2011) to investigate whether display change detection uses orthographic regularity and whether detection is affected by the processing difficulty of the word preceding the boundary that triggers the display change. Subjects were significantly more sensitive to display changes when the change was from a nonwordlike preview than when the change was from a wordlike preview, but the preview benefit effect on the target word was not affected by whether the preview was wordlike or nonwordlike. Additionally, we did not find any influence of preboundary word frequency on display change detection performance. Our results suggest that display change detection and lexical processing do not use the same cognitive mechanisms. We propose that parafoveal processing takes place in two stages: an early, orthography-based, preattentional stage, and a late, attention-dependent lexical access stage

Generalization Strategies in Finding the <i>n</i>th Term Rule for Simple Quadratic Sequences

In this study, we identify ways in which a sample of 18 graduates with mathematics-related first degrees found the nth term for quadratic sequences from the first values of a sequence of data, presented on a computer screen in various formats: tabular, scattered data pairs and sequential. Participants’ approaches to identifying the nth term were recorded with eye-tracking technology. Our aims are to identify their strategies and to explore whether and how format influences these strategies. Qualitative analysis of eye-tracking data offers several strategies: Sequence of Differences, Building a Relationship, Known Formula, Linear Recursive and Initial Conjecture. Sequence of Differences was the most common strategy, but Building a Relationship was more likely to lead to the right formula. Building from Square and Factor Search were the most successful methods of Building a Relationship. Findings about the influence of format on the range of strategies were inconclusive but analysis indicated sporadic evidence of possible influences

Comparing Methods for Analysis of Pupillary Response

Changes in eye-pupil size index a range of cognitive processes. However, variations in the protocols used to analyze such data exist in the psychological literature. This raises the question of whether different approaches to pupillary response data influence the outcome of the analysis. To address this question, four methods of analysis were compared, using pupillary responses to sexually appetitive visual content as example data. These methods comprised analysis of the unadjusted (raw) pupillary response data,z-scored data, percentage-change data, and data transformed by a prestimulus baseline correction. Across two experiments, these methods yielded near-identical outcomes, leading to similar conclusions. This suggests that the range of approaches that are employed in the psychological literature to analyze pupillary response data do not fundamentally influence the outcome of the analysis. However, some systematic carryover effects were observed when a prestimulus baseline correction was applied, whereby dilation effects from an arousing target on one trial still influenced pupil size on the next trial. This indicates that the appropriate application of this analysis might require additional information, such as prior knowledge of the duration of carryover effects

Is children's reading “good enough”? Links between online processing and comprehension as children read syntactically ambiguous sentences

We monitored 8- and 10-year-old children’s eye movements as they read sentences containing a temporary syntactic ambiguity to obtain a detailed record of their online processing. Children showed the classic garden-path effect in online processing. Their reading was disrupted following disambiguation, relative to control sentences containing a comma to block the ambiguity, although the disruption occurred somewhat later than would be expected for mature readers. We also asked children questions to probe their comprehension of the syntactic ambiguity offline. They made more errors following ambiguous sentences than following control sentences, demonstrating that the initial incorrect parse of the garden-path sentence influenced offline comprehension. These findings are consistent with “good enough” processing effects seen in adults. While faster reading times and more regressions were generally associated with better comprehension, spending longer reading the question predicted comprehension success specifically in the ambiguous condition. This suggests that reading the question prompted children to reconstruct the sentence and engage in some form of processing, which in turn increased the likelihood of comprehension success. Older children were more sensitive to the syntactic function of commas, and, overall, they were faster and more accurate than younger children

Effects of syntactic context on eye movements during reading

Previous research has demonstrated that properties of a currently fixated word and of adjacent words influence eye movement control in reading. In contrast to such local effects, little is known about the global effects on eye movement control, for example global adjustments caused by processing difficulty of previous sentences. In the present study, participants read text passages in which voice (active vs. passive) and sentence structure (embedded vs. non-embedded) were manipulated. These passages were followed by identical target sentences. The results revealed effects of previous sentence structure on gaze durations in the target sentence, implying that syntactic properties of previously read sentences may lead to a global adjustment of eye movement control

Do successor effects in reading reflect lexical parafoveal processing? Evidence from corpus-based and experimental eye movement data

Abstract In the past, most research on eye movements during reading involved a limited number of subjects reading sentences with specific experimental manipulations on target words. Such experiments usually only analyzed eye-movements measures on and around the target word. Recently, some researchers have started collecting larger data sets involving large and diverse groups of subjects reading large numbers of sentences, enabling them to consider a larger number of influences and study larger and more representative subject groups. In such corpus studies, most of the words in a sentence are analyzed. The complexity of the design of corpus studies and the many potentially uncontrolled influences in such studies pose new issues concerning the analysis methods and interpretability of the data. In particular, several corpus studies of reading have found an effect of successor word (n&#xa0;+&#xa0;1) frequency on current word (n) fixation times, while studies employing experimental manipulations tend not to. The general interpretation of corpus studies suggests that readers obtain parafoveal lexical information from the upcoming word before they have finished identifying the current word, while the experimental manipulations shed doubt on this claim. In the present study, we combined a corpus analysis approach with an experimental manipulation (i.e., a parafoveal modification of the moving mask technique, Rayner & Bertera, 1979), so that, either (a) word n+1, (b) word n+;2, (c) both words, or (d) neither word was masked. We found that denying preview for either or both parafoveal words increased average fixation times. Furthermore, we found successor effects similar to those reported in the corpus studies. Importantly, these successor effects were found even when the parafoveal word was masked, suggesting that apparent successor frequency effects may be due to causes that are unrelated to lexical parafoveal preprocessing. We discuss the implications of this finding both for parallel and serial accounts of word identification and for the interpretability of large correlational studies of word identification in reading in general