Controlled language and readability

Controlled Language (CL) rules specify constraints on lexicon, grammar and style with the objective of improving text translatability, comprehensibility, readability and usability. A significant body of research exists demonstrating the positive effects CL rules can have on machine translation quality (e.g. Mitamura and Nyberg 1995; Kamprath et al 1998; Bernth 1999; Nyberg et al 2003), acceptability (Roturier 2006), and post-editing effort (O’Brien 2006). Since CL rules aim to reduce complexity and ambiguity, claims have been made that they consequently improve the readability of text (e.g., Spaggiari, Beaujard and Cannesson 2003; Reuther 2003). Little work, however, has been done on the effects of CL on readability. This paper represents an attempt to investigate the relationship in an empirical manner using both qualitative and quantitative methods

Eye movements in code reading:relaxing the linear order

Abstract—Code reading is an important skill in programming. Inspired by the linearity that people exhibit while natural lan-guage text reading, we designed local and global gaze-based mea-sures to characterize linearity (left-to-right and top-to-bottom) in reading source code. Unlike natural language text, source code is executable and requires a specific reading approach. To validate these measures, we compared the eye movements of novice and expert programmers who were asked to read and comprehend short snippets of natural language text and Java programs. Our results show that novices read source code less linearly than natural language text. Moreover, experts read code less linearly than novices. These findings indicate that there are specific differences between reading natural language and source code, and suggest that non-linear reading skills increase with expertise. We discuss the implications for practitioners and educators. I

Text reading in English as a second language: Evidence from the Multilingual Eye-Movements Corpus

Research into second language (L2) reading is an exponentially growing field. Yet, it still has a relatively short supply of comparable, ecologically valid data from readers representing a variety of first languages (L1). This article addresses this need by presenting a new data resource called MECO L2 (Multilingual Eye Movements Corpus), a rich behavioral eye-tracking record of text reading in English as an L2 among 543 university student speakers of 12 different L1s.MECO L2 includes a test battery of component skills of reading and allows for a comparison of the participants’ reading performance in their L1 and L2. This data resource enables innovative large-scale cross-sample analyses of predictors of L2 reading fluency and comprehension. We first introduce the design and structure of the MECO L2 resource, along with reliability estimates and basic descriptive analyses. Then, we illustrate the utility of MECO L2 by quantifying contributions of four sources to variability in L2 reading proficiency proposed in prior literature: reading fluency and comprehension in L1, proficiency in L2 component skills of reading, extralinguistic factors, and the L1 of the readers. Major findings included (a) a fundamental contrast between the determinants of L2 reading fluency versus comprehension accuracy, and (b) high within-participant consistency in the real-time strategy of reading in L1 and L2.We conclude by reviewing the implications of these findings to theories of L2 acquisition and outline further directions in which the new data resourcemay support L2 reading research.Este artículo se encuentra publicado en Studies in Second Language Acquisition, 45(1), 3-37

Investigating Reading Behavior and Inference-making in Advanced L2 Reading Comprehension Assessment Tasks

Despite the ubiquity of reading comprehension tasks in English language proficiency tests (or sections of tests), the constructs underlying successful reading comprehension in English as a second/additional language at the advanced academic level are still not completely understood. Part of the reason for this gap in the current state of knowledge comes from how existing models of second language reading neglect higher-order reading skills. Many reading assessments overly target language proficiency skills and assume the transfer of first language literacy skills, leaving unexamined the higher-order skills of language learners who become skilled academic readers in their second or additional language. This study seeks to address the dearth of research on higher-order reading skills in advanced second language reading comprehension by examining the activation of these skills in realistic L2 reading comprehension tasks. A reading comprehension test with three different tasks (MC questions, cloze, and summary) was developed and administered to 102 second language English and multilingual undergraduate and graduate students studying at a university in the US. Eye-movement behavior was recorded during these tasks, and each reading task was followed by a sentence verification task to measure activation of inferencing. Eye-movement behavior and inferencing are compared across the reading tasks, and additionally compared to language proficiency and reading comprehension scores. The tasks each elicited distinct patterns of reading behavior: the cloze task elicited careful local reading, the MC task elicited expeditious linear reading, and the summary task elicited both careful global reading and expeditious strategies. Cloze scores were closely related to language proficiency, but also related to reasoning ability and processing efficiency. MC scores were unrelated to proficiency. They were instead related more to reasoning ability and were predicted by readers’ ability to efficiently process the MC questions. Inferencing ability was only predictive of score in the summary task. Summary scores were additionally influenced by global attention to the text, processing efficiency, reading motivation, and language proficiency. Implications for the use of each task as L2 reading assessment are discussed, as well as implications for the teaching of second language reading

Towards predicting post-editing productivity

Machine translation (MT) quality is generally measured via automatic metrics, producing scores that have no meaning for translators who are required to post-edit MT output or for project managers who have to plan and budget for transla- tion projects. This paper investigates correlations between two such automatic metrics (general text matcher and translation edit rate) and post-editing productivity. For the purposes of this paper, productivity is measured via processing speed and cognitive measures of effort using eye tracking as a tool. Processing speed, average fixation time and count are found to correlate well with the scores for groups of segments. Segments with high GTM and TER scores require substantially less time and cognitive effort than medium or low-scoring segments. Future research involving score thresholds and confidence estimation is suggested

Integrative Processing of Verbal and Graphical Information During Re-reading Predicts Learning from Illustrated Text: An Eye-Movement Study

Printed or digital textbooks contain texts accompanied by various kinds of visualisation. Successful comprehension of these materials requires integrating verbal and graphical information. This study investigates the time course of processing an illustrated text through eye-tracking methodology in the school context. The aims were to identify patterns of first- and second-pass reading and to examine whether the integrative processing of text and picture during the less automatic and more purposeful second-pass reading predicts learning, after controlling for reading comprehension, prior knowledge, and self-concept. Forty-three 7th graders read an illustrated science text while their eye-movements were recorded. A cluster analysis revealed two processing patterns during the first-pass reading, which differed for the time spent on the main concepts in the text and picture. During re-reading, two patterns of stronger and weaker integrative processing emerged. Integration of verbal and graphical information was revealed by the frequency of second-pass transitions from text to picture and from picture to text, and the duration of picture re-inspecting while re-reading text information (look-from text to picture) and re-reading text information while re-inspecting the visualised information (look-from picture to text). A series of hierarchical regression analyses indicated that only the patterns of integrative processing during the second-pass reading uniquely predict verbal and graphical recalls, and the transfer of knowledge. The study provides evidence that the delayed processing which integrates text and graphics contributes to text retention and the application of newly learned knowledge, over and above individual characteristics. The educational significance is outlined