The Relations Between Children's Comprehension Monitoring and Their Reading Comprehension and Vocabulary Knowledge: An Eye-Movement Study.

Poor reading comprehension may be due to having ineffective comprehension monitoring, the metacognitive process of evaluating and regulating comprehension. When comprehension breaks down due to an inconsistency either at the word-level (e.g., due to an unfamiliar word) or at the sentence-level (e.g., due to contradictory information), readers may identify the misunderstanding and take steps to regulate their comprehension. In the current study, we utilized two eye-movement tasks (one newly developed) to examine comprehension monitoring in third through fifth grade students (n = 123), when confronted with word- and sentence-level inconsistencies, by measuring the amount of time they read (gaze duration) and reread the target inconsistent words. We investigated how this skill may be associated with individual differences in age, reading comprehension ability, and vocabulary knowledge. The results showed that generally, all students detected the word-level inconsistencies, indicated by longer gaze durations, and attempted to regulate their comprehension after detecting both word- and sentence-level inconsistencies, as indicated by more time spent rereading. Students with stronger reading comprehension (when controlling for their vocabulary), and stronger vocabulary knowledge (when controlling for their reading comprehension) were more likely to attempt regulating their comprehension. In general, the difference between the control words and the inconsistent words was smaller for third graders and larger for fourth and fifth graders, which we argue indicates greater levels of comprehension monitoring - specifically employing repair strategies. With eye-tracking technology becoming more accessible, these tasks may be useful in assessing children's reading processes to better understand at which level of comprehension monitoring they may be struggling, which in return will allow us to develop more individualized instruction for all readers

Measuring beginner reading skills: An empirical evaluation of alternative instruments and their potential use for policymaking and accountability in Peru

Based on analysis of reading performance data from 475 third-graders in Peru, this study makes recommendations on improving reading tests, choice of reading standards, and how to present the results at the school and individual levels. The paper reviews the literature on using reading skills measurement in the early grades to guide policymaking, strengthen accountability, and improve education quality. It uses data generated from the same students using two common approaches to measuring reading skills: an individually-administered oral fluency test, and a group-administered written comprehension test designed by the Ministry of Education for the 2006 universal standard test of second grade reading comprehension. These two approaches have sometimes been presented as competing alternatives, but the paper shows that it is better if they are used together, as complements. Based on psychometric analysis, the paper shows that both the oral and written tests adequately measured studentsâÃÂàreading abilities. The results show that reading fluency and comprehension are correlated: fluent readers are more likely to understand what they read than non-fluent readers. The strength of the fluency-comprehension relationship depends on the level of fluency, the difficulty of the questions, and social characteristics of the school. The paper recommends using improved versions of both tests to evaluate early grade reading skills, as a central element of a system of accountability for results. It proposes a model for reporting test results desgned to highlight the importance of reading standards, mobilize the education community to reach them, track progress, and identify students in need of extra support.academic performance; access to education; access to preschool; access to preschool education; Achievement; achievements; addition; adults; Assessment of Literacy; average score; Basic Skills;

Poor written and oral text comprehension in third grade children. A multiple case study

In this multiple case study we analyzed oral text comprehension, reading profiles and underlying cognitive abilities (attention, executive functions, working memory, narrative memory, rapid automatized naming and vocabulary) of 9 children identified as poor written text comprehenders after a school screening on 75 third grade children. Four out of the 9 children were named Language-Minority (L-M) children, since they had immigrant parents. The remaining 5 children were born in Italy from Italian parents. The comparisons of the two subgroups suggested that the lexical route of reading was particularly impaired in the L-M subgroup and that written text comprehension was weakened by restricted vocabulary which, in turn, was not supported by efficient phonological short-term memory. In a second type of data analysis we examined the individual profiles of the 9 children, irrespective of their belonging to the L-M or Italian subgroups, and identified different patterns of associations among reading performance, written text comprehension and oral text comprehension. The findings showed that poor text comprehension always co-occurred with word and/or text reading difficulties which, in turn, were associated to slow naming and weak verbal working memory. Moreover, when children had both written and oral text comprehension difficulties, not only verbal working memory was impaired but also narrative memory, suggesting a weakness in the episodic buffer (Baddeley 2000; 2010). The implications of poor working memory associated to slow naming and/or weak episodic buffer for text comprehension are discusse

The Impact of Multiple Fluency Interventions on a Single Subject

This study investigates the effectiveness of multiple fluency interventions on a single subject in grade three. Fluency interventions, including choral reading, echo reading, repeated reading, audio book modeling, and teacher modeling were implemented over a period of eight weeks. Results indicated that using multiple fluency strategies, rather than a single fluency strategy as is usually investigated, was positively associated with improvement in oral readin

Automatic Assessment of Oral Reading Accuracy for Reading Diagnostics

Automatic assessment of reading fluency using automatic speech recognition (ASR) holds great potential for early detection of reading difficulties and subsequent timely intervention. Precise assessment tools are required, especially for languages other than English. In this study, we evaluate six state-of-the-art ASR-based systems for automatically assessing Dutch oral reading accuracy using Kaldi and Whisper. Results show our most successful system reached substantial agreement with human evaluations (MCC = .63). The same system reached the highest correlation between forced decoding confidence scores and word correctness (r = .45). This system's language model (LM) consisted of manual orthographic transcriptions and reading prompts of the test data, which shows that including reading errors in the LM improves assessment performance. We discuss the implications for developing automatic assessment systems and identify possible avenues of future research

Improving Early Literacy in PreK-3: Lessons Learned

In 2011, The McKnight Foundation partnered with a set of districts and schools in the Twin Cities area, all serving high-needs students, on a PreK–3 literacy initiative. The Pathway Schools Initiative aims to dramatically increase the number of students who reach the critical milestone of third-grade reading proficiency, an indicator predictive of later academic outcomes and high school graduation. This report focuses on findings from Phase I of the Pathway Schools Initiative (2011–2015).The McKnight Foundation selected the Urban Education Institute (UEI) at the University of Chicago to serve as the initiative's intermediary. UEI was tasked with providing the intellectual, conceptual, and managerial leadership for the initiative as well as professional development and technical assistance focused on literacy and leadership to the Pathway districts and schools. UEI anchored this support on two, validated diagnostic tools developed at the University of Chicago: the Strategic Teaching and Evaluation of Progress (STEP) developmental literacy assessment and the 5Essentials Survey.Participating Pathway schools and districts carried out the day-to-day work of the initiative. They used grant funds to expand or refine their PreK programs; hire additional staff such as program managers, literacy coaches, classroom aides, and family engagement liaisons; and purchase high-quality instructional materials, such as classroom libraries or tablets.An advisory group, the Education and Learning National Advisory Committee (ELNAC), was established in 2010 to help inform decisions about the initiative. SRI International has served as the initiative's evaluator since 2010

Determination and evaluation of clinically efficient stopping criteria for the multiple auditory steady-state response technique

Background: Although the auditory steady-state response (ASSR) technique utilizes objective statistical detection algorithms to estimate behavioural hearing thresholds, the audiologist still has to decide when to terminate ASSR recordings introducing once more a certain degree of subjectivity. Aims: The present study aimed at establishing clinically efficient stopping criteria for a multiple 80-Hz ASSR system. Methods: In Experiment 1, data of 31 normal hearing subjects were analyzed off-line to propose stopping rules. Consequently, ASSR recordings will be stopped when (1) all 8 responses reach significance and significance can be maintained for 8 consecutive sweeps; (2) the mean noise levels were ≤ 4 nV (if at this “≤ 4-nV” criterion, p-values were between 0.05 and 0.1, measurements were extended only once by 8 sweeps); and (3) a maximum amount of 48 sweeps was attained. In Experiment 2, these stopping criteria were applied on 10 normal hearing and 10 hearing-impaired adults to asses the efficiency. Results: The application of these stopping rules resulted in ASSR threshold values that were comparable to other multiple-ASSR research with normal hearing and hearing-impaired adults. Furthermore, in 80% of the cases, ASSR thresholds could be obtained within a time-frame of 1 hour. Investigating the significant response-amplitudes of the hearing-impaired adults through cumulative curves indicated that probably a higher noise-stop criterion than “≤ 4 nV” can be used. Conclusions: The proposed stopping rules can be used in adults to determine accurate ASSR thresholds within an acceptable time-frame of about 1 hour. However, additional research with infants and adults with varying degrees and configurations of hearing loss is needed to optimize these criteria