Implementation Fidelity and Attainment in Computerized Practice of Mathematics

Measuring the implementation fidelity (IF) or integrity of interventions is crucial, otherwise a positive or negative outcome cannot be interpreted. Direct and indirect methods of IF measurement tend to over-emphasize teacher behaviour. This paper focuses on IF measured by student behaviour collected through computers. Attainment was measured by the STAR test of maths (a computerized item-banked adaptive norm-referenced test). Implementation quality (IF) was measured by Accelerated Maths (AM) (an instruction-free personalized practice and progress-monitoring system in mastery of mathematics skills). Attainment data was gathered in the UK on 20,103 students in 148 schools, and of these implementation data on n=6,285. Only a small percentage of pupils scored on five AM implementation indices at or above the levels recommended. Correlations between attainment and implementation indices were modest, but high implementation was positively correlated with high attainment. Socio-economic status did not appear to affect implementation or attainment. Implementation quality of AM is clearly a problem in the UK, and needs improvement. However, overall students still scored above average on attainment

Of Research reviews and practice guides: Translating rapidly growing research on adolescent literacy into updated practice recommendations.

The demand for evidence-based instructional practices has driven a large supply of research on adolescent literacy. Documenting this supply, Baye, Inns, Lake, and Slavin’s 2019 article in Reading Research Quarterly synthesized far more studies, with far more rigorous methodology, than had ever been collected before. What does this mean for practice? Inspired by this article, I investigated how this synthesis compared with the 2008 U.S. Institute of Education Sciences practice guide for adolescent literacy. I also include two contemporary documents for context: Herrera, Truckenmiller, and Foorman’s (2016) review and the U.K. Education Endowment Foundation’s 2019 practice guide for secondary schools. I first examine how these documents define adolescent, reading, and evidence, and propose more inclusive definitions. I then compare their respective evidence bases, finding that the quality and quantity of evidence have dramatically changed. Only one of the 34 studies in the 2008 U.S. practice guide met Baye et al.’s inclusion criteria in 2019, and the average sample size in Baye et al.’s studies was 22 times as large as those in the 2008 U.S. practice guide. I also examine the potential implications for a new practice guide’s instructional recommendations and comment on the expansion of research in technology, disciplinary literacy, and writing—topics scarcely covered in the 2008 U.S. practice guide but which have been extensively researched since then. Finally, I call for revision of the U.S. practice guide and the establishment of standing committees on adolescent literacy to help educators translate the latest research findings into updated practices

What Works Clearinghouse Intervention Report: Lovaas Model of Applied Behavior Analysis

This report analyzes research performed to test the Lovaas Model of Applied Behavior Analysis. This behavior modification technique uses prompting and reinforcement to help with children who have disabilities