Using Teacher Logs to Measure the Enacted Curriculum: A Study of Literacy Teaching in Third‐Grade Classrooms

In this article we examine methodological and conceptual issues that emerge when researchers measure the enacted curriculum in schools. After outlining key theoretical considerations that guide measurement of this construct and alternative strategies for collecting and analyzing data on it, we illustrate one approach to gathering and analyzing data on the enacted curriculum. Using log data on the reading/language arts instruction of more than 150 third‐grade teachers in 53 high‐poverty elementary schools participating in the Study of Instructional Improvement, we estimated several hierarchical linear models and found that the curricular content of literacy instruction (a) varied widely from day to day, (b) did not vary much among students in the same classroom, but (c) did vary greatly across classrooms, largely as the result of teachers’ participation in 1 of the 3 instructional improvement interventions (Accelerated Schools, America’s Choice, and Success for All) under study. The implications of these findings for future research on the enacted curriculum are discussed

School Improvement by Design: Lessons From a Study of Comprehensive School Reform Programs

This CPRE report is a reprint of a chapter that originally appeared as Chapter 49 of the Handbook of Education Policy Research, edited by Gary Sykes, Barbara Schneider, and DavidN.Plank and published for theAmerican Educational Research Association by Routledge Publishers in 2009. The reprinted chapter presents key findings from A Study of Instructional Improvement, a study that was conducted under the auspices of the Consortium for Policy Research in Education and directed by Brian Rowan, David K. Cohen, and Deborah Loewenberg Ball (all at the University of Michigan).This study examined the design, implementation, and instructional effectiveness of three of America’s most widely disseminated comprehensive school reform programs (the Accelerated Schools Project,America’s Choice, and Successful forAll) over a four year period that encompassed the school years 2000–2001 through 2003–2004. During the course of the study, data were collected in 115 elementary schools in every region of the United States,with more than 5,300 teachers, 800 school leaders, and 7,500 students and their families participating

NEPC Review: Asking Students about Teaching: Student Perception Surveys and Their Implementation

Asking Students about Teaching seeks to establish that student surveys provide valid evidence that can be used for evaluation of and feedback for teachers. The report then proceeds to advise practitioners about optimal practices for administering student surveys and using survey information. As the report contends, student surveys are a useful tool in practitioners’ and policymakers’ toolkits, and the report contains many practical pieces of advice that are sensible and worth putting into practice. But a major limitation of the report is that the claimed relationship between student survey reports and teacher effectiveness is not supported by the evidence provided. A broader limitation of the report is that many of the findings and conclusions are presented too uncritically and without sufficient justification. Developers of the MET project embrace the idea that multiple measures of teaching effectiveness are needed to represent such a complex, multi-faceted phenomenon. In discussing the potential uses of student surveys, however, this report’s stance is lopsided, placing too much weight on the strengths of student surveys and not enough weight on their weaknesses. A potential concern is that glib implementation of some of the report’s recommendations might result in an unwarranted overconfidence in student survey results

Choosing STEM College Majors: Exploring the Role of Pre-College Engineering Courses

Despite the recent policy proclamations urging state and local educators to implement integrated science, technology, engineering, and mathematics (STEM) curricula, relatively little is known about the role and impact of pre-college engineering courses within these initiatives. When combined with appropriate mathematics and science courses, high school engineering and engineering technology (E&ET) courses may have the potential to provide students with pre-college learning experiences that encourage them to pursue STEM college majors. Our central research question was: What is the nature and extent of any relationship between high school E&ET course completion and subsequent selection of a STEM major in a two-year or four-year college? Using the first and second follow-up datasets of the Education Longitudinal Study of 2002, we examined the direction and magnitude of the association between E&ET course-taking in high school and postsecondary STEM program enrollment. We controlled for a wide array of factors identified in the literature as being associated with college major selection, allowing us to better isolate the association between high school E&ET course-taking and college major selection. Overall, students who earned three credits in E&ET courses were 1.60 times more likely to enroll in STEM majors in four-year institutions than students who did not earn high school E&ET credits. This positive, significant association persisted even after controlling for students’ social backgrounds, academic preparation and attitudes during high school, college choice considerations, and early postsecondary education experiences. In combination with a high school college readiness curriculum, E&ET courses potentially contribute in multiple ways to informing students’ selection of engineering and STEM college majors

Using Teacher Logs to Measure the Enacted Curriculum: A Study of Literacy Teaching in Third‐Grade Classrooms

In this article we examine methodological and conceptual issues that emerge when researchers measure the enacted curriculum in schools. After outlining key theoretical considerations that guide measurement of this construct and alternative strategies for collecting and analyzing data on it, we illustrate one approach to gathering and analyzing data on the enacted curriculum. Using log data on the reading/language arts instruction of more than 150 third‐grade teachers in 53 high‐poverty elementary schools participating in the Study of Instructional Improvement, we estimated several hierarchical linear models and found that the curricular content of literacy instruction (a) varied widely from day to day, (b) did not vary much among students in the same classroom, but (c) did vary greatly across classrooms, largely as the result of teachers’ participation in 1 of the 3 instructional improvement interventions (Accelerated Schools, America’s Choice, and Success for All) under study. The implications of these findings for future research on the enacted curriculum are discussed

School Improvement by Design: Lessons From a Study of Comprehensive School Reform Programs

general view, boxwoods in the henyard, 199