Organizing Schools to Improve Student Achievement: Start Times, Grade Configurations, and Teacher Assignments

Education reform proposals are often based on high-profile or dramatic policy changes, many of which are expensive, politically controversial, or both. In this paper, we argue that the debates over these "flashy" policies have obscured a potentially important direction for raising student performance -- namely, reforms to the management or organization of schools. By making sure the "trains run on time" and focusing on the day-to-day decisions involved in managing the instructional process, school and district administrators may be able to substantially increase student learning at modest cost.In this paper, we describe three organizational reforms that recent evidence suggests have the potential to increase K -- 12 student performance at modest costs: (1) Starting school later in the day for middle and high school students; (2) Shifting from a system with separate elementary and middle schools to one with schools that serve students in kindergarten through grade eight; (3) Managing teacher assignments with an eye toward maximizing student achievement (e.g. allowing teachers to gain experience by teaching the same grade level for multiple years or having teachers specializing in the subject where they appear most effective). We conservatively estimate that the ratio of benefits to costs is 9 to 1 for later school start times and 40 to 1 for middle school reform. A precise benefit-cost calculation is not feasible for the set of teacher assignment reforms we describe, but we argue that the cost of such proposals is likely to be quite small relative to the benefits for students. While we recognize that these specific reforms may not be appropriate or feasible for every district, we encourage school, district, and state education leaders to make the management, organization, and operation of schools a more prominent part of the conversation on how to raise student achievement

Remedial Education and Student Achievement: A Regression-Discontinuity Analysis

As standards and accountability have become an increasingly prominent feature of the educational landscape, educators have relied more on remedial programs such as summer school and grade retention to help low-achieving students meet minimum academic standards. Yet the evidence on the effectiveness of such programs is mixed, and prior research suffers from selection bias. However, recent school reform efforts in Chicago provide an opportunity to examine the causal impact of these remedial education programs. In 1996, the Chicago Public Schools instituted an accountability policy that tied summer school and promotional decisions to performance on standardized tests, which resulted in a highly non-linear relationship between current achievement and the probability of attending summer school or being retained. Using a regression discontinuity design, we find that the net effect of these programs was to substantially increase academic achievement among third graders, but not sixth graders. In addition, contrary to conventional wisdom and prior research, we find that retention increases achievement for third grade students and has little effect on math achievement for sixth grade students.

What Do Parents Value in Education? An Empirical Investigation of Parents' Revealed Preferences for Teachers

This paper examines revealed parent preferences for their children's education using a unique data set that includes the number of parent requests for individual elementary school teachers along with information on teacher attributes including principal reports of teacher characteristics that are typically unobservable. We find that, on average, parents strongly prefer teachers that principals describe as good at promoting student satisfaction and place relatively less value on a teacher's ability to raise standardized math or reading achievement. These aggregate effects, however, mask striking differences across family demographics. Families in higher poverty schools strongly value student achievement and are essentially indifferent to the principal's report of a teacher's ability to promote student satisfaction. The results are reversed for families in higher-income schools.

The Impact of Teacher Training on Student Achievement: Quasi-Experimental Evidence from School Reform Efforts in Chicago

While there is a substantial literature on the relationship between general teacher characteristics and student learning, school districts and states often rely on in-service teacher training as a part of school reform efforts. Recent school reform efforts in Chicago provide an opportunity to examine in-service training using a quasi-experimental research design. In this paper, we use a regression discontinuity strategy to estimate the effect of teacher training on the math and reading performance of elementary students. We find that marginal increases in-service training have no statistically or academically significant effect on either reading or math achievement, suggesting that modest investments in staff development may not be sufficient to increase the achievement of elementary school children in high poverty schools.

Are Idle Hands the Devil's Workshop? Incapacitation, Concentration and Juvenile Crime

This paper examines the short-term effect of school on juvenile crime. To do so, we bring together daily measures of criminal activity and detailed school calendar information from 29 jurisdictions across the country, and use the plausibly exogenous variation generated by teacher in-service days to estimate the school-crime relationship. We find that the level of property crime committed by juveniles decreases by 14 percent on days when school is in session, but that the level of violent crime increases by 28 percent on such days. These results do not appear to be driven by inflated reporting of crime on school days or substitution of crime across days. Our findings suggest that incapacitation and concentration influence juvenile crime - when juveniles are not engaged in supervised activities, they are more likely to engage in certain anti-social behaviors; at the same time, the increase in interactions associated with school attendance leads to more interpersonal conflict and violence. These results underscore the social nature of violent crime and suggest that youth programs - particularly those with no educational component such as midnight basketball or summer concerts - may entail important tradeoffs in terms of their effects on juvenile crime.

Principals as Agents: Subjective Performance Measurement in Education

In this paper, we compare subjective principal assessments of teachers to the traditional determinants of teacher compensation ¡V education and experience ¡V and another potential compensation mechanism -- value-added measures of teacher effectiveness based on student achievement gains. We find that subjective principal assessments of teachers predict future student achievement significantly better than teacher experience, education or actual compensation, though not as well as value-added teacher quality measures. In particular, principals appear quite good at identifying those teachers who produce the largest and smallest standardized achievement gains in their schools, but have far less ability to distinguish between teachers in the middle of this distribution and systematically discriminate against male and untenured faculty. Moreover, we find that a principal¡¦s overall rating of a teacher is a substantially better predictor of future parent requests for that teacher than either the teacher¡¦s experience, education and current compensation or the teacher¡¦s value-added achievement measure. These findings not only inform education policy, but also shed light on subjective performance assessment more generally.

Educational Expectations and Attainment

This paper examines the role of educational expectations in the educational attainment process. We utilize data from a variety of datasets to document and analyze the trends in educational expectations between the mid-1970s and the early 2000s. We focus on differences across racial/ethnic and socioeconomic groups and examine how young people update their expectations during high school and beyond. The results indicate that expectations rose for all students with the greatest increases among young women. Expectations have become somewhat less predictive of attainment over the past several decades but expectations remain strong predictors of attainment above and beyond other standard determinants of schooling. Interestingly, the data demonstrate that the majority (about 60 percent) of students update their expectations at least once between eighth grade and eight years post-high school. Updating appears to be based, in part, on the acquisition of new information about academic ability.

Rotten Apples: An Investigation of the Prevalence and Predictors of Teacher Cheating

We develop an algorithm for detecting teacher cheating that combines information on unexpected test score fluctuations and suspicious patterns of answers for students in a classroom. Using data from the Chicago Public Schools, we estimate that serious cases of teacher or administrator cheating on standardized tests occur in a minimum of 4-5 percent of elementary school classrooms annually. Moreover, the observed frequency of cheating appears to respond strongly to relatively minor changes in incentives. Our results highlight the fact that incentive systems, especially those with bright line rules, often induce behavioral distortions such as cheating. Statistical analysis, however, may provide a means of detecting illicit acts, despite the best attempts of perpetrators to keep them clandestine.

Catching Cheating Teachers: The Results of an Unusual Experiment in Implementing Theory

This paper reports on the results of a prospective implementation of methods for detecting teacher cheating. In Spring 2002, over 100 Chicago Public Schools elementary classrooms were selected for retesting based on the cheating detection algorithm. Classrooms prospectively identified as likely cheaters experienced large test score declines. In contrast, classes that had large test score gains on the original test, but were prospectively identified as being unlikely to have cheated, maintained their original gains. Randomly selected classrooms also maintained their gains. The cheating detection tools were thus demonstrated to be effective in distinguishing between classrooms that achieved large test-score gains as a consequence of cheating versus those whose gains were the result of outstanding teaching. In addition, the data generated by the implementation experiment highlight numerous ways in which the original cheating detection methods can be improved in the future.