The Muzzled Dog That Didn’t Bark: Charters and the Behavioral Response of D.C. Public Schools

As of the 2006-2007 school year, 19,733 students attended charter schools in the District of Columbia, representing over a quarter of the District’s total public school student population and one of the largest charter school markets in the country.1 It is under such circumstances, some suggest, that choice will spur competition, ultimately leading to the improvement of public education. Yet, surprisingly little research has evaluated the behavioral response of public schools in D.C. to this source of competition. Most research to date on school choice in D.C. and elsewhere focuses on the largely positive “participant effects” that school choice programs have on choosers. By looking at the issue from the ground level of one of the most choice-prevalent districts in the United States, we seek to closely examine the causal dynamics of “systemic effects” induced by competition from within the D.C. education establishment. Our study consists of a series of interviews, focus groups, and surveys along three levels: District elites, principals, and teachers

Conducting Experiments in Public Management Research: A Practical Guide

This article provides advice on how to meet the practical challenges of experimental methods within public management research. We focus on lab, field, and survey experiments. For each of these types of experiments we outline the major challenges and limitations encountered when implementing experiments in practice and discuss tips, standards, and common mistakes to avoid. The article is multi-authored in order to benefit from the practical lessons drawn by a number of experimental researchers

Assessing the Impact of Holocaust Education on Adolescents’ Civic Values: Experimental Evidence from Arkansas

American adults overwhelmingly agree that the Holocaust should be taught in schools, yet few studies investigate the potential benefits of Holocaust education. We evaluate the impact of Holocaust education on several civic outcomes, including “upstander” efficacy (willingness to intervene on behalf of others), likelihood of exercising civil disobedience, empathy for the suffering of others, and tolerance of others with different values and lifestyles. We recruit students from two local high schools and randomize access to the Arkansas Holocaust Education Conference, where students have the chance to hear from a Holocaust survivor and to participate in breakout sessions with leading Holocaust experts. We find that students randomly assigned to attend the conference become more knowledgeable about the Holocaust and are more willing to act as an upstander on behalf of others. In our subgroup analysis, we find that minority students are significantly more willing to act as an upstander relative to their white peers

No Excuses Charter Schools: A Meta-Analysis of the Experimental Evidence on Student Achievement

While charter schools differ widely in philosophy and pedagogical views, the United States’s most famous urban charter schools typically use the No Excuses approach. Enrolling mainly poor and minority students, these schools feature high academic standards, strict disciplinary codes, extended instructional time, and targeted supports for low-performing students. The strenuous and regimented style is controversial amongst some scholars, but others contend that the No Excuses approach is needed to rapidly close the achievement gap. We conduct the first meta-analysis of the achievement impacts of No Excuses charter schools. Focusing on experimental studies, we find that No Excuses charter schools significantly improve math scores and reading scores. We estimate gains of 0.25 and 0.16 standard deviations on math and literacy achievement, respectively, as the effect of attending a No Excuses charter school for one year. Though the effect is large and meaningful, we offer some caveats to this finding and discuss policy implications for the United States as well as other countries