Bayesian Modeling of School Effects Using Hierarchical Models with Smoothing Priors

Abstract

We describe a new and flexible framework for modeling school effects. Like previous work in this area, we introduce an empirical model that evaluates school performance on the basis of student level test-score gains. Unlike previous work, however, we introduce a flexible model that relates follow-up student test scores to baseline student test scores and explore for possible nonlinearities in these relationships. Using data from High School and Beyond (HSB) and adapting the methodology described in Koop and Poirier (2004a), we test and reject the use of specifications that have been frequently used in research and as a basis for policy. We find that nonlinearities are important in the relationship between intake and follow-up achievement, that rankings of schools are sensitive to the model employed, and importantly, that commonly used specifications can give different and potentially misleading assessments of school performance. When estimating our preferred semiparametric specification, we find small but ``significant'' impacts of some school quality proxies (such as district-level expenditure per pupil) in the production of student achievement.