The legend of the large MCAS gains of 2000-2001.

Issues related to student, teacher, and school accountability have been at the forefront of current educational policy initiatives. Recently, the state of Massachusetts has become a focal point in debate regarding the efficacy of high-stakes accountability models based on an ostensibly large gain at 10th grade. This paper uses an IRT method for evaluating the validity of 10th grade performance gains from 2000 to 2001 on the Massachusetts Comprehensive Assessment System (MCAS) tests in English Language Arts (ELA) and mathematics. We conclude that a moderate gain was obtained in ELA and a small gain in mathematics

A Meta-Analysis of Research on Sensory Integration Treatment

Objective. The purpose of this study was to find whether existing studies of treatment using sensory integration approaches support the efficacy of these approaches. Method. With meta-analysis, the results of sensory integration efficacy research studies published from 1972 to the present were synthesized and analyzed. Sixteen studies were used to compare sensory integration effect with no treatment (SI/NT), and 16 were used to compare sensory integration effect with alternative treatments (SI/ALT). Overall average effect sizes, comparisons of the effect sizes for different dependent variables, and secondary factors associated with effect size variation were examined. Results. The weighted average effect size of SI/NT studies was .29. However, there was a significant difference between the average effect sizes of the earlier studies (.60) and the more recent studies (.03). Of the outcome measures, larger effect sizes were found in the psychoeducational category (.39) and motor category (.40). Of SI/ALT studies, the average effect size was .09, not significantly different from zero. Conclusion. Three central conclusions can be made. First, in the SI/NT comparison, a significant effect was replicated for sensory integration treatment effects in earlier studies, but more recent studies did not show overall positive effects. Second, larger effect sizes were found in psychoeducational and motor categories. Third, sensory integration treatment methods were found to be as effective as various alternative treatment methods

Teaching Children to Read : The Fragile Link Between Science & Federal Education Policy

Teaching Children to Read (TCR) has stirred much controversy among reading experts regarding the efficacy of phonics instruction. This report, which was conducted by the National Reading Panel (NRP), has also played an important role in subsequent federal policy regarding reading instruction. Using meta-analysis, the NRP found that systematic phonics instruction was more effective than alternatives in teaching children to read. In the present study, the findings and procedures leading to TCR were examined. We concluded that the methodology and procedures in TCR were not adequate for synthesizing the research literature on phonics instruction. Moreover, we estimated a smaller though still substantial effect (d = .24) for systematic phonics, but we also found an effect for systematic language activities (d = .29) and tutoring (d = .40). Systematic phonics instruction when combined with language activities and individual tutoring may triple the effect of phonics alone. As federal policies are formulated around early literacy curricula and instruction, these findings indicate that phonics, as one aspect of the complex reading process, should not be over-emphasized

A response to Steubing et al., "Effects of systematic phonics instruction are practically significant": The origins of the National Reading Panel.

A recent article by Stuebing, Barth, Cirino, Francis and Fletcher critiqued the findings of Camilli, Vargas, and Yurecko (2003) and Camilli, Wolfe, and Smith (2006). With a methodological argument, they attempted to resolve the conflict between these studies and the original report Teaching Children to Read (National Reading Panel, 2000). In response, it is argued that three issues must be considered in a fair assessment of the NRP report—program labels or bins, alternative bins, and the role of literacy activities in reading instruction. In this light, three hypotheses ventured by Stuebing et al. are analyzed. It is concluded that the argument by Stuebing et al. does not reveal flaws in the original NRP report by Camilli et al. (2003), though some points of agreement are acknowledged

Illustration of a multilevel model for meta-analysis

Clustering effect and non-zero intraclass correlation produce the variability that can be observed in meta-analytic data. Statistical modeling is shown to provide a flexible approach to capturing and describing this empirical variability. The most common multilevel approach to analyzing data from meta-analysis is illustrated in this article with a set of 177 studies of behavioral therapies. © 2007 American Counseling Association. All rights reserved.Link_to_subscribed_fulltex