The Effect of Token Economies on Student Behavior in the Preschool Classroom: A Meta-Analysis

There has been a recent push in the literature to identify and use more evidence-based practices for positive behavioral supports for challenging student behaviors in the classroom environment. Further, interest in targeting early education environments such as preschool has been growing given the persistence of behavioral difficulties in the absence of early and effective intervention (Campbell & Ewing, 1990; Kazdin, 1987; Powell et al., 2006; Stormont, 2002). Two previous meta-analyses (Maggin et al., 2011; Soares et al., 2016) provided some initial support for effectiveness of token economies with challenging student behavior; however, the inclusion of the preschool setting was limited and both studies used older versions of design standards to evaluate the quality of studies in the literature. The present study served to extend those meta-analyses by targeting preschool classrooms. Further, the current study included the most recent What Works Clearinghouse Design Standards to evaluate whether token economies meet criteria as an evidence-based practice. Ten studies were included in the final analyses. Two sets of effect sizes were calculated: Baseline-Corrected Tau and Hedge’s g. An omnibus effect size showed an overall large effect; however, similar to previous meta-analyses, several methodological concerns were identified. Moderator analyses for several variables were conducted; however, no moderator analyses were significant. Limitations and future directions were discussed

Developing a Brief Behavior Rating Scale for Progress Monitoring of Depression in School Settings

Frequent formative assessment of students’ functioning, or progress monitoring, is a critical component of multi-tiered systems of support as data inform data-driven decisions about response to treatment. Progress monitoring tools for students’ academic and behavioral functioning are readily available and widely researched; however, despite the documented prevalence of depressive disorders among youth and that schools have been put forth as an ideal location for the delivery of mental health services, there are currently no progress monitoring tools to examine students’ response to interventions that target depression. To address this gap, this study sought to develop a progress monitoring assessment of students’ depressive symptoms using an empirically informed model for creating Brief Behavior Rating Scales (BBRS). Using this model, a four-item BBRS of depressive symptoms (BBRS-D) was created from the item pools of the Beck Depression Inventory for Youth (BDI-Y) and Children’s Depression Inventory (CDI) administered during a treatment study of depression in female youth; the resulting short scale corresponds well to the full-length assessments (i.e., r = .65 and r = .59); however, the BBRS-D possessed lower than adequate internal consistency (α = .50

Antecedent Strategies to Promote Children\u27s and Adolescents\u27 Compliance with Adult Requests: A Review of the Literature

Compliance with adult requests and directives has often been described as a keystone behavior in children, meaning it is associated with engagement in other desirable and socially appropriate behaviors. As such, a great deal of research has been directed toward identifying strategies that increase compliance in children. Antecedent strategies, which focus on increasing the probability of compliance prior to or during the delivery of the directive or request, are popular because they have the potential to prevent noncompliance; however, it is not clear which of the numerous antecedent strategies are effective or for whom. Therefore, a systematic review of the antecedent strategies for compliance was completed. Forty-two studies were identified evaluating eight different antecedent strategies for children aged 1-19. It was determined that high-probability command sequences, effective instruction delivery, and errorless compliance training may all be considered evidence-based antecedent strategies to increase children\u27s compliance with adult requests

Toward a Standard Assembly of Linear Graphs

© 2017 American Psychological Association. Single-case data are frequently used in school psychology. In research, single-case designs allow experimenters to provide rigorous demonstrations of treatment effects on a smaller scale and with more precise measurement than traditional group experimental design. In practice, single-case data are used to evaluate the effects of school-based services to make decisions at the individual level within a multitiered system of support (MTSS). School psychology and related fields (e.g., special education) have worked to increase the rigor of single-case data by developing standards for single-case experimental design and developing robust single-case effect size statistics; however, in practice, single-case data are often collected with less experimental rigor and evaluated using visual analysis of a linear graph as opposed to quantitative effect sizes. This is concerning, as an emerging body of literature suggests that simple elements of the graphical display (e.g., ordinate axis scaling, ratio of X to Y axis length) can have a profound impact on effect size judgments made by visual analysts. Currently, there are no standards guiding the construction of linear graphs used to display single-case data. The purpose of this paper is to advance the perspective that our field must develop and adopt standards of linear graph construction or risk inaccurate decisions within a MTSS framework

The Impact of Ordinate Scaling On the Visual Analysis of Single-Case Data

Visual analysis is the primary method for detecting the presence of treatment effects in graphically displayed single-case data and it is often referred to as the “gold standard.” Although researchers have developed standards for the application of visual analysis (e.g., Horner et al., 2005), over- and underestimation of effect size magnitude is not uncommon among analysts. Several characteristics have been identified as potential contributors to these errors; however, researchers have largely focused on characteristics of the data itself (e.g., autocorrelation), paying less attention to characteristics of the graphic display which are largely in control of the analyst (e.g., ordinate scaling). The current study investigated the impact that differences in ordinate scaling, a graphic display characteristic, had on experts\u27 accuracy in judgments regarding the magnitude of effect present in single-case percentage data. 32 participants were asked to evaluate eight ABAB data sets (2 each presenting null, small, moderate, and large effects) along with three iterations of each (32 graphs in total) in which only the ordinate scale was manipulated. Results suggest that raters are less accurate in their detection of treatment effects as the ordinate scale is constricted. Additionally, raters were more likely to overestimate the size of a treatment effect when the ordinate scale was constricted

A Systematic Review of Function-Modified Check-In/Check-Out

Check-in/check-out (CICO) is widely used as a Tier 2 intervention within school-wide positive behavior interventions and supports. Evidence suggests that traditional CICO is primarily effective for students demonstrating problem behavior maintained by adult attention. A growing body of research has investigated function-modified CICO to address behaviors maintained by other consequences. The purpose of this review was to examine the evidence-base for function-modified versions of CICO to identify (a) the procedures used to assess students’ behavior function and (b) the types of modifications and additions to CICO that have been empirically evaluated. We systematically reviewed 11 studies that examined the effects of function-based CICO. Researchers determined behavior function using a combination of direct observations and indirect assessments. These methods were more involved than a brief behavior screening. The modifications and additions to traditional CICO included changes that were functionally relevant and functionally independent. Based on the results of this review, more research is needed before function-based CICO can be considered an evidence-based practice. Moreover, the extent to which educators can implement function-based CICO without researcher support is also unknown. The implications of this review are discussed in terms of future research and practice

The Effect of Data Points Per X- To Y-Axis Ratio On Visual Analysts Evaluation of Single-Case Graphs

© 2017 American Psychological Association. Research based on single-case designs (SCD) are frequently utilized in educational settings to evaluate the effect of an intervention on student behavior. Visual analysis is the primary method of evaluation of SCD, despite research noting concerns regarding reliability of the procedure. Recent research suggests that characteristics of the graphic display may contribute to poor reliability and overestimation of intervention effects. This study investigated the effect of increasing or decreasing the data points per xto y-axis ratio (DPPXYR) on rater evaluations of functional relation and effect size in SCD data sets. Twenty-nine individuals (58.6% male) with experience in SCD were asked to evaluate 40 multiple baseline data sets. Two data sets reporting null, small, moderate, and large intervention effects (8 total) were modified by manipulating the ratio of the x- to y-axis (5 variations), resulting in 40 total graphs. Results indicate that raters scored effects as larger as the DPPXYR decreased. Additionally, a 2-way within-subjects analysis of variance (ANOVA) revealed a significant main effect of DPPXYR manipulation on effect size rating, F(2.11, 58.98) = 58.05, p \u3c .001, η2 = .675, and an interaction between DPPXYR manipulation and magnitude of effect, F(6.71, 187.78) = 11.45, p \u3c .001, η2 = .29. Overall, results of the study indicate researchers and practitioners should maintain a DPPXYR of .14 or larger in the interest of more conservative effect size judgments

Behavior Interventions In the Restroom: Flushing Away Noise

This study investigated the effectiveness of Flushing Away Noise, an interdependent group contingency using an iPod equipped with a decibel meter application, for reducing noise in restrooms. Two Head Start classrooms in the Southeastern United States, referred for demonstrating high levels of student noise in the restroom,were included in the study. The authors used a multiplebaseline design across 4 groups to determine existence of a functional relation between implementation of the intervention and a decrease in noise level. After introducing the intervention, the authors observed substantial decreases in noise level in all groups. In addition, teachers indicated that they found the intervention socially acceptable. The results support the utility of Flushing Away Noise for promoting behavioral expectations in a bathroom setting

Generalizability of Multiple Measures of Treatment Integrity: Comparisons Among Direct Observation, Permanent Products, and Self-Report

The concept of treatment integrity is an essential component to databased decision making within a response-to-intervention model. Although treatment integrity is a topic receiving increased attention in the school-based intervention literature, relatively few studies have been conducted regarding the technical adequacy of treatment integrity assessment methods. In light of recent research utilizing generalizability theory (G theory) to assess the dependability of behavioral measurement in schools, the current study used G theory to examine the dependability of direct observation, permanent products, and self-report as measures of treatment integrity when six teachers implemented the Good Behavior Game across three study sites. Results indicated that direct observation yielded the most reliable treatment integrity data, followed by permanent products and self-report. Specifically, when assessment of treatment integrity is conducted twice per week, direct observation should provide a dependable estimate (phi = .821) after only four assessments. Implications, limitations, and future directions are discussed

The Effects of Peer-Mediated Check-In/Check-Out on the Social Skills of Socially Neglected Students

Check-In/Check-Out (CICO) is a moderately effective Tier 2 intervention often used to address attention-maintained problem behaviors in schools. Recent studies on CICO have demonstrated the effectiveness of the intervention when combined with social skills training and when utilizing students’ peers as interventionists. Using a concurrent multiple baseline across participants design, the present study evaluated the effectiveness of peer-mediated CICO to target social skills in elementary school students identified as socially neglected using a sociometric classification system. Results, implications for practice, limitations, and future directions are discussed