A comparison of two group cognitive behavioral therapy protocols for anxiety in urban schools: appropriateness, child outcomes, and cost-effectiveness

BackgroundCognitive behavioral therapy (CBT) for pediatric anxiety is efficacious for reducing anxiety symptoms and improving functioning, but many children are unable to access CBT for anxiety in community settings. Schools are an important setting in which children access mental health care, including therapy for anxiety. In this setting, therapy is usually delivered by Masters-level therapists.ObjectivesFriends for Life (FRIENDS), a 12-session, manualized, group CBT program for anxiety has demonstrated effectiveness when implemented in schools. However, prior research has also found challenges regarding feasibility and cultural fit when delivering FRIENDS in the urban school context. To address these challenges, we adapted FRIENDS for implementation in the school setting so that it might be more feasible and culturally appropriate for low-income, urban schools in the United States, while maintaining the core components of treatment. The current study uses a mixed-method approach to compare the effectiveness, cost-effectiveness, and perceived appropriateness of FRIENDS and CATS when delivered by Masters-level therapists with train-the-trainer support.Materials and methodsFirst, we compared change scores for student outcomes (i.e., child-report MASC-2 total score, parent-report MASC-2 total score, teacher-report Engagement and Disaffection subscale scores) from pre- to post- treatment between students receiving FRIENDS and students receiving CATS to assess whether the two conditions resulted in equivalent outcomes. Second, we compared the cost and cost-effectiveness between the groups. Finally, we used an applied thematic analysis to compare appropriateness of the interventions as perceived by therapists and supervisors.ResultsThe mean change score for the child-reported MASC-2 was 1.9 (SE = 1.72) points in the FRIENDS condition and 2.9 (SE = 1.73) points in the CATS condition; results indicated that the conditions were similar in their treatment effects, and symptom reductions were small in both groups. The modified protocol, CATS, was shown to cost significantly less to implement compared to FRIENDS and showed greater cost-effectiveness. Finally, compared to therapists and supervisors in the CATS condition, therapists and supervisors in the FRIENDS condition more strongly described aspects of the intervention that were not appropriate for their context and in need of more extensive adaptations.ConclusionRelatively brief, group CBT for anxiety, with adaptations to improve cultural fit, is a promising approach to treat youth anxiety symptom when delivered by school-based therapists with train-the-trainer implementation support

Development and evaluation of a remote training strategy for the implementation of mental health evidence-based practices in rural schools: pilot study protocol.

BACKGROUND: An increasing number of schools in rural settings are implementing multi-tier positive behavioral interventions and supports (PBIS) to address school-climate problems. PBIS can be used to provide the framework for the implementation of evidence-based practices (EBPs) to address children\u27s mental health concerns. Given the large service disparities for children in rural areas, offering EBPs through PBIS can improve access and lead to better long-term outcomes. A key challenge is that school personnel need technical assistance in order to implement EBPs with fidelity and clinical effectiveness. Providing ongoing on-site support is not feasible or sustainable in the majority of rural schools, due to their remote physical location. For this reason, remote training technology has been recommended for providing technical assistance to behavioral health staff (BHS) in under-served rural communities. OBJECTIVES: The purpose of this study is to use the user-centered design, guided by an iterative process (rapid prototyping), to develop and evaluate the appropriateness, feasibility, acceptability, usability, and preliminary student outcomes of two online training strategies for the implementation of EBPs at PBIS Tier 2. METHODS: The study will employ a pragmatic design comprised of a mixed-methods approach for the development of the training platform, and a hybrid type 2, pilot randomized controlled trial to examine the implementation and student outcomes of two training strategies: Remote Video vs. Remote Video plus Coaching. DISCUSSION: There is a clear need for well-designed remote training studies focused on training in non-traditional settings. Given the lack of well-trained mental health professionals in rural settings and the stark disparities in access to services, the development and pilot-testing of a remote training strategy for BHS in under-served rural schools could have a significant public health impact. ETHICS AND DISSEMINATION: The project was reviewed and approved by the institutional review board. Results will be submitted to ClinicalTrials.gov and disseminated to community partners and participants, peer-reviewed journals, and academic conferences. TRIAL REGISTRATION: ClinicialTrials.gov, NCT05034198 and NCT05039164

Integration of Mental Health Interventions Within PBIS: a Mixed-Methods Analysis

Schools face an unprecedent demand for mental health services. Student mental health problems can be addressed via a continuum of mental health evidence-based practices (EBPs) integrated within school-wide Positive Behavioral Interventions and Supports (PBIS). However, integrating mental health interventions with PBIS can be challenging. The purpose of this study is to examine the integration of mental health interventions with PBIS in a group of schools in Pennsylvania. We describe the extent to which schools implementing PBIS with fidelity were using mental health EBPs at tiers 2 and 3, examine recommendations about how to achieve further integration, and identify school professional needs for training and support. The study is based on a statewide sample of 48 K-8 schools. Members of the leadership team completed questionnaires and participated in qualitative interviews. Most schools had established advanced tiers of support and offered EBPs for externalizing behavior problems at tier 2. However, few schools reported offering mental health EBPs at tier 3, or interventions for internalizing problems. Qualitative analyses of interview transcripts revealed key recommendations regarding characteristics of interventions students should receive, who should provide the extra supports to students and the type of training that should be made available to school personnel and providers of tier 2 and tier 3 interventions. Participants indicated school mental health personnel did not receive adequate technical assistance to implement EBPs

Implementation resources to support teachers’ use of behavioral classroom interventions: protocol of a randomized pilot trial

Abstract Background Teacher-delivered behavioral classroom management interventions are effective for students with or at-risk for attention-deficit/hyperactivity disorder (ADHD) or other disruptive behavior challenges, but they can be difficult for teachers to use in the classroom. In this study, we will pilot test a package of implementation strategies to support teachers in using behavioral classroom interventions for students with ADHD symptoms. Methods We will use a 2-group, randomized controlled trial to compare outcomes for teachers who receive Positive Behavior Management Implementation Resources (PBMIR), a theory and data-driven implementation resource package designed to increase teacher implementation of behavioral classroom management interventions, with those who do not receive this additional implementation support. We will measure teacher implementation outcomes (e.g., observed fidelity to behavioral classroom interventions) and student clinical outcomes (e.g., ADHD-related impairment, ADHD symptoms, student–teacher relationship, academic performance) before and after an 8-week intervention period for both groups; we will also measure teacher-reported acceptability, appropriateness, and feasibility for the PBMIR group following the intervention period. Discussion If there is preliminary evidence of feasibility and effectiveness, this pilot study will provide the foundation for evaluation the PBMIR at a larger scale and the potential to improve outcomes for students with or at risk for ADHD. Trial registration This clinical trial was registered at ClinicalTrials.gov. ( https://clinicaltrials.gov/ ) on 8/5/2022 which was prior to the time of first participant enrollment. The registration number is: NCT05489081

Development of an Online Training Platform and Implementation Strategy for School-Based Mental Health Professionals in Rural Elementary Schools: A Mixed-Methods Study

Children in rural settings are less likely to receive mental health services than their urban and suburban counterparts and even less likely to receive evidence-based care. Rural schools could address the need for mental health interventions by using evidence-based practices within a tiered system of supports such as positive behavioral interventions and supports. However, very few school professionals, with or without mental health training, have received training on evidence-based practices. Rural schools need implementation strategies focused on training to prepare school personnel for the implementation of interventions with fidelity. Little is known about training strategies that are feasible and appropriate for the rural school context. User-centered design is an appropriate framework for the development of training strategies for professionals in rural schools because of its participatory approach and the development of products that fit the context where they are going to be used. The purpose of the study was to develop and assess components of an online training platform and implementation strategy based on the user-centered design. Quantitative and qualitative data from 25 participants from an equal number of schools in rural areas of Pennsylvania were used in the study. A mixed-methods design utilizing complementary descriptive statistics and theme analyses indicated that the training platform and implementation strategy were perceived as highly acceptable, appropriate, feasible and usable by school professionals. The resulting training platform and implementation strategy will fill a void in the training literature in rural schools

Implementation fidelity, student outcomes, and cost-effectiveness of train-the-trainer strategies for Masters-level therapists in urban schools: results from a cluster randomized trial

Abstract Background Little is known about the effectiveness and cost-effectiveness of train-the-trainer implementation strategies in supporting mental health evidence-based practices in schools, and about the optimal level of support needed for TT strategies. Methods The current study is part of a larger type 2 hybrid cluster randomized controlled trial. It compares two train-the-trainer strategies, Train-the-Trainer (TT) and Train-the-Trainer plus ongoing consultation for trainers (TT +) on the delivery of a group cognitive behavioral treatment protocol for anxiety disorders. Participants were 33 therapists, 29 supervisors, and 125 students who were at risk for anxiety disorders from 22 urban schools. Implementation outcomes were implementation fidelity and treatment dosage. Student outcomes were child- and parent-reported symptoms of anxiety, child-reported symptoms of depression, and teacher-reported academic engagement. We estimated the cost of implementing the intervention in each condition and examined the probability that a support strategy for supervisors (TT vs TT +) is a good value for varying values of willingness to pay. Results Therapists in the TT and TT + conditions obtained similarly high implementation fidelity and students in the conditions received similar treatment dosages. A mixed effects modeling approach for student outcomes revealed time effects for symptoms of anxiety and depression reported by students, and emotional disaffection reported by teachers. There were no condition or condition × times effects. For both conditions, the time effects indicated an improvement from pre-treatment to post-treatment in symptoms of anxiety and depression and academic emotional engagement. The average cost of therapist, supervisor, and consultant time required to implement the intervention in each condition was $1002 for TT and$1431 for TT + (p = 0.01). There was a greater than 80% chance that TT was a good value compared to TT + for all values of willingness to pay per one-point improvement in anxiety scores. Conclusions A TT implementation approach consisting of a thorough initial training workshop for therapists and supervisors as well as ongoing supervision for therapists resulted in adequate levels of fidelity and student outcomes but at a lower cost, compared to the TT + condition that also included ongoing external expert consultation for supervisors. Trial registration ClinicalTrials.gov identifier: NCT02651402

Study protocol: cluster randomized trial of consultation strategies for the sustainment of mental health interventions in under-resourced urban schools: rationale, design, and methods.

BACKGROUND: The school is a key setting for the provision of mental health services to children, particularly those underserved through traditional service delivery systems. School-wide Positive Behavioral Interventions and Supports (PBIS) is a tiered approach to service delivery based on the public health model that schools use to implement universal (Tier 1) supports to improve school climate and safety. As our prior research has demonstrated, PBIS is a useful vehicle for implementing mental and behavioral health evidence-based practices (EBPs) at Tier 2 for children with, or at risk for, mental health disorders. Very little research has been conducted regarding the use of mental health EBPs at Tier 2 or how to sustain implementation in schools. METHODS/DESIGN: The main aim of the study is to compare fidelity, penetration, cost-effectiveness, and student outcomes of Tier 2 mental health interventions across 2 sustainment approaches for school implementers in 12 K-8 schools. The study uses a 2-arm, cluster randomized controlled trial design. The two arms are: (a) Preparing for Sustainment (PS)-a consultation strategy implemented by school district coaches who receive support from external consultants, and (b) Sustainment as Usual (SAU)-a consultation strategy implemented by school district coaches alone. Participants will be 60 implementers and 360 students at risk for externalizing and anxiety disorders. The interventions implemented by school personnel are: Coping Power Program (CPP) for externalizing disorders, CBT for Anxiety Treatment in Schools (CATS) for anxiety disorders, and Check-in/Check-out (CICO) for externalizing and internalizing disorders. The Interactive Systems Framework (ISF) for Dissemination and Implementation guides the training and support procedures for implementers. DISCUSSION: We expect that this study will result in a feasible, effective, and cost-effective strategy for sustaining mental health EBPs that is embedded within a multi-tiered system of support. Results from this study conducted in a large urban school district would likely generalize to other large, urban districts and have an impact on population-level child mental health. Trial registration ClinicalTrials.gov identifier number NCT04869657. Registered May 3, 2021

Additional file 1 of Implementation fidelity, student outcomes, and cost-effectiveness of train-the-trainer strategies for Masters-level therapists in urban schools: results from a cluster randomized trial

Additional file 1: Supplementary Information 1. Training of clinical supervisors, therapists, and research consultants