Implementing the LifeSkills Training drug prevention program: factors related to implementation fidelity

<p>Abstract</p> <p>Background</p> <p>Widespread replication of effective prevention programs is unlikely to affect the incidence of adolescent delinquency, violent crime, and substance use until the quality of implementation of these programs by community-based organizations can be assured.</p> <p>Methods</p> <p>This paper presents the results of a process evaluation employing qualitative and quantitative methods to assess the extent to which 432 schools in 105 sites implemented the LifeSkills Training (LST) drug prevention program with fidelity. Regression analysis was used to examine factors influencing four dimensions of fidelity: adherence, dosage, quality of delivery, and student responsiveness.</p> <p>Results</p> <p>Although most sites faced common barriers, such as finding room in the school schedule for the program, gaining full support from key participants (i.e., site coordinators, principals, and LST teachers), ensuring teacher participation in training workshops, and classroom management difficulties, most schools involved in the project implemented LST with very high levels of fidelity. Across sites, 86% of program objectives and activities required in the three-year curriculum were delivered to students. Moreover, teachers were observed using all four recommended teaching practices, and 71% of instructors taught all the required LST lessons. Multivariate analyses found that highly rated LST program characteristics and better student behavior were significantly related to a greater proportion of material taught by teachers (adherence). Instructors who rated the LST program characteristics as ideal were more likely to teach all lessons (dosage). Student behavior and use of interactive teaching techniques (quality of delivery) were positively related. No variables were related to student participation (student responsiveness).</p> <p>Conclusion</p> <p>Although difficult, high implementation fidelity by community-based organizations can be achieved. This study suggests some important factors that organizations should consider to ensure fidelity, such as selecting programs with features that minimize complexity while maximizing flexibility. Time constraints in the classroom should be considered when choosing a program. Student behavior also influences program delivery, so schools should train teachers in the use of classroom management skills. This project involved comprehensive program monitoring and technical assistance that likely facilitated the identification and resolution of problems and contributed to the overall high quality of implementation. Schools should recognize the importance of training and technical assistance to ensure quality program delivery.</p

Strategies for enhancing the adoption of school-based prevention programs: Lessons learned from the blueprints for violence prevention replications of the life skills training program

Widespread implementation of effective programs is unlikely to affect the incidence of violent crime unless there is careful attention given to the quality of implementation, including identification of the problems associated with the process of implementation and strategies for overcoming these obstacles. Here we describe the results of a process evaluation focused on discovering common implementation obstacles faced by schools implementing the Life Skills Training (LST) drug prevention program. The evaluation was conducted by the Center for the Study and Prevention of Violence (CSPV) under the Blueprints for Violence Prevention Initiative in conjunction with the designer of the LST program, Dr. Gilbert Botvin and his dissemination agency, National Health Promotion Associates (NHPA), and was funded by the Office of Juvenile Justice and Delinquency Prevention (OJJDP). This evaluation revealed that the 70 sites involved in the project faced many obstacles when implementing this science-based program in the "real" classroom setting, outside the rigorous controls of a research trial. Nonetheless, the schools were very successful in delivering the program in its entirety and with a high level of fidelity to the program model, and we attribute much of this success to the high level of independent monitoring provided by CSPV, as well as our ongoing efforts to work with schools to identify and overcome problems associated with implementation

Evidence-based programs registry: Blueprints for Healthy Youth Development

AbstractThere is a growing demand for evidence-based programs to promote healthy youth development, but this growth has been accompanied by confusion related to varying definitions of evidence-based and mixed messages regarding which programs can claim this designation. The registries that identify evidence-based programs, while intended to help users sift through the findings and claims regarding programs, has oftentimes led to more confusion with their differing standards and program ratings. The advantages of using evidence-based programs and the importance of adopting a high standard of evidence, especially when taking programs to scale,are described. One evidence-based registry is highlighted—Blueprints for Healthy Youth Development hosted at the University of Colorado Boulder.Unlike any previous initiative of its kind, Blueprintsestablished unmatched standards for identifying evidence-based programs and has acted in a way similar to the FDA – evaluating evidence, data and research to determine which programs meet their high standard of proven efficacy