Collaborative research between clinicians and researchers: a multiple case study of implementation

<p>Abstract</p> <p>Background</p> <p>Bottom-up, clinician-conceived and directed clinical intervention research, coupled with collaboration from researcher experts, is conceptually endorsed by the participatory research movement. This report presents the findings of an evaluation of a program in the Veterans Health Administration meant to encourage clinician-driven research by providing resources believed to be critical. The evaluation focused on the extent to which funded projects: maintained integrity to their original proposals; were methodologically rigorous; were characterized by collaboration between partners; and resulted in sustained clinical impact.</p> <p>Methods</p> <p>Researchers used quantitative (survey and archival) and qualitative (focus group) data to evaluate the implementation, evaluation, and sustainability of four clinical demonstration projects at four sites. Fourteen research center mentors and seventeen clinician researchers evaluated the level of collaboration using a six-dimensional model of participatory research.</p> <p>Results</p> <p>Results yielded mixed findings. Qualitative and quantitative data suggested that although the process was collaborative, clinicians' prior research experience was critical to the quality of the projects. Several challenges were common across sites, including subject recruitment, administrative support and logistics, and subsequent dissemination. Only one intervention achieved lasting clinical effect beyond the active project period. Qualitative analyses identified barriers and facilitators and suggested areas to improve sustainability.</p> <p>Conclusions</p> <p>Evaluation results suggest that this participatory research venture was successful in achieving clinician-directed collaboration, but did not produce sustainable interventions due to such implementation problems as lack of resources and administrative support.</p

Implementing the LifeSkills Training drug prevention program: factors related to implementation fidelity

<p>Abstract</p> <p>Background</p> <p>Widespread replication of effective prevention programs is unlikely to affect the incidence of adolescent delinquency, violent crime, and substance use until the quality of implementation of these programs by community-based organizations can be assured.</p> <p>Methods</p> <p>This paper presents the results of a process evaluation employing qualitative and quantitative methods to assess the extent to which 432 schools in 105 sites implemented the LifeSkills Training (LST) drug prevention program with fidelity. Regression analysis was used to examine factors influencing four dimensions of fidelity: adherence, dosage, quality of delivery, and student responsiveness.</p> <p>Results</p> <p>Although most sites faced common barriers, such as finding room in the school schedule for the program, gaining full support from key participants (i.e., site coordinators, principals, and LST teachers), ensuring teacher participation in training workshops, and classroom management difficulties, most schools involved in the project implemented LST with very high levels of fidelity. Across sites, 86% of program objectives and activities required in the three-year curriculum were delivered to students. Moreover, teachers were observed using all four recommended teaching practices, and 71% of instructors taught all the required LST lessons. Multivariate analyses found that highly rated LST program characteristics and better student behavior were significantly related to a greater proportion of material taught by teachers (adherence). Instructors who rated the LST program characteristics as ideal were more likely to teach all lessons (dosage). Student behavior and use of interactive teaching techniques (quality of delivery) were positively related. No variables were related to student participation (student responsiveness).</p> <p>Conclusion</p> <p>Although difficult, high implementation fidelity by community-based organizations can be achieved. This study suggests some important factors that organizations should consider to ensure fidelity, such as selecting programs with features that minimize complexity while maximizing flexibility. Time constraints in the classroom should be considered when choosing a program. Student behavior also influences program delivery, so schools should train teachers in the use of classroom management skills. This project involved comprehensive program monitoring and technical assistance that likely facilitated the identification and resolution of problems and contributed to the overall high quality of implementation. Schools should recognize the importance of training and technical assistance to ensure quality program delivery.</p