Acceptability and feasibility of peer assisted supervision and support for intervention practitioners: a Q-methodology evaluation

Evidence-based interventions often include quality improvement methods to support fidelity and improve client outcomes. Clinical supervision is promoted as an effective way of developing practitioner confidence and competence in delivery; however, supervision is often inconsistent and embedded in hierarchical line management structures that may limit the opportunity for reflective learning. The Peer Assisted Supervision and Support (PASS) supervision model uses peer relationships to promote the self-regulatory capacity of practitioners to improve intervention delivery. The aim of the present study was to assess the acceptability and feasibility of PASS amongst parenting intervention practitioners. A Q-methodology approach was used to generate data and 30 practitioners volunteered to participate in the study. Data were analyzed and interpreted using standard Q-methodology procedures and by-person factor analysis yielded three factors. There was consensus that PASS was acceptable. Participants shared the view that PASS facilitated an environment of support where negative aspects of interpersonal relationships that might develop in supervision were not evident. Two factors represented the viewpoint that PASS was also a feasible model of supervision. However, the third factor was comprised of practitioners who reported that PASS could be time consuming and difficult to fit into existing work demands. There were differences across the three factors in the extent to which practitioners considered PASS impacted on their intervention delivery. The findings highlight the importance of organizational mechanisms that support practitioner engagement in supervision

The side effects of service changes: exploring the longitudinal impact of participation in a randomised controlled trial (DOORWAYS) on staff perceptions of barriers to change

Background: Staff and service users have expressed concerns that service improvements in British mental health wards have been slow or transient. It is possible that certain changes are positive for some (e.g. service users), but negative for others (e.g. staff), which may affect implementation success. In this study, we explore whether a programme of change to improve the therapeutic milieu on mental health wards influenced staff perceptions of barriers to change, 12 months after implementation. Method: A cluster randomised controlled trial called DOORWAYS was conducted on eight British, inner-city acute mental health wards. Randomisation was achieved using a list randomly generated by a computer. A psychologist trained ward staff (mainly nurses) to deliver evidence-based groups and supported their initial implementation. The impact of these changes was measured over 12 months (when 4 wards were randomised), according to nurses’ perceptions of barriers to change (VOCALISE), using unstructured multivariate linear regression models. This innovative analysis method allows maximum use of data in randomised controlled trials with reduced sample sizes due to substantial drop out rates. The contextual influences of occupational status (staff) and of workplace setting (ward) were also considered. Results: Staff who participated in the intervention had significantly worse perceptions of barriers to change at follow up. The perceptions of staff in the control group did not change over time. In both groups (N = 120), direct care staff had more negative perceptions of barriers to change, and perceptions varied according to ward. Across time, direct care staff in the intervention group became more negative than those in the control group. Conclusion: Participation in this program of change, worsened staff perceptions of barriers to change. In addition, occupational status (being from the direct care group) had a negative effect on perceptions of barriers to change, an effect that continued across time and was worse in the intervention group. Those providing direct care should be offered extra support when changes are introduced and through the implementation process. More effort should be placed around reducing the perceived burden of innovation for staff in mental health wards

Clinician and Parent Perspectives on Parent and Family Contextual Factors that Impact Community Mental Health Services for Children with Behavior Problems

The present study employed qualitative methods to examine multiple stakeholder perspectives regarding the role of parent and family contextual factors on community child mental health treatment for children with behavior problems. Findings suggest agreement between clinicians and parents on the number, types and importance of parent and family factors in children’s mental health services; however, stakeholders differed in reports of which factors were most salient. Specifically, clinicians endorsed most factors as being equally salient, while parents described a few salient factors, with parental stress and inadequate social support being the most frequently discussed. These qualitative data further elucidate the context of community services and have implications for evidence-based practice implementation and improving community care

Innovations in mental health services implementation: a report on state-level data from the U.S. Evidence-Based Practices Project

BACKGROUND: The Evidence-Based Practice (EBP) Project has been investigating the implementation of evidence-based mental health practices (Assertive Community Treatment, Family Psychoeducation, Integrated Dual Diagnosis Treatment, Illness Management and Recovery, and Supported Employment) in state public mental health systems in the United States since 2001. To date, Project findings have yielded valuable insights into implementation strategy characteristics and effectiveness. This paper reports results of an effort to identify and classify state-level implementation activities and strategies employed across the eight states participating in the Project. METHODS: Content analysis and Greenhalgh et al's (2004) definition of innovation were used to identify and classify state-level activities employed during three phases of EBP implementation: Pre-Implementation, Initial Implementation and Sustainability Planning. Activities were coded from site visit reports created from documents and notes from key informant interviews conducted during two periods, Fall 2002 – Spring 2003, and Spring 2004. Frequency counts and rank-order analyses were used to examine patterns of implementation activities and strategies employed across the three phases of implementation. RESULTS: One hundred and six discreet implementation activities and strategies were identified as innovative and were classified into five categories: 1) state infrastructure building and commitment, 2) stakeholder relationship building and communications, 3) financing, 4) continuous quality management, and 5) service delivery practices and training. Implementation activities from different categories were employed at different phases of implementation. CONCLUSION: Insights into effective strategies for implementing EBPs in mental health and other health sectors require qualitative and quantitative research that seeks to: a) empirically test the effects of tools and methods used to implement EBPs, and b) establish a stronger evidence-base from which to plan, implement and sustain such efforts. This paper offers a classification scheme and list of innovative implementation activities and strategies. The classification scheme offers potential value for future studies that seek to assess the effects of various implementation processes, and helps establish widely accepted standards and criteria that can be used to assess the value of innovative activities and strategies

Outcomes for Implementation Research: Conceptual Distinctions, Measurement Challenges, and Research Agenda

An unresolved issue in the field of implementation research is how to conceptualize and evaluate successful implementation. This paper advances the concept of “implementation outcomes” distinct from service system and clinical treatment outcomes. This paper proposes a heuristic, working “taxonomy” of eight conceptually distinct implementation outcomes—acceptability, adoption, appropriateness, feasibility, fidelity, implementation cost, penetration, and sustainability—along with their nominal definitions. We propose a two-pronged agenda for research on implementation outcomes. Conceptualizing and measuring implementation outcomes will advance understanding of implementation processes, enhance efficiency in implementation research, and pave the way for studies of the comparative effectiveness of implementation strategies

Credible knowledge: A pilot evaluation of a modified GRADE method using parent-implemented interventions for children with autism

Abstract Background Decision-making in child and youth mental health (CYMH) care requires recommendations that are developed through an efficient and effective method and are based on credible knowledge. Credible knowledge is informed by two sources: scientific evidence, and practice-based evidence, that reflects the "real world" experience of service providers. Current approaches to developing these recommendations in relation to CYMH will typically include evidence from one source or the other but do not have an objective method to combine the two. To this end, a modified version of the Grading Recommendations Assessment, Development and Evaluation (GRADE) approach was pilot-tested, a novel method for the CYMH field. Methods GRADE has an explicit methodology that relies on input from scientific evidence as well as a panel of experts. The panel established the quality of evidence and derived detailed recommendations regarding the organization and delivery of mental health care for children and youth or their caregivers. In this study a modified GRADE method was used to provide precise recommendations based on a specific CYMH question (i.e. What is the current credible knowledge concerning the effects of parent-implemented, early intervention with their autistic children?). Results Overall, it appeared that early, parent-implemented interventions for autism result in positive effects that outweigh any undesirable effects. However, as opposed to overall recommendations, the heterogeneity of the evidence required that recommendations be specific to particular interventions, based on the questions of whether the benefits of a particular intervention outweighs its harms. Conclusions This pilot project provided evidence that a modified GRADE method may be an effective and practical approach to making recommendations in CYMH, based on credible knowledge. Key strengths of the process included separating the assessments of the quality of the evidence and the strength of recommendations, transparency in decision-making, and the objectivity of the methods. Most importantly, this method combined the evidence and clinical experience in a more timely, explicit and simple process as compared to previous approaches. The strengths, limitations and modifications of the approach as they pertain to CYMH, are discussed