Performance measurement for co-occurring mental health and substance use disorders

<p>Abstract</p> <p>Background</p> <p>Co-occurring mental health and substance use disorders (COD) are the norm rather than the exception. It is therefore critical that performance measures are developed to assess the quality of care for individuals with COD irrespective of whether they seek care in mental health systems or substance abuse systems or both.</p> <p>Methods</p> <p>We convened an expert panel and asked them to rate a series of structure, process, and outcomes measures for COD using a structured evaluation tool with domains for importance, usefulness, validity, and practicality.</p> <p>Results</p> <p>We chose twelve measures that demonstrated promise for future pilot testing and refinement. The criteria that we applied to select these measures included: balance across structure, process, and outcome measures, quantitative ratings from the panelists, narrative comments from the panelists, and evidence the measure had been tested in a similar form elsewhere.</p> <p>Conclusion</p> <p>To be successful performance measures need to be developed in such a way that they align with needs of administrators and providers. Policymakers need to work with all stakeholders to establish a concrete agenda for developing, piloting and implementing performance measures that include COD. Future research could begin to consider strategies that increase our ability to use administrative coding in mental health and substance use disorder systems to efficiently capture quality relevant clinical data.</p

Innovations in mental health services implementation: a report on state-level data from the U.S. Evidence-Based Practices Project

BACKGROUND: The Evidence-Based Practice (EBP) Project has been investigating the implementation of evidence-based mental health practices (Assertive Community Treatment, Family Psychoeducation, Integrated Dual Diagnosis Treatment, Illness Management and Recovery, and Supported Employment) in state public mental health systems in the United States since 2001. To date, Project findings have yielded valuable insights into implementation strategy characteristics and effectiveness. This paper reports results of an effort to identify and classify state-level implementation activities and strategies employed across the eight states participating in the Project. METHODS: Content analysis and Greenhalgh et al's (2004) definition of innovation were used to identify and classify state-level activities employed during three phases of EBP implementation: Pre-Implementation, Initial Implementation and Sustainability Planning. Activities were coded from site visit reports created from documents and notes from key informant interviews conducted during two periods, Fall 2002 – Spring 2003, and Spring 2004. Frequency counts and rank-order analyses were used to examine patterns of implementation activities and strategies employed across the three phases of implementation. RESULTS: One hundred and six discreet implementation activities and strategies were identified as innovative and were classified into five categories: 1) state infrastructure building and commitment, 2) stakeholder relationship building and communications, 3) financing, 4) continuous quality management, and 5) service delivery practices and training. Implementation activities from different categories were employed at different phases of implementation. CONCLUSION: Insights into effective strategies for implementing EBPs in mental health and other health sectors require qualitative and quantitative research that seeks to: a) empirically test the effects of tools and methods used to implement EBPs, and b) establish a stronger evidence-base from which to plan, implement and sustain such efforts. This paper offers a classification scheme and list of innovative implementation activities and strategies. The classification scheme offers potential value for future studies that seek to assess the effects of various implementation processes, and helps establish widely accepted standards and criteria that can be used to assess the value of innovative activities and strategies

Employing external facilitation to implement cognitive behavioral therapy in VA clinics: a pilot study

<p>Abstract</p> <p>Background</p> <p>Although for more than a decade healthcare systems have attempted to provide evidence-based mental health treatments, the availability and use of psychotherapies remains low. A significant need exists to identify simple but effective implementation strategies to adopt complex practices within complex systems of care. Emerging evidence suggests that facilitation may be an effective integrative implementation strategy for adoption of complex practices. The current pilot examined the use of external facilitation for adoption of cognitive behavioral therapy (CBT) in 20 Department of Veteran Affairs (VA) clinics.</p> <p>Methods</p> <p>The 20 clinics were paired on facility characteristics, and 23 clinicians from these were trained in CBT. A clinic in each pair was randomly selected to receive external facilitation. Quantitative methods were used to examine the extent of CBT implementation in 10 clinics that received external facilitation compared with 10 clinics that did not, and to better understand the relationship between individual providers' characteristics and attitudes and their CBT use. Costs of external facilitation were assessed by tracking the time spent by the facilitator and therapists in activities related to implementing CBT. Qualitative methods were used to explore contextual and other factors thought to influence implementation.</p> <p>Results</p> <p>Examination of change scores showed that facilitated therapists averaged an increase of 19% [95% CI: (2, 36)] in self-reported CBT use from baseline, while control therapists averaged a 4% [95% CI: (-14, 21)] increase. Therapists in the facilitated condition who were not providing CBT at baseline showed the greatest increase (35%) compared to a control therapist who was not providing CBT at baseline (10%) or to therapists in either condition who were providing CBT at baseline (average 3%). Increased CBT use was unrelated to prior CBT training. Barriers to CBT implementation were therapists' lack of control over their clinic schedule and poor communication with clinical leaders.</p> <p>Conclusions</p> <p>These findings suggest that facilitation may help clinicians make complex practice changes such as implementing an evidence-based psychotherapy. Furthermore, the substantial increase in CBT usage among the facilitation group was achieved at a modest cost.</p

Changes in Treatment Content of Services During Trauma-informed Integrated Services for Women with Co-occurring Disorders

The experience of trauma is highly prevalent in the lives of women with mental health and substance abuse problems. We examined how an intervention targeted to provide trauma-informed integrated services in the treatment of co-occurring disorders has changed the content of services reported by clients. We found that the intervention led to an increased provision of integrated services as well as services addressing each content area: trauma, mental health and substance abuse. There was no increase in service quantity from the intervention. Incorporation of trauma-specific element in the treatment of mental health and substance abuse may have been successfully implemented at the service level thereby better serve women with complex behavioral health histories

Development of a measure of model fidelity for mental health Crisis Resolution Teams

Background Crisis Resolution Teams (CRTs) provide short-term intensive home treatment to people experiencing mental health crisis. Trial evidence suggests CRTs can be effective at reducing hospital admissions and increasing satisfaction with acute care. When scaled up to national level however, CRT implementation and outcomes have been variable. We aimed to develop and test a fidelity scale to assess adherence to a model of best practice for CRTs, based on best available evidence. Methods A concept mapping process was used to develop a CRT fidelity scale. Participants (n = 68) from a range of stakeholder groups prioritised and grouped statements (n = 72) about important components of the CRT model, generated from a literature review, national survey and qualitative interviews. These data were analysed using Ariadne software and the resultant cluster solution informed item selection for a CRT fidelity scale. Operational criteria and scoring anchor points were developed for each item. The CORE CRT fidelity scale was then piloted in 75 CRTs in the UK to assess the range of scores achieved and feasibility for use in a 1-day fidelity review process. Trained reviewers (n = 16) rated CRT service fidelity in a vignette exercise to test the scale’s inter-rater reliability. Results There were high levels of agreement within and between stakeholder groups regarding the most important components of the CRT model. A 39-item measure of CRT model fidelity was developed. Piloting indicated that the scale was feasible for use to assess CRT model fidelity and had good face validity. The wide range of item scores and total scores across CRT services in the pilot demonstrate the measure can distinguish lower and higher fidelity services. Moderately good inter-rater reliability was found, with an estimated correlation between individual ratings of 0.65 (95% CI: 0.54 to 0.76). Conclusions The CORE CRT Fidelity Scale has been developed through a rigorous and systematic process. Promising initial testing indicates its value in assessing adherence to a model of CRT best practice and to support service improvement monitoring and planning. Further research is required to establish its psychometric properties and international applicability

Treatment Outcome in Patients Receiving Assertive Community Treatment

In an observational study of severely mentally ill patients treated in assertive community treatment (ACT) teams, we investigated how treatment outcome was associated with demographic factors, clinical factors, and motivation for treatment. To determine psychosocial outcome, patients were routinely assessed using the Health of the Nation Outcome Scales (HoNOS). Trends over time were analyzed using a mixed model with repeated measures. The HoNOS total score was modeled as a function of treatment duration and patient-dependent covariates. Data comprised 637 assessments of 139 patients; mean duration of follow-up was 27.4 months (SD = 5.4). Substance abuse, higher age, problems with motivation, and lower educational level were associated with higher HoNOS total scores (i.e., worse outcome). To improve treatment outcome, we recommend better implementation of ACT, and also the implementation of additional programs targeting subgroups which seem to benefit less from ACT

Assertive community treatment for elderly people with severe mental illness

Background: Adults aged 65 and older with severe mental illnesses are a growing segment of the Dutch population. Some of them have a range of serious problems and are also difficult to engage. While assertive community treatment is a common model for treating difficult to engage severe mental illnesses patients, no special form of it is available for the elderly. A special assertive community treatment team for the elderly is developed in Rotterdam, the Netherlands and tested for its effectiveness.Methods: We will use a randomized controlled trial design to compare the effects of assertive community treatment for the elderly with those of care as usual. Primary outcome measures will be the number of dropouts, the number of patients engaged in care and patient's psychiatric symptoms, somatic symptoms, and social functioning. Secondary outcome measures are the number of unmet needs, the subjective quality of life and patients' satisfaction. Other secondary outcomes include the number of crisis contacts, rates of voluntary and involuntary admission, and length of stay. Inclusion criteria are aged 65 plus, the presence of a mental disorder, a lack of motivation for treatment and at least four suspected problems with functioning (addiction, somatic problems, daily living activities, housing etc.). If patients meet the inclusion criteria, they will be randomly allocated to either assertive community treatment for the elderly or care as usual. Trained assessors will use mainly observational instruments at the following time points: at baseline, after 9 and 18 months.Discussion: This study will help establish whether assertive community treatment for the elderly produces better results than care as usual in elderly people with severe mental illnesses who are difficult to engage. When assertive community treatment for the elderly proves valuable in these respects, it can be tested and implemented more widely, and mechanisms for its effects investigated

Routine Outcomes Monitoring to Support Improving Care for Schizophrenia: Report from the VA Mental Health QUERI

In schizophrenia, treatments that improve outcomes have not been reliably disseminated. A major barrier to improving care has been a lack of routinely collected outcomes data that identify patients who are failing to improve or not receiving effective treatments. To support high quality care, the VA Mental Health QUERI used literature review, expert interviews, and a national panel process to increase consensus regarding outcomes monitoring instruments and strategies that support quality improvement. There was very good consensus in the domains of psychotic symptoms, side-effects, drugs and alcohol, depression, caregivers, vocational functioning, and community tenure. There are validated instruments and assessment strategies that are feasible for quality improvement in routine practice

A real-life observational study of the effectiveness of FACT in a Dutch mental health region

<p>Abstract</p> <p>Background</p> <p>ACT is an effective community treatment but causes discontinuity of care between acutely ill and currently stable patient groups. The Dutch variant of ACT, FACT, combines both intensive ACT treatment and care for patients requiring less intensive care at one time point yet likely to need ACT in the future. It may be hypothesised that this case mix is not beneficial for patients requiring intensive care, as other patient groups may "dilute" care provision. The effectiveness of FACT was compared with standard care, with a particular focus on possible moderating effects of patient characteristics within the case mix in FACT.</p> <p>Methods</p> <p>In 2002, three FACT teams were implemented in a Dutch region in which a cumulative routine outcome measurement system was in place. Patients receiving FACT were compared with patients receiving standard treatment, matched on "baseline" symptom severity and age, using propensity score matching. Outcome was the probability of being in symptomatic remission of psychotic symptoms.</p> <p>Results</p> <p>The probability of symptomatic remission was higher for SMI patients receiving FACT than for controls receiving standard treatment, but only when there was an unmet need for care with respect to psychotic symptoms (OR = 6.70, p = 0.002; 95% CI = 1.97 – 22.7).</p> <p>Conclusion</p> <p>Compared to standard care, FACT was more rather than less effective, but only when a need for care with respect to psychotic symptoms is present. This suggests that there is no adverse effect of using broader patient mixes in providing continuity of care for all patients with severe mental illness in a defined geographical area.</p