The WorkingWell Smartphone App for Individuals with Serious Mental Illnesses: A Proof-of-Concept, Mixed Methods Feasibility Study (Preprint)

Background: The disparities in employment for individuals with serious mental illnesses (SMI) have been well documented, as have the benefits of work. The benefits of mobile technology in providing accessible, in-the-moment support for these individuals has been demonstrated. The WorkingWell mobile app was developed to meet the need for accessible follow-along supports for individuals with SMI in the workplace. Objective: We explore the usability, usage, usefulness and overall feasibility of the WorkingWell mobile app with individuals with SMI receiving community-based services and actively employed. Methods: In this proof-of-concept, mixed methods, two-month feasibility study (N=40), employed individuals with SMI were recruited in mental health agencies. Participants completed surveys regarding background characteristics and cellphone use at enrollment; and responded to interview items regarding app usability, usage and usefulness in technical assistance calls at one, two, four and six weeks of study participation and in the exit interview at 8 weeks. Data on the frequency of app usage were downloaded and monitored on a daily basis. A version of the System Usability Scale (SUS) was administered in the exit interview. Feasibility was determined by the percent of users completing the study. General impressions were obtained from users regarding user support materials, technical assistance, and study procedures. Results: Over half of the participants were male (60%, 24/40). The majority were age 55 or under (70%, 28/40), Caucasian (80%, 32/40), had less than a 4-year college education (78%, 31/40), were employed part-time (98%, 39/40), had been working more than six months (60%, 24/40), and indicated a diagnosis of bipolar, schizoaffective or depressive disorder (84%, 16/25). The vast majority of participants owned cellphones (95%, 38/40), using them multiple times per day (83%, 33/40). Their average rating on SUS usability items was 3.93 (SD = 0.77; range = 1.57 to 5.00), reflecting positive responses. Participants, in general, indicated WorkingWell was “very easy”, “straightforward”, “simple”, and “user-friendly”. Usability challenges were related to personal issues (e.g., memory) or to difficulties with the phone or app. Data on app usage varied considerably. The most frequent navigations were to the home screen, followed by Rate My Day and My Progress, and then by Manage the Moment and Remind Me. The app was described as useful by most study participants; 86% (30/35) agreed the app would help them manage better on the job. Thirty-five of the 40 original participants (87%) completed the study. Conclusions: The WorkingWell app is a feasible approach to providing accessible, as-needed employment support for individuals with SMI. The app would benefit from additional modifications to address recommendations from feasibility testing. Controlled research with larger samples, more diverse in individual characteristics and workplace settings, is essential to demonstrating the effectiveness of the app

Performance measurement for co-occurring mental health and substance use disorders

<p>Abstract</p> <p>Background</p> <p>Co-occurring mental health and substance use disorders (COD) are the norm rather than the exception. It is therefore critical that performance measures are developed to assess the quality of care for individuals with COD irrespective of whether they seek care in mental health systems or substance abuse systems or both.</p> <p>Methods</p> <p>We convened an expert panel and asked them to rate a series of structure, process, and outcomes measures for COD using a structured evaluation tool with domains for importance, usefulness, validity, and practicality.</p> <p>Results</p> <p>We chose twelve measures that demonstrated promise for future pilot testing and refinement. The criteria that we applied to select these measures included: balance across structure, process, and outcome measures, quantitative ratings from the panelists, narrative comments from the panelists, and evidence the measure had been tested in a similar form elsewhere.</p> <p>Conclusion</p> <p>To be successful performance measures need to be developed in such a way that they align with needs of administrators and providers. Policymakers need to work with all stakeholders to establish a concrete agenda for developing, piloting and implementing performance measures that include COD. Future research could begin to consider strategies that increase our ability to use administrative coding in mental health and substance use disorder systems to efficiently capture quality relevant clinical data.</p

A real-life observational study of the effectiveness of FACT in a Dutch mental health region

<p>Abstract</p> <p>Background</p> <p>ACT is an effective community treatment but causes discontinuity of care between acutely ill and currently stable patient groups. The Dutch variant of ACT, FACT, combines both intensive ACT treatment and care for patients requiring less intensive care at one time point yet likely to need ACT in the future. It may be hypothesised that this case mix is not beneficial for patients requiring intensive care, as other patient groups may "dilute" care provision. The effectiveness of FACT was compared with standard care, with a particular focus on possible moderating effects of patient characteristics within the case mix in FACT.</p> <p>Methods</p> <p>In 2002, three FACT teams were implemented in a Dutch region in which a cumulative routine outcome measurement system was in place. Patients receiving FACT were compared with patients receiving standard treatment, matched on "baseline" symptom severity and age, using propensity score matching. Outcome was the probability of being in symptomatic remission of psychotic symptoms.</p> <p>Results</p> <p>The probability of symptomatic remission was higher for SMI patients receiving FACT than for controls receiving standard treatment, but only when there was an unmet need for care with respect to psychotic symptoms (OR = 6.70, p = 0.002; 95% CI = 1.97 – 22.7).</p> <p>Conclusion</p> <p>Compared to standard care, FACT was more rather than less effective, but only when a need for care with respect to psychotic symptoms is present. This suggests that there is no adverse effect of using broader patient mixes in providing continuity of care for all patients with severe mental illness in a defined geographical area.</p

Assertive community treatment for elderly people with severe mental illness

Background: Adults aged 65 and older with severe mental illnesses are a growing segment of the Dutch population. Some of them have a range of serious problems and are also difficult to engage. While assertive community treatment is a common model for treating difficult to engage severe mental illnesses patients, no special form of it is available for the elderly. A special assertive community treatment team for the elderly is developed in Rotterdam, the Netherlands and tested for its effectiveness.Methods: We will use a randomized controlled trial design to compare the effects of assertive community treatment for the elderly with those of care as usual. Primary outcome measures will be the number of dropouts, the number of patients engaged in care and patient's psychiatric symptoms, somatic symptoms, and social functioning. Secondary outcome measures are the number of unmet needs, the subjective quality of life and patients' satisfaction. Other secondary outcomes include the number of crisis contacts, rates of voluntary and involuntary admission, and length of stay. Inclusion criteria are aged 65 plus, the presence of a mental disorder, a lack of motivation for treatment and at least four suspected problems with functioning (addiction, somatic problems, daily living activities, housing etc.). If patients meet the inclusion criteria, they will be randomly allocated to either assertive community treatment for the elderly or care as usual. Trained assessors will use mainly observational instruments at the following time points: at baseline, after 9 and 18 months.Discussion: This study will help establish whether assertive community treatment for the elderly produces better results than care as usual in elderly people with severe mental illnesses who are difficult to engage. When assertive community treatment for the elderly proves valuable in these respects, it can be tested and implemented more widely, and mechanisms for its effects investigated

Changes in Treatment Content of Services During Trauma-informed Integrated Services for Women with Co-occurring Disorders

The experience of trauma is highly prevalent in the lives of women with mental health and substance abuse problems. We examined how an intervention targeted to provide trauma-informed integrated services in the treatment of co-occurring disorders has changed the content of services reported by clients. We found that the intervention led to an increased provision of integrated services as well as services addressing each content area: trauma, mental health and substance abuse. There was no increase in service quantity from the intervention. Incorporation of trauma-specific element in the treatment of mental health and substance abuse may have been successfully implemented at the service level thereby better serve women with complex behavioral health histories

Employing external facilitation to implement cognitive behavioral therapy in VA clinics: a pilot study

<p>Abstract</p> <p>Background</p> <p>Although for more than a decade healthcare systems have attempted to provide evidence-based mental health treatments, the availability and use of psychotherapies remains low. A significant need exists to identify simple but effective implementation strategies to adopt complex practices within complex systems of care. Emerging evidence suggests that facilitation may be an effective integrative implementation strategy for adoption of complex practices. The current pilot examined the use of external facilitation for adoption of cognitive behavioral therapy (CBT) in 20 Department of Veteran Affairs (VA) clinics.</p> <p>Methods</p> <p>The 20 clinics were paired on facility characteristics, and 23 clinicians from these were trained in CBT. A clinic in each pair was randomly selected to receive external facilitation. Quantitative methods were used to examine the extent of CBT implementation in 10 clinics that received external facilitation compared with 10 clinics that did not, and to better understand the relationship between individual providers' characteristics and attitudes and their CBT use. Costs of external facilitation were assessed by tracking the time spent by the facilitator and therapists in activities related to implementing CBT. Qualitative methods were used to explore contextual and other factors thought to influence implementation.</p> <p>Results</p> <p>Examination of change scores showed that facilitated therapists averaged an increase of 19% [95% CI: (2, 36)] in self-reported CBT use from baseline, while control therapists averaged a 4% [95% CI: (-14, 21)] increase. Therapists in the facilitated condition who were not providing CBT at baseline showed the greatest increase (35%) compared to a control therapist who was not providing CBT at baseline (10%) or to therapists in either condition who were providing CBT at baseline (average 3%). Increased CBT use was unrelated to prior CBT training. Barriers to CBT implementation were therapists' lack of control over their clinic schedule and poor communication with clinical leaders.</p> <p>Conclusions</p> <p>These findings suggest that facilitation may help clinicians make complex practice changes such as implementing an evidence-based psychotherapy. Furthermore, the substantial increase in CBT usage among the facilitation group was achieved at a modest cost.</p

Routine Outcomes Monitoring to Support Improving Care for Schizophrenia: Report from the VA Mental Health QUERI

In schizophrenia, treatments that improve outcomes have not been reliably disseminated. A major barrier to improving care has been a lack of routinely collected outcomes data that identify patients who are failing to improve or not receiving effective treatments. To support high quality care, the VA Mental Health QUERI used literature review, expert interviews, and a national panel process to increase consensus regarding outcomes monitoring instruments and strategies that support quality improvement. There was very good consensus in the domains of psychotic symptoms, side-effects, drugs and alcohol, depression, caregivers, vocational functioning, and community tenure. There are validated instruments and assessment strategies that are feasible for quality improvement in routine practice

The Medical Segmentation Decathlon

International challenges have become the de facto standard for comparative assessment of image analysis algorithms. Although segmentation is the most widely investigated medical image processing task, the various challenges have been organized to focus only on specific clinical tasks. We organized the Medical Segmentation Decathlon (MSD)—a biomedical image analysis challenge, in which algorithms compete in a multitude of both tasks and modalities to investigate the hypothesis that a method capable of performing well on multiple tasks will generalize well to a previously unseen task and potentially outperform a custom-designed solution. MSD results confirmed this hypothesis, moreover, MSD winner continued generalizing well to a wide range of other clinical problems for the next two years. Three main conclusions can be drawn from this study: (1) state-of-the-art image segmentation algorithms generalize well when retrained on unseen tasks; (2) consistent algorithmic performance across multiple tasks is a strong surrogate of algorithmic generalizability; (3) the training of accurate AI segmentation models is now commoditized to scientists that are not versed in AI model training

Treatment Outcome in Patients Receiving Assertive Community Treatment

In an observational study of severely mentally ill patients treated in assertive community treatment (ACT) teams, we investigated how treatment outcome was associated with demographic factors, clinical factors, and motivation for treatment. To determine psychosocial outcome, patients were routinely assessed using the Health of the Nation Outcome Scales (HoNOS). Trends over time were analyzed using a mixed model with repeated measures. The HoNOS total score was modeled as a function of treatment duration and patient-dependent covariates. Data comprised 637 assessments of 139 patients; mean duration of follow-up was 27.4 months (SD = 5.4). Substance abuse, higher age, problems with motivation, and lower educational level were associated with higher HoNOS total scores (i.e., worse outcome). To improve treatment outcome, we recommend better implementation of ACT, and also the implementation of additional programs targeting subgroups which seem to benefit less from ACT