Usability, Acceptability, and Effectiveness of Web-Based Conversational Agents to Facilitate Problem Solving in Older Adults: Controlled Study.

BACKGROUND: The usability and effectiveness of conversational agents (chatbots) that deliver psychological therapies is under-researched. OBJECTIVE: This study aimed to compare the system usability, acceptability, and effectiveness in older adults of 2 Web-based conversational agents that differ in theoretical orientation and approach. METHODS: In a randomized study, 112 older adults were allocated to 1 of the following 2 fully automated interventions: Manage Your Life Online (MYLO; ie, a chatbot that mimics a therapist using a method of levels approach) and ELIZA (a chatbot that mimics a therapist using a humanistic counseling approach). The primary outcome was problem distress and resolution, with secondary outcome measures of system usability and clinical outcome. RESULTS: MYLO participants spent significantly longer interacting with the conversational agent. Posthoc tests indicated that MYLO participants had significantly lower problem distress at follow-up. There were no differences between MYLO and ELIZA in terms of problem resolution. MYLO was rated as significantly more helpful and likely to be used again. System usability of both the conversational agents was associated with helpfulness of the agents and the willingness of the participants to reuse. Adherence was high. A total of 12% (7/59) of the MYLO group did not carry out their conversation with the chatbot. CONCLUSIONS: Controlled studies of chatbots need to be conducted in clinical populations across different age groups. The potential integration of chatbots into psychological care in routine services is discussed

Acceptability and Effectiveness of NHS-Recommended e-Therapies for Depression, Anxiety, and Stress: Meta-Analysis.

BACKGROUND: There is a disconnect between the ability to swiftly develop e-therapies for the treatment of depression, anxiety, and stress, and the scrupulous evaluation of their clinical utility. This creates a risk that the e-therapies routinely provided within publicly funded psychological health care have evaded appropriate rigorous evaluation in their development. OBJECTIVE: This study aims to conduct a meta-analytic review of the gold standard evidence of the acceptability and clinical effectiveness of e-therapies recommended for use in the National Health Service (NHS) in the United Kingdom. METHODS: Systematic searches identified appropriate randomized controlled trials (RCTs). Depression, anxiety, and stress outcomes at the end of treatment and follow-up were synthesized using a random-effects meta-analysis. The grading of recommendations assessment, development, and evaluation approach was used to assess the quality of each meta-analytic comparison. Moderators of treatment effect were examined using subgroup and meta-regression analysis. Dropout rates for e-therapies (as a proxy for acceptability) were compared against controls. RESULTS: A total of 24 studies evaluating 7 of 48 NHS-recommended e-therapies were qualitatively and quantitatively synthesized. Depression, anxiety, and stress outcomes for e-therapies were superior to controls (depression: standardized mean difference [SMD] 0.38, 95% CI 0.24 to 0.52, N=7075; anxiety and stress: SMD 0.43, 95% CI 0.24 to 0.63, n=4863), and these small effects were maintained at follow-up. Average dropout rates for e-therapies (31%, SD 17.35) were significantly higher than those of controls (17%, SD 13.31). Limited moderators of the treatment effect were found. CONCLUSIONS: Many NHS-recommended e-therapies have not been through an RCT-style evaluation. The e-therapies that have been appropriately evaluated generate small but significant, durable, beneficial treatment effects. TRIAL REGISTRATION: International Prospective Register of Systematic Reviews (PROSPERO) registration CRD42019130184; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=130184

Risk factors for negative experiences during psychotherapy

Background: It is estimated that between 3% and 15% of patients have a negative experience of psychotherapy, but little is understood about this. Aims: The aim of this study was to investigate the factors associated with patients’ negative therapy experiences. Method: The data comprised 185 patient and 304 therapist questionnaires, 20 patient and 20 therapist interviews. Patients reported on an unhelpful or harmful experience of therapy, and therapists on a therapy where they thought the patient they were working with had a poor or harmful experience. These were transcribed and analysed using thematic analysis. Results: There was a Lack of fit between Patient needs, Therapist skills, and Service structures. This could result in Fault Lines, a tension between Safety and containment and Power and control. This tension led to Strain and Poor Engagement, which led to Consequences following the negative therapy experience. Conclusions: Patients require clear information, choice, involvement in decision-making, explicit contracting and clarity about sessions and progress. Opportunities for patient feedback should be the norm, where the therapist and service are vigilant for signs of deterioration and solutions considered.Clinical and methodological significance of this article: Estimates of “unwanted effects,” including long-lasting effects, of psychotherapy have ranged from 3% to 15%. Few empirical studies have been conducted in this area. This study aimed to address this gap and provide clinicians with a model of risk factors for negative therapy effects. The findings of this study indicate the importance of providing patients with a supportive service structure that offers clear information, choice and involvement in decision-making. Explicit contracting at the beginning of therapy and clarity about sessions and progress are also important in managing patient expectations throughout. Opportunities for patient feedback should be provided

Out of Pocket Expenses in Obsessive Compulsive Disorder

Background: Despite anecdotal evidence that the out of pocket costs of OCD can be substantial in some cases, there is no evidence on how many people they affect, or the magnitude of these costs. Aims: This paper explores the type and quantity of out of pocket expenses reported by a large sample of adults with OCD. Methods: Data on out of pocket expenses were collected from participants taking part in the OCTET multi-centre randomised controlled trial. Participants were aged 18+, meeting DSM-IV criteria for OCD, and scoring 16+ on the Yale Brown Obsessive Compulsive Scale. Individual-level resource use data including a description and estimated cost of out of pocket expenses were measured using an adapted version of the Adult Service Use Schedule (AD-SUS): a questionnaire used to collect data on resource use. Results: Forty-five percent (208/465) reported out of pocket expenses due to their OCD. The mean cost of out of pocket expenses was £19.19 per week (SD £27.56 SD), range £0.06–£224.00. Conclusions: Future economic evaluations involving participants with OCD should include out of pocket expenses, but careful consideration of alternative approaches to the collection and costing of this data is needed

Obsessive Compulsive Treatment Efficacy Trial (OCTET) comparing the clinical and cost effectiveness of self-managed therapies: study protocol for a randomised controlled trial

Background: UK National Institute of Health and Clinical Excellence guidelines for obsessive compulsive disorder (OCD) specify recommendations for the treatment and management of OCD using a stepped care approach. Steps three to six of this model recommend treatment options for people with OCD that range from low-intensity guided self-help (GSH) to more intensive psychological and pharmacological interventions. Cognitive behavioural therapy (CBT), including exposure and response prevention, is the recommended psychological treatment. However, whilst there is some preliminary evidence that self-managed therapy packages for OCD can be effective, a more robust evidence base of their clinical and cost effectiveness and acceptability is required. Methods/Design: Our proposed study will test two different self-help treatments for OCD: 1) computerised CBT (cCBT) using OCFighter, an internet-delivered OCD treatment package; and 2) GSH using a book. Both treatments will be accompanied by email or telephone support from a mental health professional. We will evaluate the effectiveness, cost and patient and health professional acceptability of the treatments. Discussion: This study will provide more robust evidence of efficacy, cost effectiveness and acceptability of self-help treatments for OCD. If cCBT and/or GSH prove effective, it will provide additional, more accessible treatment options for people with OCD

Tuberculosis susceptibility and vaccine protection are independently controlled by host genotype

The outcome of Mycobacterium tuberculosis infection and the immunological response to the bacillus Calmette-Guerin (BCG) vaccine are highly variable in humans. Deciphering the relative importance of host genetics, environment, and vaccine preparation for the efficacy of BCG has proven difficult in natural populations. We developed a model system that captures the breadth of immunological responses observed in outbred individual mice, which can be used to understand the contribution of host genetics to vaccine efficacy. This system employs a panel of highly diverse inbred mouse strains, consisting of the founders and recombinant progeny of the "Collaborative Cross" project. Unlike natural populations, the structure of this panel allows the serial evaluation of genetically identical individuals and the quantification of genotype-specific effects of interventions such as vaccination. When analyzed in the aggregate, our panel resembled natural populations in several important respects: the animals displayed a broad range of susceptibility to M. tuberculosis, differed in their immunological responses to infection, and were not durably protected by BCG vaccination. However, when analyzed at the genotype level, we found that these phenotypic differences were heritable. M. tuberculosis susceptibility varied between lines, from extreme sensitivity to progressive M. tuberculosis clearance. Similarly, only a minority of the genotypes was protected by vaccination. The efficacy of BCG was genetically separable from susceptibility to M. tuberculosis, and the lack of efficacy in the aggregate analysis was driven by nonresponsive lines that mounted a qualitatively distinct response to infection. These observations support an important role for host genetic diversity in determining BCG efficacy and provide a new resource to rationally develop more broadly efficacious vaccines. IMPORTANCE Tuberculosis (TB) remains an urgent global health crisis, and the efficacy of the currently used TB vaccine, M. bovis BCG, is highly variable. The design of more broadly efficacious vaccines depends on understanding the factors that limit the protection imparted by BCG. While these complex factors are difficult to disentangle in natural populations, we used a model population of mice to understand the role of host genetic composition in BCG efficacy. We found that the ability of BCG to protect mice with different genotypes was remarkably variable. The efficacy of BCG did not depend on the intrinsic susceptibility of the animal but, instead, correlated with qualitative differences in the immune responses to the pathogen. These studies suggest that host genetic polymorphism is a critical determinant of vaccine efficacy and provide a model system to develop interventions that will be useful in genetically diverse populations.This work, including the efforts of Hardy Kornfeld, was funded by HHS | National Institutes of Health (NIH) (HL081149). This work, including the efforts of Sam Behar, was funded by HHS | National Institutes of Health (NIH) (AI123286-01). This work, including the efforts of Clare Margaret Smith and Christopher Sassetti, was funded by Howard Hughes Medical Institute (HHMI)

A pragmatic randomised controlled trial assessing the non-inferiority of counselling for depression versus cognitive-behaviour therapy for patients in primary care meeting a diagnosis of moderate or severe depression (PRaCTICED): Study protocol for a randomised controlled trial.

BACKGROUND: NICE guidelines state cognitive behavioural therapy (CBT) is a front-line psychological treatment for people presenting with depression in primary care. Counselling for Depression (CfD), a form of Person-Centred Experiential therapy, is also offered within Improving Access to Psychological Therapies (IAPT) services for moderate depression but its effectiveness for severe depression has not been investigated. A full-scale randomised controlled trial to determine the efficacy and cost-effectiveness of CfD is required. METHODS: PRaCTICED is a two-arm, parallel group, non-inferiority randomised controlled trial comparing CfD against CBT. It is embedded within the local IAPT service using a stepped care service delivery model where CBT and CfD are routinely offered at step 3. Trial inclusion criteria comprise patients aged 18 years or over, wishing to work on their depression, judged to require a step 3 intervention, and meeting an ICD-10 diagnosis of moderate or severe depression. Patients are randomised using a centralised, web-based system to CfD or CBT with each treatment being delivered up to a maximum 20 sessions. Both interventions are manualised with treatment fidelity tested via supervision and random sampling of sessions using adherence/competency scales. The primary outcome measure is the Patient Health Questionnaire-9 collected at baseline, 6 and 12 months. Secondary outcome measures tap depression, generic psychological distress, anxiety, functioning and quality of life. Cost-effectiveness is determined by a patient service receipt questionnaire. Exit interviews are conducted with patients by research assessors blind to treatment allocation. The trial requires 500 patients (250 per arm) to test the non-inferiority hypothesis of -2 PHQ-9 points at the one-sided, 2.5% significance level with 90% power, assuming no underlying difference and a standard deviation of 6.9. The primary analysis will be undertaken on all patients randomised (intent to treat) alongside per-protocol and complier-average causal effect analyses as recommended by the extension to the CONSORT statement for non-inferiority trials. DISCUSSION: This large-scale trial utilises routinely collected outcome data as well as specific trial data to provide evidence of the comparative efficacy and cost-effectiveness of Counselling for Depression compared with Cognitive Behaviour Therapy as delivered within the UK government's Improving Access to Psychological Therapies initiative. TRIAL REGISTRATION: Controlled Trials ISRCTN Registry, ISRCTN06461651 . Registered on 14 September 2014