Cost-effectiveness of peer-supported self-management for people discharged from a mental health crisis team: methodological challenges and recommendations

Background Mental health acute crisis episodes are associated with high inpatient costs. Self-management interventions may reduce readmission by enabling individuals to manage their condition. Delivery of such interventions by Peer Support Workers (PSWs) may be cost-effective. CORE, a randomized control trial of a PSW self-management intervention compared to usual care, found a significant reduction in admissions to acute mental healthcare for participants receiving the intervention. This paper aims to evaluate the cost-effectiveness of the intervention over 12 months from a mental health service perspective. Analysis methods of increasing complexity were used to account for data missingness and distribution. Methods Participants were recruited from six crisis resolution teams in England from 12 March 2014 to 3 July 2015 (trial registration ISRCTN: 01027104). Resource use was collected from patient records at baseline and 12 months. The EQ-5D-3L was collected at baseline and 4 and 18 months, and linear interpolation was used to calculate 12-month values for quality-adjusted life-years (QALYs). The primary analysis of adjusted mean incremental costs and QALYs for complete cases are calculated separately using OLS regression. Secondly, a complete-case non-parametric two-stage bootstrap (TSB) was performed. The impacts of missing data and skewed cost data were explored using multiple imputation using chained equations and general linear models, respectively. Results Four hundred and forty-one participants were recruited to CORE; 221 randomized to the PSW intervention and 220 to usual care plus workbook. The probability that the PSW intervention was cost-effective compared with the workbook plus usual care control at 12 months varied with the method used, and ranged from 57% to 96% at a cost-effectiveness threshold of £20,000 per QALY gained. Discussion There was a minimum 57% chance that the intervention was cost-effective compared to the control using 12-month costs and QALYs. The probability varied by 40% when methods were employed to account for the relationship between costs and QALYs, but which restricted the sample to those who provided both complete cost and utility data. Caution should therefore be applied when selecting methods for the evaluation of healthcare interventions that aim to increase precision but may introduce bias if missing data are heavily unbalanced between costs and outcomes

Cost-effectiveness of peer-supported self-management for people discharged from a mental health crisis team: methodological challenges and recommendations

BackgroundMental health acute crisis episodes are associated with high inpatient costs. Self-management interventions may reduce readmission by enabling individuals to manage their condition. Delivery of such interventions by Peer Support Workers (PSWs) may be cost-effective. CORE, a randomized control trial of a PSW self-management intervention compared to usual care, found a significant reduction in admissions to acute mental healthcare for participants receiving the intervention. This paper aims to evaluate the cost-effectiveness of the intervention over 12 months from a mental health service perspective. Analysis methods of increasing complexity were used to account for data missingness and distribution.MethodsParticipants were recruited from six crisis resolution teams in England from 12 March 2014 to 3 July 2015 (trial registration ISRCTN: 01027104). Resource use was collected from patient records at baseline and 12 months. The EQ-5D-3L was collected at baseline and 4 and 18 months, and linear interpolation was used to calculate 12-month values for quality-adjusted life-years (QALYs). The primary analysis of adjusted mean incremental costs and QALYs for complete cases are calculated separately using OLS regression. Secondly, a complete-case non-parametric two-stage bootstrap (TSB) was performed. The impacts of missing data and skewed cost data were explored using multiple imputation using chained equations and general linear models, respectively.ResultsFour hundred and forty-one participants were recruited to CORE; 221 randomized to the PSW intervention and 220 to usual care plus workbook. The probability that the PSW intervention was cost-effective compared with the workbook plus usual care control at 12 months varied with the method used, and ranged from 57% to 96% at a cost-effectiveness threshold of £20,000 per QALY gained.DiscussionThere was a minimum 57% chance that the intervention was cost-effective compared to the control using 12-month costs and QALYs. The probability varied by 40% when methods were employed to account for the relationship between costs and QALYs, but which restricted the sample to those who provided both complete cost and utility data. Caution should therefore be applied when selecting methods for the evaluation of healthcare interventions that aim to increase precision but may introduce bias if missing data are heavily unbalanced between costs and outcomes

Randomised controlled trial of the Community Navigator programme to reduce loneliness and depression for adults with treatment-resistant depression in secondary community mental health services: trial protocol

BACKGROUND: New treatments are needed for people with treatment-resistant depression (TRD), who do not benefit from anti-depressants and many of whom do not recover fully with psychological treatments. The Community Navigator programme was co-produced with service users and practitioners. It is a novel social intervention which aims to reduce loneliness and thus improve health outcomes for people with TRD. Participants receive up to 10 individual meetings with a Community Navigator, who helps them to map their social world and set and enact goals to enhance their social connections and reduce loneliness. Participants may also access group meet-ups with others in the programme every 2 months, and may be offered modest financial support to enable activities to support social connections. METHODS: A researcher-blind, multi-site, 1:1 randomised controlled trial with N = 306 participants will test the effectiveness of the Community Navigator programme for people with TRD in secondary community mental health teams (CMHTs). Our primary hypothesis is that people who are offered the Community Navigator programme as an addition to usual CMHT care will be less depressed, assessed using the PHQ-9 self-report measure, at 8-month, end-of-treatment follow-up, compared to a control group receiving usual CMHT care and a booklet with information about local social groups and activities. We will follow participants up at end-of-treatment and at 14 months, 6 months after end-of-treatment follow-up. Secondary outcomes include the following: loneliness, anxiety, personal recovery, self-efficacy, social network, social identities. We will collect data about health-related quality of life and service use to investigate the cost-effectiveness of the Community Navigator programme. DISCUSSION: This trial will provide definitive evidence about the effectiveness and cost-effectiveness of the Community Navigator programme and whether it can be recommended for use in practice. The trial is due to finish in August 2025. TRIAL REGISTRATION: Prospectively registered on 8th July 2022 at: ISRCTN13205972

Randomised controlled trial of the Community Navigator programme to reduce loneliness and depression for adults with treatment-resistant depression in secondary community mental health services : trial protocol

BACKGROUND: New treatments are needed for people with treatment-resistant depression (TRD), who do not benefit from anti-depressants and many of whom do not recover fully with psychological treatments. The Community Navigator programme was co-produced with service users and practitioners. It is a novel social intervention which aims to reduce loneliness and thus improve health outcomes for people with TRD. Participants receive up to 10 individual meetings with a Community Navigator, who helps them to map their social world and set and enact goals to enhance their social connections and reduce loneliness. Participants may also access group meet-ups with others in the programme every 2 months, and may be offered modest financial support to enable activities to support social connections. METHODS: A researcher-blind, multi-site, 1:1 randomised controlled trial with N = 306 participants will test the effectiveness of the Community Navigator programme for people with TRD in secondary community mental health teams (CMHTs). Our primary hypothesis is that people who are offered the Community Navigator programme as an addition to usual CMHT care will be less depressed, assessed using the PHQ-9 self-report measure, at 8-month, end-of-treatment follow-up, compared to a control group receiving usual CMHT care and a booklet with information about local social groups and activities. We will follow participants up at end-of-treatment and at 14 months, 6 months after end-of-treatment follow-up. Secondary outcomes include the following: loneliness, anxiety, personal recovery, self-efficacy, social network, social identities. We will collect data about health-related quality of life and service use to investigate the cost-effectiveness of the Community Navigator programme. DISCUSSION: This trial will provide definitive evidence about the effectiveness and cost-effectiveness of the Community Navigator programme and whether it can be recommended for use in practice. The trial is due to finish in August 2025. TRIAL REGISTRATION: Prospectively registered on 8th July 2022 at: ISRCTN13205972

COVID-19 and the Physio4FMD trial: Impact, mitigating strategies and analysis plans

Introduction: Functional motor disorder (FMD) is a common cause of disabling neurological symptoms such as weakness and tremor. Physio4FMD is a pragmatic, multicentre single blind randomised controlled trial to evaluate effectiveness and cost effectiveness of specialist physiotherapy for FMD. Like many other studies this trial was affected by the COVID-19 pandemic. Methods: The planned statistical and health economics analyses for this trial are described, as well as the sensitivity analyses designed to assess the disruption caused by COVID-19. The trial treatment of at least 89 participants (33%) was disrupted due to the pandemic. To account for this, we have extended the trial to increase the sample size. We have identified four groups based on how participants’ involvement in Physio4FMD was affected; A: 25 were unaffected; B: 134 received their trial treatment before the start of the COVID-19 pandemic and were followed up during the pandemic; C: 89 were recruited in early 2020 and had not received any randomised treatment before clinical services closed because of COVID-19; D: 88 participants were recruited after the trial was restarted in July 2021. The primary analysis will involve groups A, B and D. Regression analysis will be used to assess treatment effectiveness. We will conduct descriptive analyses for each of the groups identified and sensitivity regression analyses with participants from all groups, including group C, separately. Discussion: The COVID-19 mitigation strategy and analysis plans are designed to maintain the integrity of the trial while providing meaningful results. Trial registration: ISRCTN56136713

Acceptance and commitment therapy for late-life treatment-resistant generalised anxiety disorder : a feasibility study

Background: Generalised anxiety disorder (GAD) is the most common anxiety disorder in older people. First-line management includes pharmacological and psychological therapies, but many do not find these effective or acceptable. Little is known about how to manage treatment-resistant generalised anxiety disorder (TR-GAD) in older people. Objectives: To examine the acceptability, feasibility and preliminary estimates of the effectiveness of acceptance and commitment therapy (ACT) for older people with TR-GAD. Participants: People aged ≥65 years with TR-GAD (defined as not responding to GAD treatment, tolerate it or refused treatment) recruited from primary and secondary care services and the community. Intervention: Participants received up to 16 one-to-one sessions of ACT, developed specifically for older people with TR-GAD, in addition to usual care. Measurements: Co-primary outcomes were feasibility (defined as recruitment of ≥32 participants and retention of ≥60% at follow-up) and acceptability (defined as participants attending ≥10 sessions and scoring ≥21/30 on the satisfaction with therapy subscale). Secondary outcomes included measures of anxiety, worry, depression and psychological flexibility (assessed at 0 and 20 weeks). Results: Thirty-seven participants were recruited, 30 (81%) were retained and 26 (70%) attended ≥10 sessions. A total of 18/30 (60%) participants scored ≥21/30 on the satisfaction with therapy subscale. There was preliminary evidence suggesting that ACT may improve anxiety, depression and psychological flexibility. Conclusions: There was evidence of good feasibility and acceptability, although satisfaction with therapy scores suggested that further refinement of the intervention may be necessary. Results indicate that a larger-scale randomised controlled trial of ACT for TR-GAD is feasible and warranted

Online remote behavioural intervention for tics in 9- to 17-year-olds: the ORBIT RCT with embedded process and economic evaluation

Background Behavioural therapy for tics is difficult to access, and little is known about its effectiveness when delivered online. Objective To investigate the clinical and cost-effectiveness of an online-delivered, therapist- and parent-supported therapy for young people with tic disorders. Design Single-blind, parallel-group, randomised controlled trial, with 3-month (primary end point) and 6-month post-randomisation follow-up. Participants were individually randomised (1 : 1), using on online system, with block randomisations, stratified by site. Naturalistic follow-up was conducted at 12 and 18 months post-randomisation when participants were free to access non-trial interventions. A subset of participants participated in a process evaluation. Setting Two hospitals (London and Nottingham) in England also accepting referrals from patient identification centres and online self-referrals. Participants Children aged 9–17 years (1) with Tourette syndrome or chronic tic disorder, (2) with a Yale Global Tic Severity Scale-total tic severity score of 15 or more (or > 10 with only motor or vocal tics) and (3) having not received behavioural therapy for tics in the past 12 months or started/stopped medication for tics within the past 2 months. Interventions Either 10 weeks of online, remotely delivered, therapist-supported exposure and response prevention therapy (intervention group) or online psychoeducation (control). Outcome Primary outcome: Yale Global Tic Severity Scale-total tic severity score 3 months post-randomisation; analysis done in all randomised patients for whom data were available. Secondary outcomes included low mood, anxiety, treatment satisfaction and health resource use. Quality-adjusted life-years are derived from parent-completed quality-of-life measures. All trial staff, statisticians and the chief investigator were masked to group allocation. Results Two hundred and twenty-four participants were randomised to the intervention (n = 112) or control (n = 112) group. Participants were mostly male (n = 177; 79%), with a mean age of 12 years. At 3 months the estimated mean difference in Yale Global Tic Severity Scale-total tic severity score between the groups adjusted for baseline and site was −2.29 points (95% confidence interval −3.86 to −0.71) in favour of therapy (effect size −0.31, 95% confidence interval −0.52 to −0.10). This effect was sustained throughout to the final follow-up at 18 months (−2.01 points, 95% confidence interval −3.86 to −0.15; effect size −0.27, 95% confidence interval −0.52 to −0.02). At 18 months the mean incremental cost per participant of the intervention compared to the control was £662 (95% confidence interval −£59 to £1384), with a mean incremental quality-adjusted life-year of 0.040 (95% confidence interval −0.004 to 0.083) per participant. The mean incremental cost per quality-adjusted life-year gained was £16,708. The intervention was acceptable and delivered with high fidelity. Parental engagement predicted child engagement and more positive clinical outcomes. Harms Two serious, unrelated adverse events occurred in the control group. Limitations We cannot separate the effects of digital online delivery and the therapy itself. The sample was predominately white and British, limiting generalisability. The design did not compare to face-to-face services. Conclusion Online, therapist-supported behavioural therapy for young people with tic disorders is clinically and cost-effective in reducing tics, with durable benefits extending up to 18 months. Future work Future work should compare online to face-to-face therapy and explore how to embed the intervention in clinical practice. Trial registration This trial is registered as ISRCTN70758207; ClinicalTrials.gov (NCT03483493). The trial is now complete. Funding This project was funded by the National Institute for Health and Care Research (NIHR) Health and Technology Assessment programme (project number 16/19/02) and will be published in full in Health and Technology Assessment; Vol. 27, No. 18. See the NIHR Journals Library website for further project information. Plain language summary It can be difficult for children and young people with tics to access therapy. This is because there are not enough trained tic therapists. Online remote behavioural intervention for tics was a clinical trial to see whether an online platform that delivered two different types of interventions could help tics. One intervention focused on techniques to control tics; this type of therapy is called exposure and response prevention. The other intervention was psychoeducation, where participants learned about the nature of tics but not how to control them. The online remote behavioural intervention for tics interventions also involved help from a therapist and support from a parent. Participants were aged 9–17 years with Tourette syndrome/chronic tic disorder and were recruited from 16 clinics, two study sites (Nottingham and London) or via online self-referral. All individuals who were eligible for the online remote behavioural intervention for tics trial were randomised in a 50/50 split by researchers who were unaware of which treatment was being given. Participants received either 10 weeks of online exposure and response prevention or 10 weeks of online psychoeducation. A total of 224 children and young people participated: 112 allocated to exposure and response prevention and 112 to psychoeducation. Tics decreased more in the exposure and response prevention group (16% reduction) than in the psychoeducation group (6% reduction) 3 months after treatment. This difference is considered a clinically important difference in tic reduction. The treatment continued to have a positive effect on tic symptoms at 6, 12 and 18 months, showing that the effects are durable. This was achieved with minimal therapist involvement. The cost of online exposure and response prevention to treat young people with tics within this study was less when compared to the cost of face-to-face therapy. The results show that exposure and response prevention is an effective behavioural therapy for tics in this specific patient group. Delivering exposure and response prevention online with minimal therapist contact can be a successful and cost-effective treatment to improve access to behavioural therapy. Scientific summary Background Tic disorders including Tourette syndrome and chronic tic disorders are common conditions that affect approximately 1% of the population in the UK. Young people with tics often report substantial impairment, thus it is important that they have access to evidence-based treatment. Face-to-face behavioural therapy (BT) such as exposure and response prevention (ERP) may be offered to some young people. However, due to a lack of trained therapists, there are often difficulties accessing BT, and there is a better need to understand the clinical and cost-effectiveness of the online delivery of such therapy. Objectives The primary objective of this study was to evaluate the clinical effectiveness of therapist-guided, parent-assisted, internet-based ERP BT for tics in young people with tic disorders compared to online psychoeducation. Secondary objectives included (1) optimising the design of the intervention, (2) undertaking an internal pilot, (3) evaluating cost-effectiveness, (4) establishing whether the efficacy is maintained longer term, (5) understanding the mechanisms of impact of the intervention and (6) identifying barriers to implementation. Methods We conducted an individually randomised (1 : 1 ratio), multicentre trial, with an internal pilot and embedded process evaluation. Participants were assigned to either receive online, remotely delivered, therapist- and parent-supported ERP for tics or online, remotely delivered, therapist- and parent-supported psychoeducation for tics. Participants were recruited from the two study sites, 16 patient identification centres in England or could self-refer online via the study webpage or via Tourettes Action (a national charity for tics). The inclusion criteria were age between 9 and 17 years, with tics assessed on the Yale Global Tic Severity Scale (YGTSS), able to provide written informed consent (parental consent for children aged 80%) was excellent. Retention to the primary outcome measure remained high at 12 months (81% in both arms) and 18 months (> 79% in both arms). The primary analysis showed that participants in the ERP group [16% reduction, standard deviation (SD) 1.1] had a greater decrease in tics than those in the psychoeducation group (6% reduction, SD 1.0) at 3 months (primary end point). The estimated mean difference in YGTSS-TTSS change between the groups adjusted for baseline and site was −2.29 points [95% confidence interval (CI) −3.86 to −0.71] in favour of ERP, with an effect size of −0.31 (95% CI −0.52 to −0.10). This effect was sustained at 6 months, with a mean decrease of 6.9 points (24%, SD 1.2) in the ERP group versus 3.4 points (12%, SD 1.0) in the psychoeducation group. For phase 2, participants in the ERP group continued to have a greater decrease in tics than the control group. The estimated mean difference in YGTSS-TTSS between groups adjusting for baseline and site at 12 months was −2.64 points (95% CI −4.48 to −0.79), with an effect size of −0.36 (95% CI −0.61 to −0.11), at 18 months it was −2.01 points (95% CI −3.86 to −0.15), with an effect size of −0.27 (95% CI −0.52 to −0.02), in favour of the ERP group. In addition, extended follow-up showed those receiving online ERP compared with online psychoeducation had reduced scores for low mood and anxiety at 12 and 18 months and superior tic-specific quality of life, with the largest effects seen at 18 months. The direct cost of the intervention was £155 per person, including £104.57 for the online platform, supervision and training and a mean variable cost of £50.43 per participant for therapist time in the trial. At 18 months, using proxy parent-completed CHU9D responses, there were a mean additional 0.040 (95% CI −0.004 to 0.083) quality-adjusted life-years (QALYs) per participant in the ERP group compared with psychoeducation, with an addition mean cost per participant of £662 (95% CI −£59 to £1384). The incremental cost-effectiveness ratio in the primary analysis was £16,708 per QALY gained from a health and social care cost perspective at 18 months. In the 10-year long-term decision model, online ERP cost £537 less per participant than face-to-face BT and resulted in 0.02 fewer QALYs. Two serious adverse events (SAEs) occurred (hospital attendance due to one ‘collapse’ and one ‘tic attack’), both in the active control psychoeducation group, neither of which were related to the study intervention. The process evaluation found that the ERP intervention was implemented with high fidelity, and participants found the intervention acceptable and satisfactory. Engagement was high, with child participants completing an average of 7.5/10 chapters and 99/112 (88.4%) participants completing the minimum of the first four chapters (the predefined threshold for effective dose). Parental engagement was the only significant independent predictor of child engagement. Improvement in tic severity and overall clinical condition was not moderated by the relationship between demographic or baseline clinical factors and engagement and no mediators were found. However, level of parental engagement was associated with overall clinical improvement, and this relationship was illuminated by the qualitative data. Conclusion Implications for health care The findings demonstrate that online, therapist-supported ERP for young people with chronic tic disorders is clinically effective at reducing tic severity. Therefore, this is an efficient public mental health approach to supporting young people with tics. The intervention can be delivered at lower cost than standard face-to-face BT and may also result in improved service efficiencies, allowing a greater number of young people to access evidence-based care. Future research implications Further ‘field trials’ should be conducted to explore the clinical and service implications of delivering the intervention in real-world settings. Given that online interventions are context dependent, exploring the validity of these findings in different cultures/countries is important. Future research should explore where online, therapist-supported ERP best fits in the tic disorder care pathway and how online and face-to-face therapy can be best combined (e.g. non-responders to online ERP are ‘stepped up’ to face-to-face therapy). Trial registrations This trial is registered as ISRCTN70758207 and ClinicalTrials.gov (NCT03483493). The trial is now complete. Funding This project was funded by the National Institute for Health and Care Research (NIHR) Health and Technology Assessment programme (project number 16/19/02) and will be published in full in Health and Technology Assessment; Vol. 27, No. 18. See the NIHR Journals Library website for further project information

Online Remote Behavioural Intervention for Tics in 9 to 17-year-olds: the ORBIT RCT with embedded process and economic evaluation

Background: Behavioural therapy for tics is difficult to access, and little is known about its effectiveness when delivered online.Objective: To investigate the clinical and cost-effectiveness of an online-delivered, therapist and parent-supported therapy for young people with tic disorders.Design: Single-blind, parallel group, randomised controlled trial, with 3-month (primary end point) and 6-month post-randomisation follow-up. Participants were individually randomised (1:1), using on online system, with block randomisations, stratified by site. Naturalistic follow-up was conducted at 12- and 18-months post-randomisation when participants were free to access non-trial interventions. A subset of participants participated in a process evaluation.Setting: Two hospitals (London and Nottingham) in England also accepting referrals from patient identification centres and online self-referrals.Participants: Children aged 9–17 years, with i) Tourette syndrome or chronic tic disorder; ii) a Yale Global Tic Severity Scale Total Tic Severity Score (YGTSS-TTSS) of 15 or more (or >10 with only motor or vocal tics); and iii) not received behavioural therapy for tics in the past 12 months or started/stopped medication for tics within the past 2 months.Interventions: Either 10 weeks of online, remotely delivered, therapist-supported Exposure and Response Prevention therapy (intervention group) or online psychoeducation (control).Outcome: Primary outcome: YGTSS-TTSS 3 months post-randomisation; analysis done in all randomised patients for whom data were available. Secondary outcomes included low mood, anxiety, treatment satisfaction and health resource use. Quality-of-life-adjusted-years are derived from parent completed quality-of-life measures. All trial staff, statisticians and the chief investigator were masked to group allocation.Results: 224 participants were randomised to the intervention (n=112) or control (n=112). Participants were mostly male (n=177; 79%) with a mean age of 12 years. At 3 months the estimated mean difference in YGTSS-TTSS between the groups adjusted for baseline and site was –2.29 points (95% CI –3.86 to –0.71) in favour of therapy (effect size –0.31; 95% CI –0.52 to –0.10). This effect was sustained throughout to the final follow-up at 18 months -2.01 points (95% CI: -3.86 to -0.15, effect size -0.27; 95%CI -0.52 to -0.02). At 18 months the mean incremental cost per participant of the intervention compared to the control was £662 (95% CI -£59 to £1384) with a mean incremental quality-adjusted-life-year of 0.040 (95% CI -0.004 to 0.083) per participant. The mean incremental cost per quality-adjusted-life-year gained was £16,708.The intervention was acceptable and delivered with high fidelity. Parental engagement predicted child engagement and more positive clinical outcomes. Harms: Two serious, unrelated, adverse events occurred in the control group.Limitations: We cannot separate the effects of digital online delivery and the therapy itself. The sample was predominately white, British, limiting generalisability. The design did not compare to face-to-face services. Future work: Future work should compare online to face-to-face therapy and explore how to embed the intervention in clinical practice. Conclusion: Online, therapist supported behavioural therapy for young people with tic disorders is clinically- and cost-effective in reducing tics with durable benefits extending up to 18 months.Study registration: ISRCTN (ISRCTN70758207); ClinicalTrials.gov (NCT03483493). The trial is now complete