Implementing Internet-Based Cognitive Behavioral Therapy in Routine Care: Healthcare Practitioners’ Attitude and Perceived Level of Normalization After a Single Information Event

Understanding implementation-related factors and processes is key to ensuring that Internet-based interventions are embedded in practice and provide added value to the delivery of evidence-based care. The aim of this study was to evaluate the attitudes towards an Internet-based cognitive behavioural therapy (iCBT) intervention for the treatment of depression as well as its level of normalization and early implementation success (operationalized as intention to use the intervention) among German health care professionals (HCP). Data were collected following onetime information sessions on an iCBT tool using the Evidence-Based Practice Attitude Scale (EBPAS) and the Normalization Process Theory Measure (NoMAD). Influences of attitudes on normalization as well as influences of attitude and normalization on intention to use were analysed. Most participants (n = 78; 86.3% clinical psychologists, 9.6% general practitioners) intended to use the intervention in the future (82.1%) and had a moderately positive attitude towards iCBT interventions. The perceived level of normalization (i.e., the level of how well iCBT is integrated in practice) was moderate in the overall sample. High appeal, openness towards iCBT, low requirement to use it, and low perceived divergence (perceived difference between current and new practices) had a significant positive effect on normalization. This study indicates that iCBT can be implemented in German routine mental healthcare. However, implementation processes might benefit from tailored information campaigns that clearly highlight the effectiveness and benefits of iCBT interventions to foster openness towards iCBT interventions among HCPs

How is tailored implementation undertaken using a self-guided toolkit? Qualitative study of the ItFits-toolkit in the ImpleMentAll project

BackgroundThe process of tailored implementation is ill-defined and under-explored. The ItFits-toolkit was developed and subsequently tested as a self-guided online platform to facilitate implementation of tailored strategies for internet-based cognitive behavioural therapy (iCBT) services. In ImpleMentAll, ItFits-toolkit had a small but positive effect on the primary outcome of iCBT normalisation. This paper investigates, from a qualitative perspective, how implementation teams developed and undertook tailored implementation using the toolkit within the trial.MethodsImplementation teams in thirteen sites from nine countries (Europe and Australia) used the ItFits-toolkit for six months minimum, consistent with the trial protocol. A qualitative process evaluation was conducted. Descriptive data regarding goals, barriers, strategies, and implementation plans collected within the toolkit informed qualitative data collection in real time. Qualitative data included remote longitudinal interviews (n = 55) with implementation team members (n = 30) and observations of support calls (n = 19) with study sites. Qualitative data were analysed thematically, using a team-based approach.ResultsImplementation teams developed and executed tailored implementation projects across all steps in the toolkit process. Working in a structured way but with room for flexibility, decisions were shaped by team members' ideas and goals, iterative stakeholder engagement, internal and external influences, and the context of the ImpleMentAll project. Although teams reported some positive impacts of their projects, 'time', both for undertaking the work, and for seeing project impacts, was described as a key factor in decisions about implementation strategies and assessments of success.ConclusionThis study responds directly to McHugh et al.'s (2022) call for empirical description of what implementation tailoring looks like in action, in service settings. Self-guided facilitation of tailored implementation enables implementers in service settings to undertake tailoring within their organisations. Implementation tailoring takes considerable time and involves detailed work but can be supported through the provision of implementation science informed guidance and materials, iterative and ongoing stakeholder engagement, and working reflectively in response to external influencing factors. Directions for advancement of tailored implementation are suggested

Effectiveness of Self-guided Tailored Implementation Strategies in Integrating and Embedding Internet-Based Cognitive Behavioral Therapy in Routine Mental Health Care: Results of a Multicenter Stepped-Wedge Cluster Randomized Trial

BACKGROUND: Internet-based cognitive behavioral therapy (iCBT) services for common mental health disorders have been found to be effective. There is a need for strategies that improve implementation in routine practice. One-size-fits-all strategies are likely to be ineffective. Tailored implementation is considered as a promising approach. The self-guided integrated theory-based Framework for intervention tailoring strategies toolkit (ItFits-toolkit) supports local implementers in developing tailored implementation strategies. Tailoring involves identifying local barriers; matching selected barriers to implementation strategies; developing an actionable work plan; and applying, monitoring, and adapting where necessary. OBJECTIVE: This study aimed to compare the effectiveness of the ItFits-toolkit with implementation-as-usual (IAU) in implementing iCBT services in 12 routine mental health care organizations in 9 countries in Europe and Australia. METHODS: A stepped-wedge cluster randomized trial design with repeated measures was applied. The trial period lasted 30 months. The primary outcome was the normalization of iCBT delivery by service providers (therapists, referrers, IT developers, and administrators), which was measured with the Normalization Measure Development as a proxy for implementation success. A 3-level linear mixed-effects modeling was applied to estimate the effects. iCBT service uptake (referral and treatment completion rates) and implementation effort (hours) were used as secondary outcomes. The perceived satisfaction (Client Satisfaction Questionnaire), usability (System Usability Scale), and impact of the ItFits-toolkit by implementers were used to assess the acceptability of the ItFits-toolkit. RESULTS: In total, 456 mental health service providers were included in this study. Compared with IAU, the ItFits-toolkit had a small positive statistically significant effect on normalization levels in service providers (mean 0.09, SD 0.04; P=.02; Cohen d=0.12). The uptake of iCBT by patients was similar to that of IAU. Implementers did not spend more time on implementation work when using the ItFits-toolkit and generally regarded the ItFits-toolkit as usable and were satisfied with it. CONCLUSIONS: The ItFits-toolkit performed better than the usual implementation activities in implementing iCBT services in routine practice. There is practical utility in the ItFits-toolkit for supporting implementers in developing and applying effective tailored implementation strategies. However, the effect on normalization levels among mental health service providers was small. These findings warrant modesty regarding the effectiveness of self-guided tailored implementation of iCBT services in routine practice. TRIAL REGISTRATION: ClinicalTrials.gov NCT03652883; https://clinicaltrials.gov/ct2/show/NCT03652883. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.1186/s13063-020-04686-4

Patient's experience with blended video- and internet based cognitive behavioural therapy service in routine care

Introduction: Internet-based guided self-help and face-to-face CBT have shown to be effective in the treatment of depression, but both approaches might not be an available treatment option for all patients. A treatment which blends internet-based guided self-help with video-based psychotherapy might reduce potential disadvantages of both approaches, while maintaining major advantages such as being location-independent. Additionally, it could provide a stronger focus on patient empowerment and lower resource use compared to traditional face-to-face treatment. Aim: The aim of this study is to evaluate patient's experiences with blended internet- and video-based CBT (blended iCBT) treatment and to derive suggestions for the improvement of such services. Methods: Semi-structured interviews were conducted with 15 participants of the blended iCBT treatment as part of the European MasterMind trial. Participants included adults suffering from Major Depressive Disorder. The interview guide assessed patient's experiences regarding the four treatment components program, 1. face-to-face diagnostic interviews, 2. video-based synchronous therapy sessions (VTS), 3. online self-help treatment modules (OTM) as well as 4. behaviour diaries and symptom monitoring. Interviews were analyzed using the framework method and outcomes regarding connections within and between participants and categories were generated by counting the statements within relevant themes. Results: Overall, patients indicated to have been satisfied with all components of the treatment, highlighting the option to independently work from home in their own pace. While the OTMs allowed for a deeper reflection of the content, the VTS with the therapist were mentioned to provide the personal character of the service. The working alliance with the therapist was experienced as fostering the individual fit of the treatment. Patients reported a high self-perceived treatment effectiveness. Negative effects included that some patients felt overwhelmed by the service, e.g. by working with the content of the OTM as they forced them to address their problems. Within the combination of OTM and VTS, both components were rated as equally important and patients felt that the combination depicted a treatment at least equal to regular face-to-face treatment regarding the perceived effectiveness. Other identified themes included patient's individual factors, reactions in their social environment and suggestions for improvement of the service. Discussion: Predominantly, patients reported positive experiences with the blended iCBT service and rate the treatment as adequate and effective to treat their condition. The importance of the VTS is highlighted. Following this approach might be an option to make affordable and effective evidence-based CBT available independent from regional barriers

Effects of Internet-Based Cognitive Behavioral Therapy in Routine Care for Adults in Treatment for Depression and Anxiety: Systematic Review and Meta-Analysis

BACKGROUND: Although there is evidence for the efficacy of internet-based cognitive behavioral therapy (iCBT), the generalizability of results to routine care is limited. OBJECTIVE: This study systematically reviews effectiveness studies of guided iCBT interventions for the treatment of depression or anxiety. METHODS: The acceptability (uptake, participants' characteristics, adherence, and satisfaction), effectiveness, and negative effects (deterioration) of nonrandomized pre-post designs conducted under routine care conditions were synthesized using systematic review and meta-analytic approaches. RESULTS: A total of 19 studies including 30 groups were included in the analysis. Despite high heterogeneity, individual effect sizes of investigated studies indicate clinically relevant changes, with effect sizes ranging from Hedges' g=0.42-1.88, with a pooled effect of 1.78 for depression and 0.94 for anxiety studies. Uptake, participants' characteristics, adherence, and satisfaction indicate a moderate to high acceptability of the interventions. The average deterioration across studies was 2.9%. CONCLUSIONS: This study provides evidence supporting the acceptability and effectiveness of guided iCBT for the treatment of depression and anxiety in routine care. Given the high heterogeneity between interventions and contexts, health care providers should select interventions that have been proven in randomized controlled clinical trials. The successful application of iCBT may be an effective way of increasing health care in multiple contexts

Implementing and up-scaling evidence-based eMental health in Europe: The study protocol for the MasterMind project

Background: Depressive disorder is a major societal challenge. Despite the availability of clinically and cost-effective treatments including Internet interventions, the number of patients receiving treatment is limited. Evidence-based Internet interventions promise wide availability and high efficiency of treatments. However, these interventions often do not enter routine mental healthcare delivery at a large scale. The MasterMind project aims to provide insight into the factors that promote or hinder the uptake and implementation of evidence-based Internet interventions by mental healthcare practice. Internet-based Cognitive Behaviour Therapy (iCBT) and videoconferencing facilitating collaborative care (ccVC) will be implemented in routine mental healthcare. The services will be offered to 5230 depressed adults in 15 European regions. The current paper describes the evaluation protocol for this large-scale implementation project. Design: Current summative evaluation study follows a naturalistic one-group pretest–posttest design and assesses three distinct stakeholders: patients, mental healthcare professionals, and mental healthcare organisations. The Model for Assessment of Telemedicine applications (MAST) will be employed to structure the implementation and evaluation study. The primary focal points of interest are reach, clinical effect, acceptability, appropriateness, implementation costs, and sustainability of the interventions in practice. Mixed-methods are used to provide an understanding of what (quantitative) the implementation projects have achieved and their meaning to various stakeholders (qualitative). Discussion: The use of Internet interventions in routine practice is limited. MasterMind attempts to bridge the gap between routine practice and effectiveness research by evaluating the implementation of evidence-based Internet interventions for depressive disorders in routine mental healthcare settings in Europe

Online consultations in mental healthcare during the COVID-19 outbreak: An international survey study on professionals' motivations and perceived barriers

Introduction: While the general uptake of e-mental health interventions remained low over the past years, physical distancing and lockdown measures relating to the COVID-19 pandemic created a need and demand for online consultations in only a matter of weeks. Objective: This study investigates the uptake of online consultations provided by mental health professionals during lockdown measures in the first wave of the COVID-19 pandemic in the participating countries, with a specific focus on professionals' motivations and perceived barriers regarding online consultations. Methods: An online survey on the use of online consultations was set up in March 2020. The Unified Theory of Acceptance and Use of Technology (UTAUT) guided the deductive qualitative analysis of the results. Results: In total, 2082 mental health professionals from Austria, Belgium, Cyprus, France, Germany, Italy, Lebanon, Lithuania, the Netherlands, Norway, Portugal, Spain, and Sweden were included. The results showed a high uptake of online consultations during the COVID-19 pandemic but limited previous training on this topic undergone by mental health professionals. Most professionals reported positive experiences with online consultations, but concerns about the performance of online consultations in a mental health context (e.g., in terms of relational aspects) and practical considerations (e.g., relating to privacy and security of software) appear to be major barriers that hinder implementation. Conclusions: This study provides an overview of the mental health professionals' actual needs and concerns regarding the use of online consultations in order to highlight areas of possible intervention and allow the implementation of necessary governmental, educational, and instrumental support so that online consultations can become a feasible and stable option in mental healthcare

Dimensionality of the system usability scale among professionals using internet-based interventions for depression: a confirmatory factor analysis

Background The System Usability Scale (SUS) is used to measure usability of internet-based Cognitive Behavioural Therapy (iCBT). However, whether the SUS is a valid instrument to measure usability in this context is unclear. The aim of this study is to assess the factor structure of the SUS, measuring usability of iCBT for depression in a sample of professionals. In addition, the psychometric properties (reliability, convergent validity) of the SUS were tested. Methods A sample of 242 professionals using iCBT for depression from 6 European countries completed the SUS. Confirmatory Factor Analysis (CFA) was conducted to test whether a one-factor, two-factor, tone-model or bi-direct model would fit the data best. Reliability was assessed using complementary statistical indices (e.g. omega). To assess convergent validity, the SUS total score was correlated with an adapted Client Satisfaction Questionnaire (CSQ-3). Results CFA supported the one-factor, two-factor and tone-model, but the bi-factor model fitted the data best (Comparative Fit Index = 0.992, Tucker Lewis Index = 0.985, Root Mean Square Error of Approximation = 0.055, Standardized Root Mean Square Residual = 0.042 (respectively χ2diff (9) = 69.82, p < 0.001; χ2diff (8) = 33.04, p < 0.001). Reliability of the SUS was good (ω = 0.91). The total SUS score correlated moderately with the CSQ-3 (CSQ1 rs = .49, p < 0.001; CSQ2 rs = .46, p < 0.001; CSQ3 rs = .38, p < 0.001), indicating convergent validity. Conclusions Although the SUS seems to have a multidimensional structure, the best model showed that the total sumscore of the SUS appears to be a valid and interpretable measure to assess the usability of internet-based interventions when used by professionals in mental healthcare

Effectiveness of Self-guided Tailored Implementation Strategies in Integrating and Embedding Internet-Based Cognitive Behavioral Therapy in Routine Mental Health Care: Results of a Multicenter Stepped-Wedge Cluster Randomized Trial

BACKGROUND: Internet-based cognitive behavioral therapy (iCBT) services for common mental health disorders have been found to be effective. There is a need for strategies that improve implementation in routine practice. One-size-fits-all strategies are likely to be ineffective. Tailored implementation is considered as a promising approach. The self-guided integrated theory-based Framework for intervention tailoring strategies toolkit (ItFits-toolkit) supports local implementers in developing tailored implementation strategies. Tailoring involves identifying local barriers; matching selected barriers to implementation strategies; developing an actionable work plan; and applying, monitoring, and adapting where necessary. OBJECTIVE: This study aimed to compare the effectiveness of the ItFits-toolkit with implementation-as-usual (IAU) in implementing iCBT services in 12 routine mental health care organizations in 9 countries in Europe and Australia. METHODS: A stepped-wedge cluster randomized trial design with repeated measures was applied. The trial period lasted 30 months. The primary outcome was the normalization of iCBT delivery by service providers (therapists, referrers, IT developers, and administrators), which was measured with the Normalization Measure Development as a proxy for implementation success. A 3-level linear mixed-effects modeling was applied to estimate the effects. iCBT service uptake (referral and treatment completion rates) and implementation effort (hours) were used as secondary outcomes. The perceived satisfaction (Client Satisfaction Questionnaire), usability (System Usability Scale), and impact of the ItFits-toolkit by implementers were used to assess the acceptability of the ItFits-toolkit. RESULTS: In total, 456 mental health service providers were included in this study. Compared with IAU, the ItFits-toolkit had a small positive statistically significant effect on normalization levels in service providers (mean 0.09, SD 0.04; P=.02; Cohen d=0.12). The uptake of iCBT by patients was similar to that of IAU. Implementers did not spend more time on implementation work when using the ItFits-toolkit and generally regarded the ItFits-toolkit as usable and were satisfied with it. CONCLUSIONS: The ItFits-toolkit performed better than the usual implementation activities in implementing iCBT services in routine practice. There is practical utility in the ItFits-toolkit for supporting implementers in developing and applying effective tailored implementation strategies. However, the effect on normalization levels among mental health service providers was small. These findings warrant modesty regarding the effectiveness of self-guided tailored implementation of iCBT services in routine practice. TRIAL REGISTRATION: ClinicalTrials.gov NCT03652883; https://clinicaltrials.gov/ct2/show/NCT03652883. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.1186/s13063-020-04686-4

Effectiveness of Self-guided Tailored Implementation Strategies in Integrating and Embedding Internet-Based Cognitive Behavioral Therapy in Routine Mental Health Care: Results of a Multicenter Stepped-Wedge Cluster Randomized Trial

BACKGROUND: Internet-based cognitive behavioral therapy (iCBT) services for common mental health disorders have been found to be effective. There is a need for strategies that improve implementation in routine practice. One-size-fits-all strategies are likely to be ineffective. Tailored implementation is considered as a promising approach. The self-guided integrated theory-based Framework for intervention tailoring strategies toolkit (ItFits-toolkit) supports local implementers in developing tailored implementation strategies. Tailoring involves identifying local barriers; matching selected barriers to implementation strategies; developing an actionable work plan; and applying, monitoring, and adapting where necessary. OBJECTIVE: This study aimed to compare the effectiveness of the ItFits-toolkit with implementation-as-usual (IAU) in implementing iCBT services in 12 routine mental health care organizations in 9 countries in Europe and Australia. METHODS: A stepped-wedge cluster randomized trial design with repeated measures was applied. The trial period lasted 30 months. The primary outcome was the normalization of iCBT delivery by service providers (therapists, referrers, IT developers, and administrators), which was measured with the Normalization Measure Development as a proxy for implementation success. A 3-level linear mixed-effects modeling was applied to estimate the effects. iCBT service uptake (referral and treatment completion rates) and implementation effort (hours) were used as secondary outcomes. The perceived satisfaction (Client Satisfaction Questionnaire), usability (System Usability Scale), and impact of the ItFits-toolkit by implementers were used to assess the acceptability of the ItFits-toolkit. RESULTS: In total, 456 mental health service providers were included in this study. Compared with IAU, the ItFits-toolkit had a small positive statistically significant effect on normalization levels in service providers (mean 0.09, SD 0.04; P=.02; Cohen d=0.12). The uptake of iCBT by patients was similar to that of IAU. Implementers did not spend more time on implementation work when using the ItFits-toolkit and generally regarded the ItFits-toolkit as usable and were satisfied with it. CONCLUSIONS: The ItFits-toolkit performed better than the usual implementation activities in implementing iCBT services in routine practice. There is practical utility in the ItFits-toolkit for supporting implementers in developing and applying effective tailored implementation strategies. However, the effect on normalization levels among mental health service providers was small. These findings warrant modesty regarding the effectiveness of self-guided tailored implementation of iCBT services in routine practice. TRIAL REGISTRATION: ClinicalTrials.gov NCT03652883; https://clinicaltrials.gov/ct2/show/NCT03652883. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.1186/s13063-020-04686-4