Scaling Up Psychological Treatments: A Countrywide Test of the Online Training of Therapists.

BACKGROUND: A major barrier to the widespread dissemination of psychological treatments is the way that therapists are trained. The current method is not scalable. OBJECTIVE: Our objective was to conduct a proof-of-concept study of Web-centered training, a scalable online method for training therapists. METHODS: The Irish Health Service Executive identified mental health professionals across the country whom it wanted to be trained in a specific psychological treatment for eating disorders. These therapists were given access to a Web-centered training program in transdiagnostic cognitive behavior therapy for eating disorders. The training was accompanied by a scalable form of support consisting of brief encouraging telephone calls from a nonspecialist. The trainee therapists completed a validated measure of therapist competence before and after the training. RESULTS: Of 102 therapists who embarked upon the training program, 86 (84.3%) completed it. There was a substantial increase in their competence scores following the training (mean difference 5.84, 95% Cl -6.62 to -5.05; P<.001) with 42.5% (34/80) scoring above a predetermined cut-point indicative of a good level of competence. CONCLUSIONS: Web-centered training proved feasible and acceptable and resulted in a marked increase in therapist competence scores. If these findings are replicated, Web-centered training would provide a means of simultaneously training large numbers of geographically dispersed trainees at low cost, thereby overcoming a major obstacle to the widespread dissemination of psychological treatments

Increasing the Availability of Psychological Treatments: A Multinational Study of a Scalable Method for Training Therapists.

BACKGROUND: One of the major barriers to the dissemination and implementation of psychological treatments is the scarcity of suitably trained therapists. A highly scalable form of Web-centered therapist training, undertaken without external support, has recently been shown to have promise in promoting therapist competence. OBJECTIVE: The aim of this study was to conduct an evaluation of the acceptability and effectiveness of a scalable independent form of Web-centered training in a multinational sample of therapists and investigate the characteristics of those most likely to benefit. METHODS: A cohort of eligible therapists was recruited internationally and offered access to Web-centered training in enhanced cognitive behavioral therapy, a multicomponent, evidence-based, psychological treatment for any form of eating disorder. No external support was provided during training. Therapist competence was assessed using a validated competence measure before training and after 20 weeks. RESULTS: A total of 806 therapists from 33 different countries expressed interest in the study, and 765 (94.9%) completed a pretraining assessment. The median number of training modules completed was 15 out of a possible 18 (interquartile range, IQR: 4-18), and 87.9% (531/604) reported that they treated at least one patient during training as recommended. Median pretraining competence score was 7 (IQR: 5-10, range: 0-19; N=765), and following training, it was 12 (IQR: 9-15, range: 0-20; N=577). The expected change in competence scores from pretraining to posttraining was 3.5 (95% CI 3.1-3.8; P<.001). After training, 52% (300/574) of therapists with complete competence data met or exceeded the competence threshold, and 45% (95% CI 41-50) of those who had not met this threshold before training did so after training. Compliance with training predicted both an increase in competence scores and meeting or exceeding the competence threshold. Expected change in competence score increased for each extra training module completed (0.19, 95% CI 0.13-0.25), and those who treated a suitable patient during training had an expected change in competence score 1.2 (95% CI 0.4-2.1) points higher than those who did not. Similarly, there was an association between meeting the competence threshold after training and the number of modules completed (odds ratio, OR=1.11, 95% CI 1.07-1.15), and treating at least one patient during training was associated with competence after training (OR=2.2, 95% CI 1.2-4.1). CONCLUSIONS: Independent Web-centered training can successfully train large numbers of therapists dispersed across a wide geographical area. This finding is of importance because the availability of a highly scalable method of training potentially increases the number of people who might receive effective psychological treatments

Using the Internet to Train Therapists: Randomized Comparison of Two Scalable Methods.

BACKGROUND: One of the major barriers to the dissemination and implementation of psychological treatments is the scarcity of suitably trained therapists. The currently accepted method of training is not scalable. Recently, a scalable form of training, Web-centered training, has been shown to have promise. OBJECTIVE: The goal of our research was to conduct a randomized comparison of the relative effects of independent and supported Web-centered training on therapist competence and investigate the persistence of the effects. METHODS: Eligible therapists were recruited from across the United States and Canada. They were randomly assigned to 1 of 2 forms of training in enhanced cognitive behavior therapy (CBT-E), a multicomponent evidence-based psychological treatment for any form of eating disorder. Independent training was undertaken autonomously, while supported training was accompanied by support from a nonspecialist worker. Therapist competence was assessed using a validated competence measure before training, after 20 weeks of training, and 6 months after the completion of training. RESULTS: A total of 160 therapists expressed interest in the study, and 156 (97.5%) were randomized to the 2 forms of training (81 to supported training and 75 to independent training). Mixed effects analysis showed an increase in competence scores in both groups. There was no difference between the 2 forms of training, with mean difference for the supported versus independent group being -0.06 (95% Cl -1.29 to 1.16, P=.92). A total of 58 participants (58/114, 50.9%) scored above the competence threshold; three-quarters (43/58, 74%) had not met this threshold before training. There was no difference between the 2 groups in the odds of scoring over the competence threshold (odds ratio [OR] 1.02, 95% CI 0.52 to 1.99; P=.96). At follow-up, there was no significant difference between the 2 training groups (mean difference 0.19, 95% Cl -1.27 to 1.66, P=.80). Overall, change in competence score from end of training to follow-up was not significant (mean difference -0.70, 95% CI -1.52 to 0.11, P=.09). There was also no difference at follow-up between the training groups in the odds of scoring over the competence threshold (OR 0.95, 95% Cl 0.34 to 2.62; P=.92). CONCLUSIONS: Web-centered training was equally effective whether undertaken independently or accompanied by support, and its effects were sustained. The independent form of Web-centered training is particularly attractive as it provides a means of training large numbers of geographically dispersed therapists at low cost, thereby overcoming several obstacles to the widespread dissemination of psychological treatments

A transdiagnostic comparison of enhanced cognitive behaviour therapy (CBT-E) and interpersonal psychotherapy in the treatment of eating disorders.

Eating disorders may be viewed from a transdiagnostic perspective and there is evidence supporting a transdiagnostic form of cognitive behaviour therapy (CBT-E). The aim of the present study was to compare CBT-E with interpersonal psychotherapy (IPT), a leading alternative treatment for adults with an eating disorder. One hundred and thirty patients with any form of eating disorder (body mass index >17.5 to <40.0) were randomized to either CBT-E or IPT. Both treatments involved 20 sessions over 20 weeks followed by a 60-week closed follow-up period. Outcome was measured by independent blinded assessors. Twenty-nine participants (22.3%) did not complete treatment or were withdrawn. At post-treatment 65.5% of the CBT-E participants met criteria for remission compared with 33.3% of the IPT participants (p < 0.001). Over follow-up the proportion of participants meeting criteria for remission increased, particularly in the IPT condition, but the CBT-E remission rate remained higher (CBT-E 69.4%, IPT 49.0%; p = 0.028). The response to CBT-E was very similar to that observed in an earlier study. The findings indicate that CBT-E is potent treatment for the majority of outpatients with an eating disorder. IPT remains an alternative to CBT-E, but the response is less pronounced and slower to be expressed. CURRENT CONTROLLED TRIALS: ISRCTN 15562271

Predictors and moderators of response to enhanced cognitive behaviour therapy and interpersonal psychotherapy for the treatment of eating disorders.

Consistent predictors, and more especially moderators, of response to psychological treatments for eating disorders have not been identified. The present exploratory study examined predictors and moderators of outcome in adult patients who took part in a randomised clinical trial comparing two leading treatments for these disorders, enhanced cognitive behavioural therapy (CBT-E) and interpersonal psychotherapy (IPT). Four potentially important findings emerged. Firstly, patients with a longer duration of disorder were less likely to benefit from either treatment. Second, across the two treatments the presence, at baseline, of higher levels of over-evaluation of the importance of shape predicted a less good treatment outcome. Third DSM-IV diagnosis did not predict treatment outcome. Fourth, with the exception of patients with baseline low self-esteem who achieved a better outcome with CBT-E, it was generally not possible to identify a subgroup of patients who would differentially benefit from one or other treatment

Mediators of change in cognitive behavior therapy and interpersonal psychotherapy for eating disorders: A secondary analysis of a transdiagnostic randomized controlled trial.

OBJECTIVE: Understanding the mechanisms of action of psychological treatments is a key first step in refining and developing more effective treatments. The present study examined hypothesized mediators of change of enhanced cognitive behavior therapy (CBT-E) and interpersonal psychotherapy for eating disorders (IPT-ED). METHOD: A series of mediation studies were embedded in a randomized controlled trial (RCT) comparing 20 weeks of CBT-E and IPT-ED in a transdiagnostic, non-underweight sample of patients with eating disorders (N = 130) consecutively referred to the service. Three hypothesized mediators of change in CBT-E (regular eating, weighing frequency, and shape checking) and the key hypothesized mediator of IPT-ED (interpersonal problem severity) were studied. RESULTS: The data supported regular eating as being a mediator of the effect of CBT-E on binge-eating frequency. The findings were inconclusive regarding the role of the other putative mediators of the effects of CBT-E; and were similarly inconclusive for interpersonal problem severity as a mediator of the effect of IPT-ED. DISCUSSION: This research highlights the potential benefits of embedding mediation studies within RCTs to better understand how treatments work. The findings supported the role of regular eating in reducing patients' binge-eating frequency. Other key hypothesized mediators of CBT-E and IPT-ED were not supported, although the data were not inconsistent with them. Key methodological issues to address in future work include the need to capture both behavioral and cognitive processes of change in CBT-E, and identifying key time points for change in IPT-ED

Towards scalable training: narrowing the research-practice gap in the treatment of eating disorders

Empirically supported treatments (ESTs) now exist for a variety of psychological disorders; however, few individuals have access to these treatments and even fewer receive them in well delivered form. This has been termed the research-practice gap. It is likely that a combination of factors contribute to individuals not receiving good quality ESTs. One major reason is the limited availability of effective training in these treatments. Although many therapists wish to learn such treatments, they seldom have the opportunity as training relies on scarce expert resources and is costly. Furthermore, relatively little is known about the effectiveness of this method or how best to train clinicians: despite having evidence-based treatments, there are no evidence-based trainings. This dissertation examined one example of an EST - enhanced cognitive behavior therapy for eating disorders (CBT-E) – with the overarching aim of evaluating both existing, and commonly accepted, training methods, as well as, newly developed more scalable ones. How best to train clinicians in CBT for eating disorders has not been investigated previously. The Kirkpatrick training evaluation framework was adopted to guide the studies. Chapter One provided an overview of the research-practice gap with a particular emphasis on the obstacles faced in training therapists. Chapter Two reviewed the literature on training in ESTs and highlighted gaps in the research evidence and areas for improvement in future studies. An important conclusion was that, although studies varied in design and the precise form and content of the training investigated, results were mostly consistent in indicating that knowledge and skills tended to improve following training. However, the outcome measures used to assess training were often poorly described with unknown psychometric properties. Perhaps most importantly the lack of clearly defined competence cut-points made interpretation difficult. In addition, much of the training investigated had limitations in terms of scalability. Chapters Three, Four and Five, aimed to overcome some of these difficulties and provided a series of studies investigating training in CBT-E. Chapter Three employed qualitative methods to investigate trainees' reaction to conventional workshop and more scalable web-based training and found that although trainees enjoyed training, they had a variety of reasons for not planning to implement the treatment as learned. Chapters Four and Five evaluated the impact of different forms of training on knowledge and skill acquisition respectively. Training in CBT-E was associated with increases in knowledge especially when paired with supervision or scalable guidance, which proved feasible and acceptable to clinician trainees. The results for skill acquisition were less clear, but the new scalable online training was associated with therapists achieving competence. Finally Chapter Six discussed the broader implications of the work and highlighted areas for future research.</p

Towards scalable training: narrowing the research-practice gap in the treatment of eating disorders

Empirically supported treatments (ESTs) now exist for a variety of psychological disorders; however, few individuals have access to these treatments and even fewer receive them in well delivered form. This has been termed the research-practice gap. It is likely that a combination of factors contribute to individuals not receiving good quality ESTs. One major reason is the limited availability of effective training in these treatments. Although many therapists wish to learn such treatments, they seldom have the opportunity as training relies on scarce expert resources and is costly. Furthermore, relatively little is known about the effectiveness of this method or how best to train clinicians: despite having evidence-based treatments, there are no evidence-based trainings. This dissertation examined one example of an EST - enhanced cognitive behavior therapy for eating disorders (CBT-E) â with the overarching aim of evaluating both existing, and commonly accepted, training methods, as well as, newly developed more scalable ones. How best to train clinicians in CBT for eating disorders has not been investigated previously. The Kirkpatrick training evaluation framework was adopted to guide the studies. Chapter One provided an overview of the research-practice gap with a particular emphasis on the obstacles faced in training therapists. Chapter Two reviewed the literature on training in ESTs and highlighted gaps in the research evidence and areas for improvement in future studies. An important conclusion was that, although studies varied in design and the precise form and content of the training investigated, results were mostly consistent in indicating that knowledge and skills tended to improve following training. However, the outcome measures used to assess training were often poorly described with unknown psychometric properties. Perhaps most importantly the lack of clearly defined competence cut-points made interpretation difficult. In addition, much of the training investigated had limitations in terms of scalability. Chapters Three, Four and Five, aimed to overcome some of these difficulties and provided a series of studies investigating training in CBT-E. Chapter Three employed qualitative methods to investigate trainees' reaction to conventional workshop and more scalable web-based training and found that although trainees enjoyed training, they had a variety of reasons for not planning to implement the treatment as learned. Chapters Four and Five evaluated the impact of different forms of training on knowledge and skill acquisition respectively. Training in CBT-E was associated with increases in knowledge especially when paired with supervision or scalable guidance, which proved feasible and acceptable to clinician trainees. The results for skill acquisition were less clear, but the new scalable online training was associated with therapists achieving competence. Finally Chapter Six discussed the broader implications of the work and highlighted areas for future research.</p

Development of the CBT-E Components Checklist: A tool for measuring therapist self-rated adherence to CBT-E

Few tools to encourage therapists to implement evidence based psychological treatments as designed exist. Assessing therapist “competence” (implementing therapeutic procedures well) by evaluating the quality of their treatment sessions is problematic for multiple reasons. Therapist self-rated measures of “adherence” (using the correct therapeutic procedures) may offer a viable alternative. We describe (i) the development of a CBT-E Components Checklist (CBT-E CC) for therapists, as well as (ii) how to use the CBT-E CC and where to access it. The CBT-E CC is an adherence checklist for enhanced cognitive behavior therapy for eating disorders (CBT-E). It is intended as a formative tool for therapists to assess, and improve as needed, their own adherence. Future research on the validity of the checklist to accurately measure adherence is needed

Assessing Therapist Competence : Development of a Performance-Based Measure and Its Comparison With a Web-Based Measure

BACKGROUND: Recent research interest in how best to train therapists to deliver psychological treatments has highlighted the need for rigorous, but scalable, means of measuring therapist competence. There are at least two components involved in assessing therapist competence: the assessment of their knowledge of the treatment concerned, including how and when to use its strategies and procedures, and an evaluation of their ability to apply such knowledge skillfully in practice. While the assessment of therapists' knowledge has the potential to be completed efficiently on the Web, the assessment of skill has generally involved a labor-intensive process carried out by clinicians, and as such, may not be suitable for assessing training outcome in certain circumstances. OBJECTIVES: The aims of this study were to develop and evaluate a role-play-based measure of skill suitable for assessing training outcome and to compare its performance with a highly scalable Web-based measure of applied knowledge. METHODS: Using enhanced cognitive behavioral therapy (CBT-E) for eating disorders as an exemplar, clinical scenarios for role-play assessment were developed and piloted together with a rating scheme for assessing trainee therapists' performance. These scenarios were evaluated by examining the performance of 93 therapists from different professional backgrounds and at different levels of training in implementing CBT-E. These therapists also completed a previously developed Web-based measure of applied knowledge, and the ability of the Web-based measure to efficiently predict competence on the role-play measure was investigated. RESULTS: The role-play measure assessed performance at implementing a range of CBT-E procedures. The majority of the therapists rated their performance as moderately or closely resembling their usual clinical performance. Trained raters were able to achieve good-to-excellent reliability for averaged competence, with intraclass correlation coefficients ranging from .653 to 909. The measure was also sensitive to change, with scores being significantly higher after training than before as might be expected (mean difference 0.758, P<.001) even when taking account of repeated data (mean difference 0.667, P<.001). The major shortcoming of the role-play measure was that it required considerable time and resources. This shortcoming is inherent in the method. Given this, of most interest for assessing training outcome, scores on the Web-based measure efficiently predicted therapist competence, as judged by the role-play measure (with the Web-based measure having a positive predictive value of 77% and specificity of 78%). CONCLUSIONS: The results of this study suggest that while it was feasible and acceptable to assess performance using the newly developed role-play measure, the highly scalable Web-based measure could be used in certain circumstances as a substitute for the more labor-intensive, and hence, more costly role-play method