Proceedings from the Second Annual Conference of the Norwegian Network for Implementation Research

In 2019, Norwegian implementation researchers formed a network to promote implementation research and practice in the Norwegian context. On November 19th, 2021, the second annual Norwegian implementation conference was held in Oslo. Ninety participants from all regions of the country gathered to showcase the frontiers of Norwegian implementation research. The conference also hosted a panel discussion about critical next steps for implementation science in Norway. The conference included 17 presentations from diverse disciplines within health and welfare services, including schools. The themes presented included stakeholder engagement, implementation mechanisms, evaluations of the implementation of specific interventions, the use of implementation guidelines and frameworks, the development and validation of implementation measurements, and barriers and facilitators for implementation. The panel discussion highlighted several critical challenges with the implementation of evidence-informed practices in Norway, including limited implementation competence and capacity among practice leaders and workforces, few opportunities for education in implementation science, limited implementation research in the Norwegian context, scarce funding possibilities for implementation research, and a lack of long-term perspectives on implementation processes. Overall, the 2021 Norwegian implementation conference showed an encouraging sign of a maturing field of science in Norway. The more voluminous proceedings from the 2020 conference called for several important advancements to improve implementation science and practice in Norway, and the 2021 conference indicates that steps have already been taken in favorable directions in terms of, for instance, research designs and measurements. However, there are still unexploited potentials for improvements in implementation research, funding, policies, and practice. Norwegian implementation researcher should be mindful of the challenges and potential pitfalls implementation science currently face as a scientific discipline.publishedVersio

Psychometric Properties of the General Organizational Index (GOI): A Measure of Individualization and Quality Improvement to Complement Program Fidelity

To assess the implementation of effective practices, mental health programs need standardized measures. The General Organizational Index (GOI), although widely used for this purpose, has received minimal psychometric research. For this study, we assessed psychometric properties of the GOI scale administered four times over 18 months during the implementation of a new program in 11 sites. The GOI scale demonstrated high levels of interrater reliability (.97), agreement between assessors on item ratings (86% overall), internal consistency (.77–.80 at three time points), sensitivity to change, and feasibility. We conclude that the GOI scale has acceptable psychometric properties, and its use may enhance implementation and research on evidence-based mental health practices.publishedVersio

Implementation of evidence-based treatment for PTSD in Norway: clinical outcomes and impact of probable complex PTSD

Background: Posttraumatic stress disorder (PTSD) is a long-lasting and debilitating psychological disorder that affects a large portion of the population. Treatments such as Cognitive therapy for PTSD (CT-PTSD) and Eye movement desensitization and reprocessing (EMDR) have been shown to be effective and cost-efficient in clinical trials, but uptake and evidence of positive outcomes in real-world clinical services are limited. Implementation efforts have been hampered by providers’ concerns about the feasibility of trauma-focused treatments in more complex presentations (i.e. Complex PTSD). Objective: To evaluate the effectiveness of CT-PTSD and EMDR in a real-world setting, as implemented in Norwegian outpatient mental health clinics for adults, and investigate the impact of probable Complex PTSD status on treatment outcomes. Methods: Clinicians from 15 different outpatient clinics received training and supervision in EMDR or CT-PTSD as part of a national implementation project. 104 clinicians recruited and treated 196 participants with PTSD. Symptoms of PTSD, depression and anxiety were assessed session-by-session and used to estimate pre-post effect sizes. Mixed-models were employed to investigate the impact of complex PTSD. Results: Both EMDR and CT-PTSD were associated with significant reductions in PTSD symptoms, with large effect sizes. Probable Complex PTSD was associated with higher levels of symptoms before and after treatment but did not significantly impact the effectiveness of treatment. Conclusion: The use of evidence-based treatments for PTSD in routine clinical service is associated with good treatment outcomes, also for patients with Complex PTSD

Significance of Leaders for Sustained Use of Evidence-Based Practices: A Qualitative Focus-Group Study with Mental Health Practitioners

Evidence-based practices that are implemented in mental health services are often challenging to sustain. In this focus-group study, 26 mental health practitioners with high fidelity scores were interviewed regarding their experiences with implementing the illness management and recovery, an evidence-based practice for people with severe mental disorders, in their services and how this could influence further use. Findings indicate that high fidelity is not equivalent to successful implementation. Rather, to sustain the practice in services, the practitioners emphasized the importance of their leaders being positive and engaged in the intervention, and hold clear goals and visions for the intervention in the clinic. In addition, the practitioners’ understanding of outcome monitoring as a resource for practice improvement must be improved to avoid random patient experiences becoming the decisive factor in determining further use

Psychometric properties of the Norwegian version of the Evidence-Based Practice Attitude Scale (EBPAS): to measure implementation readiness

Background Attitudes can be a precursor to the decision of whether or not to try a new practice. In order to tailor the implementation of evidence-based practices (EBPs) in mental health settings, we must first consider practitioner attitudes towards EBP adoption. To assess these attitudes, the Evidence-Based Practice Attitude Scale (EBPAS) was developed. The purpose of this study was to investigate the psychometric properties of the Norwegian version of the EBPAS, and to examine differences in attitudes towards implementing EBPs among mental health practitioners. Methods The EBPAS was translated into Norwegian and administered to 294 practitioners from seven primary and 22 specialized mental care units within a defined geographical area of Norway. Results The EBPAS showed good psychometric properties. The less clinical experience the practitioner had, the more positive their attitude toward EBPs. Primary care practitioners reported more positive attitudes towards implementing EBPs that were required of them than specialized care practitioners. Conclusions The Norwegian version of the EBPAS is a promising tool for measuring implementation readiness in mental health services, and can be used in clinical practice to tailor implementation efforts

A Randomized Effectiveness Study Comparing Trauma-Focused Cognitive Behavioral Therapy With Therapy as Usual for Youth

The efficacy of trauma-focused cognitive behavioral therapy (TF-CBT) has been shown in several randomized controlled trials. However, few trials have been conducted in community clinics, few have used therapy as usual (TAU) as a comparison group, and none have been conducted outside of the United States. The objective of this study was to evaluate the effectiveness of TF-CBT in regular community settings compared with TAU. One hundred fifty-six traumatized youth (M age = 15.1 years, range = 10–18; 79.5% girls) were randomly assigned to TF-CBT or TAU. Intent-to-treat analysis using mixed effects models showed that youth receiving TF-CBT reported significantly lower levels of posttraumatic stress symptoms (est. = 5.78, d = 0.51), 95% CI [2.32, 9.23]; depression (est. = 7.00, d = 0.54), 95% CI [2.04, 11.96]; and general mental health symptoms (est. = 2.54, d = 0.45), 95% CI [0.50, 4.58], compared with youth in the TAU group. Youth assigned to TF-CBT showed significantly greater improvements in functional impairment (est. = −1.05, d = −0.55), 95% CI [−1.67, −0.42]. Although the same trend was found for anxiety reduction, this difference was not statistically significant (est. = 4.34, d = 0.30), 95% CI [−1.50, 10.19]. Significantly fewer youths in the TF-CBT condition were diagnosed with posttraumatic stress disorder compared to youths in the TAU condition, χ2(1, N = 116) = 4.61, p = .031, Phi = .20). Findings indicate that TF-CBT is effective in treating traumatized youth in community mental health clinics and that the program may also be successfully implemented in countries outside the United States. This is an Open Access article. Non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly attributed, cited, and is not altered, transformed, or built upon in any way, is permitted. The moral rights of the named author(s) have been asserted

How to implement Illness Management and Recovery (IMR) in mental health service settings : evaluation of the implementation strategy

Background: The purpose of this study was to evaluate the implementation strategy used in the first-phase of implementation of the Illness Management and Recovery (IMR) programme, an intervention for adults with severe mental illnesses, in nine mental health service settings in Norway. Methods: A total of 9 clinical leaders, 31 clinicians, and 44 consumers at 9 service settings participated in the implementation of IMR. Implementation was conducted by an external team of researchers and an experienced trainer. Data were gathered on fidelity to the intervention and implementation strategy, feasibility, and consumer outcomes. Results: Although the majority of clinicians scored within the acceptable range of high intervention fidelity, their participation in the implementation strategy appeared to moderate anticipated future use of IMR. No service settings reached high intervention fidelity scores for organizational quality improvement after 12 months of implementation. IMR implementation seemed feasible, albeit with some challenges. Consumer outcomes indicated significant improvements in illness self-management, severity of problems, functioning, and hope. There were nonsignificant positive changes in symptoms and quality of life. Conclusions: The implementation strategy appeared adequate to build clinician competence over time, enabling clinicians to provide treatment that increased functioning and hope for consumers. Additional efficient strategies should be incorporated to facilitate organizational change and thus secure the sustainability of the implemented practice