Leading for the long haul: A mixed-method evaluation of the Sustainment Leadership Scale (SLS)

© 2018 The Author(s). Background: Despite our progress in understanding the organizational context for implementation and specifically the role of leadership in implementation, its role in sustainment has received little attention. This paper took a mixed-method approach to examine leadership during the sustainment phase of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Utilizing the Implementation Leadership Scale as a foundation, we sought to develop a short, practical measure of sustainment leadership that can be used for both applied and research purposes. Methods: Data for this study were collected as a part of a larger mixed-method study of evidence-based intervention, SafeCare®, sustainment. Quantitative data were collected from 157 providers using web-based surveys. Confirmatory factor analysis was used to examine the factor structure of the Sustainment Leadership Scale (SLS). Qualitative data were collected from 95 providers who participated in one of 15 focus groups. A framework approach guided qualitative data analysis. Mixed-method integration was also utilized to examine convergence of quantitative and qualitative findings. Results: Confirmatory factor analysis supported the a priori higher order factor structure of the SLS with subscales indicating a single higher order sustainment leadership factor. The SLS demonstrated excellent internal consistency reliability. Qualitative analyses offered support for the dimensions of sustainment leadership captured by the quantitative measure, in addition to uncovering a fifth possible factor, available leadership. Conclusions: This study found qualitative and quantitative support for the pragmatic SLS measure. The SLS can be used for assessing leadership of first-level leaders to understand how staff perceive leadership during sustainment and to suggest areas where leaders could direct more attention in order to increase the likelihood that EBIs are institutionalized into the normal functioning of the organization

Implementing a case management intervention for frequent users of the emergency department (I-CaM): An effectiveness-implementation hybrid trial study protocol

Background: ED overcrowding represents a significant public health problem in developed countries. Frequent users of the emergency departments (FUEDs; reporting 5 or more ED visits in the past year) are often affected by medical, psychological, social, and substance use problems and account for a disproportionately high number of ED visits. Past research indicates that case management (CM) interventions are a promising way to reduce ED overcrowding and improve FUEDs' quality of life. There is, however, very limited knowledge about how to disseminate and implement this intervention on a large scale to diverse clinical settings, including community hospitals and non-academic centers. This paper describes the protocol of a research project aiming to implement a CM intervention tailored to FUEDs in the public hospitals with ED in the French-speaking region of Switzerland and evaluate both the implementation process and effectiveness of the CM intervention. Methods: This research project uses a hybrid study design assessing both implementation and clinical outcomes. The implementation part of the study uses mixed methods a) to describe quantitatively and qualitatively factors that influence the implementation process, and b) to examine implementation effectiveness. The clinical part of the study uses a within-subject design (pre-post intervention) to evaluate participants' trajectories on clinical variables (e.g., quality of life, ED use) after receiving the CM intervention. We designed the study based on two implementation science frameworks. The Generic Implementation Framework guided the overall research protocol design, whereas the RE-AIM (reach, efficacy, adoption, implementation and maintenance) framework guided the implementation and effectiveness evaluations. Discussion: This research project will contribute to implementation science by providing key insights into the processes of implementing CM into broader practice. This research project is also likely to have both clinical and public health implications. Trial registration: NCT03641274, Registered 20 August 2018

Qualitative study on the implementation of professional pharmacy services in Australian community pharmacies using framework analysis

Abbreviations: BCT, Behavioural change techniques taxonomy; BCW, Behavioural change wheel; CFIR, Consolidated framework for implementation research; EPOC, Cochrane effective practice and organisation of care; FISpH, Framework for the implementation of services in pharmacy; GIF, Generic implementation framework; KPI, Key performance indicator; TDF, Theoretical domains frameworkBackground: Multiple studies have explored the implementation process and influences, however it appears there is no study investigating these influences across the stages of implementation. Community pharmacy is attempting to implement professional services (pharmaceutical care and other health services). The use of implementation theory may assist the achievement of widespread provision, support and integration. The objective was to investigate professional service implementation in community pharmacy to contextualise and advance the concepts of a generic implementation framework previously published. Methods: Purposeful sampling was used to investigate implementation across a range of levels of implementation in community pharmacies in Australia. Twenty-five semi-structured interviews were conducted and analysed using a framework methodology. Data was charted using implementation stages as overarching themes and each stage was thematically analysed, to investigate the implementation process, the influences and their relationships. Secondary analyses were performed of the factors (barriers and facilitators) using an adapted version of the Consolidated Framework for Implementation Research (CFIR), and implementation strategies and interventions, using the Expert Recommendations for Implementing Change (ERIC) discrete implementation strategy compilation. Results: Six stages emerged, labelled as development or discovery, exploration, preparation, testing, operation and sustainability. Within the stages, a range of implementation activities/steps and five overarching influences (pharmacys' direction and impetus, internal communication, staffing, community fit and support) were identified. The stages and activities were not applied strictly in a linear fashion. There was a trend towards the greater the number of activities considered, the greater the apparent integration into the pharmacy organization. Implementation factors varied over the implementation stages, and additional factors were added to the CFIR list and definitions modified/contextualised for pharmacy. Implementation strategies employed by pharmacies varied widely. Evaluations were lacking. Conclusions: The process of implementation and five overarching influences of professional services implementation in community pharmacy have been outlined. Framework analysis revealed, outside of the five overarching influences, factors influencing implementation varied across the implementation stages. It is proposed at each stage, for each domain, the factors, strategies and evaluations should be considered. The Framework for the Implementation of Services in Pharmacy incorporates the contextualisation of implementation science for pharmacy.The study was funded as part of a University of Technology Sydney (UTS) Research Excellence Scholarship (RES), comprising of an Australian Postgraduate Award (APA) Scholarship funded by the Australian Government, plus a Top-up funded by the University of Technology Sydney, received from the primary author (JCM)

Development and testing of the Measure of Innovation-Specific Implementation Intentions (MISII) using Rasch measurement theory

© 2018 The Author(s). Background: Implementation is proposed to be a multiphase, multilevel process. After a period of exploration, an adoption decision is made, typically at the upper management or policy level. Nevertheless, movement through each of the subsequent phases of the implementation process involves clinicians or providers at the individual level to adopt the innovation and then change their behavior to use/deliver the innovation. Multiple behavioral change theories propose that intentions are a critical determinant of implementation behavior. However, there is a need for the development and testing of pragmatic measures of providers' intentions to use a specific innovation or evidence-based practice (EBP). Methods: Nine items were developed to assess providers' intentions to use a specific innovation or EBP. Motivational interviewing was the EBP in the study. Items were administered, as part of larger survey, to 179 providers across 38 substance use disorder treatment (SUDT) programs within five agencies in California, USA. Rasch analysis was conducted using RUMM2030 software to assess the items, their overall fit to the Rasch model, the response scale used, individual item fit, differential item functioning (DIF), and person separation. Results: Following a stepwise process, the scale was reduced from nine items to three items to increase the feasibility and acceptability of the scale while maintaining suitable psychometric properties. The three-item unidimensional scale showed good person separation (PSI =.872), no disordering of thresholds, and no evidence of uniform or non-uniform DIF. Rasch analysis supported the viability of the scale as a measure of implementation intentions. Conclusions: The Measure of Innovation-Specific Implementation Intentions (MISII) is a sound measure of providers' intentions to use a specific innovation or EBP. Future evaluation of convergent, divergent, and predictive validity are needed. The study also demonstrates the value of Rasch analysis for testing the psychometric properties of pragmatic implementation measures

Testing the leadership and organizational change for implementation (LOCI) intervention in substance abuse treatment: A cluster randomized trial study protocol

© 2017 The Author(s). Background: Evidence-based practice (EBP) implementation represents a strategic change in organizations that requires effective leadership and alignment of leadership and organizational support across organizational levels. As such, there is a need for combining leadership development with organizational strategies to support organizational climate conducive to EBP implementation. The leadership and organizational change for implementation (LOCI) intervention includes leadership training for workgroup leaders, ongoing implementation leadership coaching, 360° assessment, and strategic planning with top and middle management regarding how they can support workgroup leaders in developing a positive EBP implementation climate. Methods: This test of the LOCI intervention will take place in conjunction with the implementation of motivational interviewing (MI) in 60 substance use disorder treatment programs in California, USA. Participants will include agency executives, 60 program leaders, and approximately 360 treatment staff. LOCI will be tested using a multiple cohort, cluster randomized trial that randomizes workgroups (i.e., programs) within agency to either LOCI or a webinar leadership training control condition in three consecutive cohorts. The LOCI intervention is 12months, and the webinar control intervention takes place in months 1, 5, and 8, for each cohort. Web-based surveys of staff and supervisors will be used to collect data on leadership, implementation climate, provider attitudes, and citizenship. Audio recordings of counseling sessions will be coded for MI fidelity. The unit of analysis will be the workgroup, randomized by site within agency and with care taken that co-located workgroups are assigned to the same condition to avoid contamination. Hierarchical linear modeling (HLM) will be used to analyze the data to account for the nested data structure. Discussion: LOCI has been developed to be a feasible and effective approach for organizations to create a positive climate and fertile context for EBP implementation. The approach seeks to cultivate and sustain both effective general and implementation leadership as well as organizational strategies and support that will remain after the study has ended. Development of a positive implementation climate for MI should result in more positive service provider attitudes and behaviors related to the use of MI and, ultimately, higher fidelity in the use of MI. Trial registration: This study is registered with Clinicaltrials.gov ( NCT03042832 ), 2 February 2017, retrospectively registered

Implementation and effectiveness study of an interprofessional support program for patients with type 2 diabetes in Swiss primary care: a study protocol

This research protocol illustrates the use of implementation science to support the development, dissemination and integration in primary care of effective and sustainable collaborative pharmacy services for chronic care management. The objective is to evaluate the implementation and the effectiveness of a pharmacist-led patient support program including regular motivational interviews; medication adherence, patient-reported outcomes, and clinical outcomes monitoring; and interactions with physicians, for patients with type 2 diabetes taking at least one oral antidiabetic medication in the French-speaking part of Switzerland. This is a prospective, multi-centered, observational, cohort study using a hybrid design to assess the patient support program. The evaluation includes three levels of analysis: (1) the implementation strategies, (2) the overall implementation process, and (3) the effectiveness of the program. Qualitative and quantitative methods are used, and outcomes are assessed at each stage of the implementation process: exploration, preparation, operation, and sustainability. This research project will provide key insights into the processes of implementing patient support programs on a large scale and adapting the traditional community pharmacy practices towards the delivery of person-centered and collaborative services

Fostering international collaboration in implementation science and research: A concept mapping exploratory study

Objective: International collaboration in science has received increasing attention given emphases on relevance, generalizability, and impact of research. Implementation science (IS) is a growing discipline that aims to translate clinical research findings into health services. Research is needed to identify efficient and effective ways to foster international collaboration in IS. Concept-mapping (CM) was utilized with a targeted sample for preliminary exploration of fostering international collaboration. Concept-mapping is a mixed-method approach (qualitative/quantitative) particularly suited for identifying essential themes and action items to facilitate planning among diverse stakeholders. We sought to identify key factors likely to facilitate productive and rewarding international collaborations in implementation research. Results: We identified eleven dimensions: Strategic Planning; Practicality; Define Common Principles; Technological Tools for Collaboration; Funding; Disseminate Importance of Fostering International Collaboration in IS; Knowledge Sharing; Innovative & Adaptive Research; Training IS Researchers; Networking & Shared Identity; Facilitate Meetings. Strategic Planning and Funding were highest rated for importance and Strategic Planning and Networking and Shared Identity were rated most feasible to institute. Fostering international collaboration in IS can accelerate the efficiency, relevance, and generalizability of implementation research. Strategies should be developed and tested to improve international collaborations and engage junior and experienced investigators in collaborations advancing implementation science and practice