Implementation and evaluation of the VA DPP clinical demonstration: protocol for a multi-site non-randomized hybrid effectiveness-implementation type III trial.

BackgroundThe Diabetes Prevention Program (DPP) study showed that lifestyle intervention resulted in a 58% reduction in incidence of type 2 diabetes among individuals with prediabetes. Additional large randomized controlled trials have confirmed these results, and long-term follow-up has shown sustained benefit 10-20 years after the interventions ended. Diabetes is a common and costly disease, especially among Veterans, and despite strong evidence supporting the feasibility of type 2 diabetes prevention, the DPP has not been widely implemented. The first aim of this study will evaluate implementation of the Veterans Affairs (VA) DPP in three VA medical centers. The second aim will assess weight and hemoglobin A1c (A1c) outcomes, and the third aim will determine the cost-effectiveness and budget impact of implementation of the VA DPP from a health system perspective.Methods/designThis partnered multi-site non-randomized systematic assignment study will use a highly pragmatic hybrid effectiveness-implementation type III mixed methods study design. The implementation and administration of the VA DPP will be funded by clinical operations while the evaluation of the VA DPP will be funded by research grants. Seven hundred twenty eligible Veterans will be systematically assigned to the VA DPP clinical demonstration or the usual care VA MOVE!® weight management program. A multi-phase formative evaluation of the VA DPP implementation will be conducted. A theoretical program change model will be used to guide the implementation process and assess applicability and feasibility of the DPP for VA. The Consolidated Framework for Implementation Research (CFIR) will be used to guide qualitative data collection, analysis, and interpretation of barriers and facilitators to implementation. The RE-AIM framework will be used to assess Reach, Effectiveness, Adoption, Implementation, and Maintenance of the VA DPP. Twelve-month weight and A1c change will be evaluated for the VA DPP compared to the VA MOVE!ProgramMediation analyses will be conducted to identify whether program design differences impact outcomes.DiscussionFindings from this pragmatic evaluation will be highly applicable to practitioners who are tasked with implementing the DPP in clinical settings. In addition, findings will determine the effectiveness and cost-effectiveness of the VA DPP in the Veteran population

Barriers and facilitators to implementation of menu labelling interventions from a food service industry perspective: a mixed methods systematic review

BACKGROUND: Eating outside the home contributes to poor dietary habits worldwide and is associated with increased body fat and weight gain. Evidence shows menu labelling is effective in promoting healthier food choices; however, implementation issues have arisen. The purpose of this systematic review was to synthesise the evidence on the perceived barriers and facilitators to implementation of menu labelling interventions from the perspective of the food service industry. METHODS: Peer-reviewed and grey literature were searched using databases, specialised search engines and public health organisation websites. Screening reference lists, citation chaining and contacting authors of all included studies were undertaken. Primary research studies relevant to direct supply-side stakeholders were eligible for inclusion. There were no restrictions on menu labelling scheme or format, study methods, publication year or language. At least two independent reviewers performed study selection, data extraction and quality appraisal. The results were synthesised using the 'best fit' framework synthesis approach, with reference to the Consolidated Framework for Implementation Research (CFIR). RESULTS: Seventeen studies met the eligibility criteria, with the majority rated as average quality (n =¿10). The most frequently cited barriers were coded to the CFIR constructs 'Consumer Needs & Resources' (e.g. lack of customer demand for/interest in menu labelling, risk of overwhelmed/confused customers) and 'Compatibility' with organisation work processes (e.g. lack of standardised recipes, limited space on menus). Frequently cited facilitators were coded to the CFIR constructs 'Relative Advantage' of menu labelling (e.g. improved business image/reputation) and 'Consumer Needs & Resources' (e.g. customer demand for/interest in menu labelling, providing nutrition information to customers). An adapted framework consisting of a priori and new constructs was developed, which illustrates the relationships between domains. CONCLUSION: This review generates an adapted CFIR framework for understanding implementation of menu labelling interventions. It highlights that implementation is influenced by multiple interdependent factors, particularly related to the external and internal context of food businesses, and features of the menu labelling intervention. The findings can be used by researchers and practitioners to develop or select strategies to address barriers that impede implementation and to leverage facilitators that assist with implementation effort

Survey of physician and pharmacist steward perceptions of their antibiotic stewardship programs

ObjectiveTo examine how individual steward characteristics (eg, steward role, sex, and specialized training) are associated with their views of antimicrobial stewardship program (ASP) implementation at their institution.DesignDescriptive survey from a mixed-methods study.SettingTwo large national healthcare systems; the Veterans' Health Administration (VA) (n = 134 hospitals) and Intermountain Healthcare (IHC; n = 20 hospitals).ParticipantsWe sent the survey to 329 antibiotic stewards serving in 154 hospitals; 152 were physicians and 177 were pharmacists. In total, 118 pharmacists and 64 physicians from 126 hospitals responded.MethodsThe survey was grounded in constructs of the Consolidated Framework for Implementation Research, and it assessed stewards' views on the development and implementation of antibiotic stewardship programs (ASPs) at their institutions We then examined differences in stewards' views by demographic factors.ResultsRegardless of individual factors, stewards agreed that the ASP added value to their institution and was advantageous to patient care. Stewards also reported high levels of collegiality and self-efficacy. Stewards who had specialized training or those volunteered for the role were less likely to think that the ASP was implemented due to a mandate. Similarly volunteers and those with specialized training felt that they had authority in the antibiotic decisions made in their facility.ConclusionsGiven the importance of ASPs, it may be beneficial for healthcare institutions to recruit and train individuals with a true interest in stewardship

Implementation and sustainment of diverse practices in a large integrated health system: a mixed methods study

Background: One goal of health systems seeking to evolve into learning health systems is to accelerate the implementation and sustainment of evidence-based practices (EBPs). As part of this evolution, the Veterans Health Administration (VHA) developed the Innovation Ecosystem, which includes the Diffusion of Excellence (DoE), a program that identifies and diffuses Gold Status Practices (GSPs) across facilities. The DoE hosts an annual Shark Tank competition in which leaders bid on the opportunity to implement a GSP with 6 months of implementation support. Over 750 diverse practices were submitted in cohorts 2 and 3 of Shark Tank; 23 were designated GSPs and were implemented in 31 VA networks or facilities. As part of a national evaluation of the DoE, we identified factors contributing to GSP implementation and sustainment. Methods: Our sequential mixed methods evaluation of cohorts 2 and 3 of Shark Tank included semi-structured interviews with at least one representative from 30/31 implementing teams (N = 78/105 people invited) and survey responses from 29/31 teams (N = 39/47 invited). Interviews focused on factors influencing implementation and future sustainment. Surveys focused on sustainment 1.5-2 years after implementation. The Consolidated Framework for Implementation Research (CFIR) informed data collection and directed content analysis. Ordinal scales were developed inductively to rank implementation and sustainment outcomes. Results: Over 50% of teams (17/30) successfully implemented their GSP within the 6-month implementation period. Despite extensive implementation support, significant barriers related to centralized decision-making, staffing, and resources led to partial (n = 6) or no (n = 7) implementation for the remaining teams. While 12/17 initially successful implementation teams reported sustained use of their GSP, over half of the initially unsuccessful teams (n = 7/13) also reported sustained GSP use 1.5 years after the initial implementation period. When asked at 6 months, 18/27 teams with complete data accurately anticipated their future sustainability based on reported sustainment an average of 1.5 years later. Conclusions: Most teams implemented within 6 months and/or sustained their GSP 1.5 years later. High levels of implementation and sustainment across diverse practices and teams suggest that VHA\u27s DoE is a successful large-scale model of diffusion. Team predictions about sustainability after the first 6 months of implementation provide a promising early assessment and point of intervention to increase sustainability

Attention bias to emotional faces varies by IQ and anxiety in Williams syndrome

Individuals with Williams syndrome (WS) often experience significant anxiety. A promising approach to anxiety intervention has emerged from cognitive studies of attention bias to threat. To investigate the utility of this intervention in WS, this study examined attention bias to happy and angry faces in individuals with WS (N=46). Results showed a significant difference in attention bias patterns as a function of IQ and anxiety. Individuals with higher IQ or higher anxiety showed a significant bias toward angry, but not happy faces, whereas individuals with lower IQ or lower anxiety showed the opposite pattern. These results suggest that attention bias interventions to modify a threat bias may be most effectively targeted to anxious individuals with WS with relatively high IQ

Diffusion of excellence: evaluating a system to identify, replicate, and spread promising innovative practices across the Veterans health administration

IntroductionThe Veterans Health Administration (VHA) Diffusion of Excellence (DoE) program provides a system to identify, replicate, and spread promising practices across the largest integrated healthcare system in the United States. DoE identifies innovations that have been successfully implemented in the VHA through a Shark Tank style competition. VHA facility and regional directors bid resources needed to replicate promising practices. Winning facilities/regions receive external facilitation to aid in replication/implementation over the course of a year. DoE staff then support diffusion of successful practices across the nationwide VHA.MethodsOrganized around the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) Framework, we summarize results of an ongoing long-term mixed-methods implementation evaluation of DoE. Data sources include: Shark Tank application and bid details, tracking practice adoptions through a Diffusion Marketplace, characteristics of VHA facilities, focus groups with Shark Tank bidders, structured observations of DoE events, surveys of DoE program participants, and semi-structured interviews of national VHA program office leaders, VHA healthcare system/facility executives, practice developers, implementation teams and facilitators.ResultsIn the first eight Shark Tanks (2016–2022), 3,280 Shark Tank applications were submitted; 88 were designated DoE Promising Practices (i.e., practices receive facilitated replication). DoE has effectively spread practices across the VHA, with 1,440 documented instances of adoption/replication of practices across the VHA. This includes 180 adoptions/replications in facilities located in rural areas. Leadership decisions to adopt innovations are often based on big picture considerations such as constituency support and linkage to organizational goals. DoE Promising Practices that have the greatest national spread have been successfully replicated at new sites during the facilitated replication process, have close partnerships with VHA national program offices, and tend to be less expensive to implement. Two indicators of sustainment indicate that 56 of the 88 Promising Practices are still being diffused across the VHA; 56% of facilities originally replicating the practices have sustained them, even up to 6 years after the first Shark Tank.ConclusionDoE has developed a sustainable process for the identification, replication, and spread of promising practices as part of a learning health system committed to providing equitable access to high quality care

Comparison of rapid vs in-depth qualitative analytic methods from a process evaluation of academic detailing in the Veterans Health Administration

Abstract Background It is challenging to conduct and quickly disseminate findings from in-depth qualitative analyses, which can impede timely implementation of interventions because of its time-consuming methods. To better understand tradeoffs between the need for actionable results and scientific rigor, we present our method for conducting a framework-guided rapid analysis (RA) and a comparison of these findings to an in-depth analysis of interview transcripts. Methods Set within the context of an evaluation of a successful academic detailing (AD) program for opioid prescribing in the Veterans Health Administration, we developed interview guides informed by the Consolidated Framework for Implementation Research (CFIR) and interviewed 10 academic detailers (clinical pharmacists) and 20 primary care providers to elicit detail about successful features of the program. For the RA, verbatim transcripts were summarized using a structured template (based on CFIR); summaries were subsequently consolidated into matrices by participant type to identify aspects of the program that worked well and ways to facilitate implementation elsewhere. For comparison purposes, we later conducted an in-depth analysis of the transcripts. We described our RA approach and qualitatively compared the RA and deductive in-depth analysis with respect to consistency of themes and resource intensity. Results Integrating the CFIR throughout the RA and in-depth analysis was helpful for providing structure and consistency across both analyses. Findings from the two analyses were consistent. The most frequently coded constructs from the in-depth analysis aligned well with themes from the RA, and the latter methods were sufficient and appropriate for addressing the primary evaluation goals. Our approach to RA was less resource-intensive than the in-depth analysis, allowing for timely dissemination of findings to our operations partner that could be integrated into ongoing implementation. Conclusions In-depth analyses can be resource-intensive. If consistent with project needs (e.g., to quickly produce information to inform ongoing implementation or to comply with a policy mandate), it is reasonable to consider using RA, especially when faced with resource constraints. Our RA provided valid findings in a short timeframe, enabling identification of actionable suggestions for our operations partner

Rapid versus traditional qualitative analysis using the Consolidated Framework for Implementation Research (CFIR)

BACKGROUND: Qualitative approaches, alone or in mixed methods, are prominent within implementation science. However, traditional qualitative approaches are resource intensive, which has led to the development of rapid qualitative approaches. Published rapid approaches are often inductive in nature and rely on transcripts of interviews. We describe a deductive rapid analysis approach using the Consolidated Framework for Implementation Research (CFIR) that uses notes and audio recordings. This paper compares our rapid versus traditional deductive CFIR approach. METHODS: Semi-structured interviews were conducted for two cohorts of the Veterans Health Administration (VHA) Diffusion of Excellence (DoE). The CFIR guided data collection and analysis. In cohort A, we used our traditional CFIR-based deductive analysis approach (directed content analysis), where two analysts completed independent in-depth manual coding of interview transcripts using qualitative software. In cohort B, we used our new rapid CFIR-based deductive analysis approach (directed content analysis), where the primary analyst wrote detailed notes during interviews and immediately coded notes into a MS Excel CFIR construct by facility matrix; a secondary analyst then listened to audio recordings and edited the matrix. We tracked time for our traditional and rapid deductive CFIR approaches using a spreadsheet and captured transcription costs from invoices. We retrospectively compared our approaches in terms of effectiveness and rigor. RESULTS: Cohorts A and B were similar in terms of the amount of data collected. However, our rapid deductive CFIR approach required 409.5 analyst hours compared to 683 h during the traditional deductive CFIR approach. The rapid deductive approach eliminated $7250 in transcription costs. The facility-level analysis phase provided the greatest savings: 14 h/facility for the traditional analysis versus 3.92 h/facility for the rapid analysis. Data interpretation required the same number of hours for both approaches. CONCLUSION: Our rapid deductive CFIR approach was less time intensive and eliminated transcription costs, yet effective in meeting evaluation objectives and establishing rigor. Researchers should consider the following when employing our approach: (1) team expertise in the CFIR and qualitative methods, (2) level of detail needed to meet project aims, (3) mode of data to analyze, and (4) advantages and disadvantages of using the CFIR

Factors influencing fidelity to a calorie posting policy in public hospitals: a mixed methods study

Background: Labelling menus with nutrition information has increasingly become an important obesity policy option. While much research to-date has focused on determining its effectiveness, few studies report the extent to which menu labelling is implemented as designed. The aim of this study was to explore factors influencing fidelity to a calorie posting policy in Irish acute public hospitals. Methods: A mixed methods sequential explanatory study design was employed, with a nested case study for the qualitative component. Quantitative data on implementation fidelity at hospitals were analysed first and informed case sampling in the follow-on qualitative phase. Maximum variation sampling was used to select four hospitals with high and low levels of implementation and variation in terms of geographic location, hospital size, complexity of care provided and hospital type. Data were collected using structured observations, unstructured non-participant observations and in-depth semi structured interviews. The Consolidated Framework for Implementation Research guided qualitative data collection and analysis. Using framework analysis, factors influencing implementation were identified. A triangulation protocol was used to integrate fidelity findings from multiple sources. Data on influencing factors and fidelity were then combined using joint displays for within and cross-case analysis. Results: Quantitative fidelity data showed seven hospitals were categorised as low implementers and 28 hospitals were high implementers of the policy. Across the four hospitals selected as cases, qualitative analysis revealed factors influencing implementation and fidelity were multiple, and operated independently and in combination. Factors were related to the internal hospital environment (e.g., leadership support, access to knowledge and information, perceived importance of calorie posting implementation), external hospital environment (e.g., national policy, monitoring), features of the calorie posting policy (e.g., availability of supporting materials), and the implementation process (e.g., engaging relevant stakeholders). Integrated analysis of fidelity indicated a pattern of partial adherence to the calorie posting policy across the four hospitals. Across all hospitals, there was a consistent pattern of low adherence to calorie posting across all menu items on sale, low adherence to calorie information displayed per standard portion or per meal, low adherence to standardised recipes/portions, and inaccurate calorie information. Conclusion: Efforts to maximise fidelity require multi-level, multi-component strategies in order to reduce or mitigate barriers and to leverage facilitators. Future research should examine the relative importance of calorie posting determinants and the association between implementation strategies and shifts in fidelity to intervention core components

Implementation and evaluation of the VA DPP clinical demonstration: protocol for a multi-site non-randomized hybrid effectiveness-implementation type III trial.

BackgroundThe Diabetes Prevention Program (DPP) study showed that lifestyle intervention resulted in a 58% reduction in incidence of type 2 diabetes among individuals with prediabetes. Additional large randomized controlled trials have confirmed these results, and long-term follow-up has shown sustained benefit 10-20 years after the interventions ended. Diabetes is a common and costly disease, especially among Veterans, and despite strong evidence supporting the feasibility of type 2 diabetes prevention, the DPP has not been widely implemented. The first aim of this study will evaluate implementation of the Veterans Affairs (VA) DPP in three VA medical centers. The second aim will assess weight and hemoglobin A1c (A1c) outcomes, and the third aim will determine the cost-effectiveness and budget impact of implementation of the VA DPP from a health system perspective.Methods/designThis partnered multi-site non-randomized systematic assignment study will use a highly pragmatic hybrid effectiveness-implementation type III mixed methods study design. The implementation and administration of the VA DPP will be funded by clinical operations while the evaluation of the VA DPP will be funded by research grants. Seven hundred twenty eligible Veterans will be systematically assigned to the VA DPP clinical demonstration or the usual care VA MOVE!® weight management program. A multi-phase formative evaluation of the VA DPP implementation will be conducted. A theoretical program change model will be used to guide the implementation process and assess applicability and feasibility of the DPP for VA. The Consolidated Framework for Implementation Research (CFIR) will be used to guide qualitative data collection, analysis, and interpretation of barriers and facilitators to implementation. The RE-AIM framework will be used to assess Reach, Effectiveness, Adoption, Implementation, and Maintenance of the VA DPP. Twelve-month weight and A1c change will be evaluated for the VA DPP compared to the VA MOVE!ProgramMediation analyses will be conducted to identify whether program design differences impact outcomes.DiscussionFindings from this pragmatic evaluation will be highly applicable to practitioners who are tasked with implementing the DPP in clinical settings. In addition, findings will determine the effectiveness and cost-effectiveness of the VA DPP in the Veteran population