Diffusion of excellence: evaluating a system to identify, replicate, and spread promising innovative practices across the Veterans health administration

IntroductionThe Veterans Health Administration (VHA) Diffusion of Excellence (DoE) program provides a system to identify, replicate, and spread promising practices across the largest integrated healthcare system in the United States. DoE identifies innovations that have been successfully implemented in the VHA through a Shark Tank style competition. VHA facility and regional directors bid resources needed to replicate promising practices. Winning facilities/regions receive external facilitation to aid in replication/implementation over the course of a year. DoE staff then support diffusion of successful practices across the nationwide VHA.MethodsOrganized around the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) Framework, we summarize results of an ongoing long-term mixed-methods implementation evaluation of DoE. Data sources include: Shark Tank application and bid details, tracking practice adoptions through a Diffusion Marketplace, characteristics of VHA facilities, focus groups with Shark Tank bidders, structured observations of DoE events, surveys of DoE program participants, and semi-structured interviews of national VHA program office leaders, VHA healthcare system/facility executives, practice developers, implementation teams and facilitators.ResultsIn the first eight Shark Tanks (2016–2022), 3,280 Shark Tank applications were submitted; 88 were designated DoE Promising Practices (i.e., practices receive facilitated replication). DoE has effectively spread practices across the VHA, with 1,440 documented instances of adoption/replication of practices across the VHA. This includes 180 adoptions/replications in facilities located in rural areas. Leadership decisions to adopt innovations are often based on big picture considerations such as constituency support and linkage to organizational goals. DoE Promising Practices that have the greatest national spread have been successfully replicated at new sites during the facilitated replication process, have close partnerships with VHA national program offices, and tend to be less expensive to implement. Two indicators of sustainment indicate that 56 of the 88 Promising Practices are still being diffused across the VHA; 56% of facilities originally replicating the practices have sustained them, even up to 6 years after the first Shark Tank.ConclusionDoE has developed a sustainable process for the identification, replication, and spread of promising practices as part of a learning health system committed to providing equitable access to high quality care

Sustainment of diverse evidence-informed practices disseminated in the Veterans Health Administration (VHA): initial development and piloting of a pragmatic survey tool

Abstract Background There are challenges associated with measuring sustainment of evidence-informed practices (EIPs). First, the terms sustainability and sustainment are often falsely conflated: sustainability assesses the likelihood of an EIP being in use in the future while sustainment assesses the extent to which an EIP is (or is not) in use. Second, grant funding often ends before sustainment can be assessed. The Veterans Health Administration (VHA) Diffusion of Excellence (DoE) program is one of few large-scale models of diffusion; it seeks to identify and disseminate practices across the VHA system. The DoE sponsors “Shark Tank” competitions, in which leaders bid on the opportunity to implement a practice with approximately 6 months of implementation support. As part of an ongoing evaluation of the DoE, we sought to develop and pilot a pragmatic survey tool to assess sustainment of DoE practices. Methods In June 2020, surveys were sent to 64 facilities that were part of the DoE evaluation. We began analysis by comparing alignment of quantitative and qualitative responses; some facility representatives reported in the open-text box of the survey that their practice was on a temporary hold due to COVID-19 but answered the primary outcome question differently. As a result, the team reclassified the primary outcome of these facilities to Sustained: Temporary COVID-Hold. Following this reclassification, the number and percent of facilities in each category was calculated. We used directed content analysis, guided by the Consolidated Framework for Implementation Research (CFIR), to analyze open-text box responses. Results A representative from forty-one facilities (64%) completed the survey. Among responding facilities, 29/41 sustained their practice, 1/41 partially sustained their practice, 8/41 had not sustained their practice, and 3/41 had never implemented their practice. Sustainment rates increased between Cohorts 1–4. Conclusions The initial development and piloting of our pragmatic survey allowed us to assess sustainment of DoE practices. Planned updates to the survey will enable flexibility in assessing sustainment and its determinants at any phase after adoption. This assessment approach can flex with the longitudinal and dynamic nature of sustainment, including capturing nuances in outcomes when practices are on a temporary hold. If additional piloting illustrates the survey is useful, we plan to assess the reliability and validity of this measure for broader use in the field

Eliciting patient views on the allocation of limited healthcare resources: a deliberation on hepatitis C treatment in the Veterans Health Administration

Abstract Background In response to the development of highly effective but expensive new medications, policymakers, payors, and health systems are considering novel and pragmatic ways to provide these medications to patients. One approach is to target these treatments to those most likely to benefit. However, to maximize the fairness of these policies, and the acceptance of their implementation, the values and beliefs of patients should be considered. The provision of treatments for chronic hepatitis C (CHC) in the resource-constrained context of the Veterans Health Administration (VHA) offered a real-world example of this situation, providing the opportunity to test the value of using Democratic Deliberation (DD) methods to solicit the informed opinions of laypeople on this complex issue. Methods We recruited Veterans (n = 30) from the VHA to attend a DD session. Following educational presentations from content experts, participants engaged in facilitated small group discussions to: 1) identify strategies to overcome CHC treatment barriers and 2) evaluate, vote on, and modify/improve two CHC treatment policies – “first come, first served” (FCFS) and “sickest first” (SF). We used transcripts and facilitators’ notes to identify key themes from the small group discussions. Additionally, participants completed pre- and post-DD surveys. Results Most participants endorsed the SF policy over the FCFS policy, emphasizing the ethical and medical appropriateness of treating the sickest first. Concerns about SF centered on the difficulty of implementation (e.g., how is “sickest” determined?) and unfairness to other Veterans. Proposed modifications focused on: 1) the need to consider additional health factors, 2) taking behavior and lifestyle into account, 3) offering education and support, 4) improving access, and 5) facilitating better decision-making. Conclusions DD offered a robust and useful method for addressing the allocation of the scarce resource of CHC treatment. Participants were able to develop a modified version of the SF policy and offered diverse recommendations to promote fairness and improve quality of care for Veterans. DD is an effective approach for incorporating patient preferences and gaining valuable insights for critical healthcare policy decisions in resource-limited environments.http://deepblue.lib.umich.edu/bitstream/2027.42/173770/1/12913_2020_Article_5211.pd

Yield of Repeat Endoscopy for Barrett's Esophagus After Normal Index Endoscopy

INTRODUCTION:Guidelines suggest 1-time screening with esophagogastroduodenoscopy (EGD) for Barrett's esophagus (BE) in individuals at an increased risk of esophageal adenocarcinoma (EAC). We aimed to estimate the yield of repeat EGD performed at prolonged intervals after a normal index EGD.METHODS:We conducted a national retrospective analysis within the U S Veterans Health Administration, identifying patients with a normal index EGD between 2003 and 2009 who subsequently had a repeat EGD. We tabulated the proportion with a new diagnosis of BE, EAC, or esophagogastric junction adenocarcinoma (EGJAC) and conducted manual chart review of a sample. We fitted logistic regression models for the odds of a new diagnosis of BE/EAC/EGJAC.RESULTS:We identified 71,216 individuals who had a repeat EGD between 1 and 16 years after an index EGD without billing or cancer registry codes for BE/EAC/EGJAC. Of them, 4,088 had a new billing or cancer registry code for BE/EAC/EGJAC after the repeat EGD. On manual review of a stratified sample, most did not truly have new BE/EAC/EGJAC. A longer duration between EGD was associated with greater odds of a new diagnosis (adjusted odds ratio [aOR] for each 5 years 1.31; 95% confidence interval [CI] 1.19-1.44), particularly among those who were younger during the index EGD (ages 19-29 years: aOR 3.92; 95% CI 1.24-12.4; ages 60-69 years: aOR 1.19; 95% CI 1.01-1.40).DISCUSSION:The yield of repeat EGD for BE/EAC/EGJAC seems to increase with time after a normal index EGD, particularly for younger individuals. Prospective studies are warranted to confirm these findings.</p