Measurement resources for dissemination and implementation research in health

BACKGROUND: A 2-day consensus working meeting, hosted by the United States National Institutes of Health and the Veterans Administration, focused on issues related to dissemination and implementation (D&I) research in measurement and reporting. Meeting participants included 23 researchers, practitioners, and decision makers from the USA and Canada who concluded that the field would greatly benefit from measurement resources to enhance the ease, harmonization, and rigor of D&I evaluation efforts. This paper describes the findings from an environmental scan and literature review of resources for D&I measures. FINDINGS: We identified a total of 17 resources, including four web-based repositories and 12 static reviews or tools that attempted to synthesize and evaluate existing measures for D&I research. Thirteen resources came from the health discipline, and 11 were populated from database reviews. Ten focused on quantitative measures, and all were generated as a resource for researchers. Fourteen were organized according to an established D&I theory or framework, with the number of constructs and measures ranging from 1 to more than 450. Measure metadata was quite variable with only six providing information on the psychometric properties of measures. CONCLUSIONS: Additional guidance on the development and use of measures are needed. A number of approaches, resources, and critical areas for future work are discussed. Researchers and stakeholders are encouraged to take advantage of a number of funding mechanisms supporting this type of work. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1186/s13012-016-0401-y) contains supplementary material, which is available to authorized users

Process Evaluation of an Academic Dissemination and Implementation Science Capacity Building Program

The UC San Diego Altman Clinical and Translational Research Institute Dissemination and Implementation Science Center (DISC) launched in 2020 to provide dissemination and implementation science (DIS) training, technical assistance, community engagement, and research advancement. DISC developed a program-wide logic model to inform a process evaluation of member engagement and impact related to DISC services. The DISC Logic Model (DLM) served as the framework for a process evaluation capturing quantitative and qualitative information about scientific activities, outputs, and outcomes. The evaluation involved a multimethod approach with surveys, attendance tracking, feedback forms, documentation of grant outcomes, and promotions metrics (e.g., Twitter engagement). There were 540 DISC Members at the end of year 2 of the DISC. Engagement in the DISC was high with nearly all members endorsing at least one scientific activity. Technical assistance offerings such as DISC Journal Club and consultation were most frequently used. The most common scientific outputs were grant submission (65, 39%), formal mentoring for career award (40, 24%), and paper submission (34, 21%). The DLM facilitated a comprehensive process evaluation of our center. Actionable steps include prioritizing technical assistance, strengthening networking opportunities, identifying streamlined approaches to facilitate DIS grant writing through writing workshops, as well as office hours or organized writing leagues

Advancing the application, quality and harmonization of implementation science measures

BACKGROUND: The field of implementation science (IS) encompasses a broad range of constructs and uses measures from a variety of disciplines. However, there has been little standardization of measures or agreement on definitions of constructs across different studies, fields, authors, or research groups. METHODS: We describe a collaborative, web-based activity using the United States National Cancer Institute’s (NCI) Grid-Enabled Measures (GEM) portal that uses a wiki platform to focus discussion and engage the research community to enhance the quality and harmonization of measures for IS health-related research and practice. We present the history, process, and preliminary data from the GEM Dissemination & Implementation (D&I) Campaign on IS measurement. RESULTS: The GEM D&I Campaign has been ongoing for eight weeks as of this writing, and has used a combination of expert opinion and crowd-sourcing approaches. To date it has listed definitions for 45 constructs and summarized information on 120 measures. Usage of the website peaked at a rate of 124 views from 89 visitors on week seven. Users from seven countries have contributed measures and/or constructs, shared experience in using different measures, contributed comments, and identified research gaps and needs. CONCLUSION: Thus far, this campaign has provided information about different IS measures, their associated characteristics, and comments. The next step is to rate these measures for quality and practicality. This resource and ongoing activity have potential to advance the quality and harmonization of IS measures and constructs, and we invite readers to contribute to the process

RE-AIM Planning and Evaluation Framework: Adapting to New Science and Practice With a 20-Year Review

The RE-AIM planning and evaluation framework was conceptualized two decades ago. As one of the most frequently applied implementation frameworks, RE-AIM has now been cited in over 2,800 publications. This paper describes the application and evolution of RE-AIM as well as lessons learned from its use. RE-AIM has been applied most often in public health and health behavior change research, but increasingly in more diverse content areas and within clinical, community, and corporate settings. We discuss challenges of using RE-AIM while encouraging a more pragmatic use of key dimensions rather than comprehensive applications of all elements. Current foci of RE-AIM include increasing the emphasis on cost and adaptations to programs and expanding the use of qualitative methods to understand “how” and “why” results came about. The framework will continue to evolve to focus on contextual and explanatory factors related to RE-AIM outcomes, package RE-AIM for use by non-researchers, and integrate RE-AIM with other pragmatic and reporting frameworks

Skills-based intervention to enhance collaborative decision-making: systematic adaptation and open trial protocol for veterans with psychosis

Background: Collaborative decision-making is an innovative decision-making approach that assigns equal power and responsibility to patients and providers. Most veterans with serious mental illnesses like schizophrenia want a greater role in treatment decisions, but there are no interventions targeted for this population. A skills-based intervention is promising because it is well-aligned with the recovery model, uses similar mechanisms as other evidence-based interventions in this population, and generalizes across decisional contexts while empowering veterans to decide when to initiate collaborative decision-making. Collaborative Decision Skills Training (CDST) was developed in a civilian serious mental illness sample and may fill this gap but needs to undergo a systematic adaptation process to ensure fit for veterans. Methods: In aim 1, the IM Adapt systematic process will be used to adapt CDST for veterans with serious mental illness. Veterans and Veteran’s Affairs (VA) staff will join an Adaptation Resource Team and complete qualitative interviews to identify how elements of CDST or service delivery may need to be adapted to optimize its effectiveness or viability for veterans and the VA context. During aim 2, an open trial will be conducted with veterans in a VA Psychosocial Rehabilitation and Recovery Center (PRRC) to assess additional adaptations, feasibility, and initial evidence of effectiveness. Discussion: This study will be the first to evaluate a collaborative decision-making intervention among veterans with serious mental illness. It will also contribute to the field’s understanding of perceptions of collaborative decision-making among veterans with serious mental illness and VA clinicians, and result in a service delivery manual that may be used to understand adaptation needs generally in VA PRRCs. Trial registration: ClinicalTrials.gov Identifier: NCT0432494

Skills-based intervention to enhance collaborative decision-making: systematic adaptation and open trial protocol for veterans with psychosis

Background Collaborative decision-making is an innovative decision-making approach that assigns equal power and responsibility to patients and providers. Most veterans with serious mental illnesses like schizophrenia want a greater role in treatment decisions, but there are no interventions targeted for this population. A skills-based intervention is promising because it is well-aligned with the recovery model, uses similar mechanisms as other evidence-based interventions in this population, and generalizes across decisional contexts while empowering veterans to decide when to initiate collaborative decision-making. Collaborative Decision Skills Training (CDST) was developed in a civilian serious mental illness sample and may fill this gap but needs to undergo a systematic adaptation process to ensure fit for veterans. Methods In aim 1, the IM Adapt systematic process will be used to adapt CDST for veterans with serious mental illness. Veterans and Veteran’s Affairs (VA) staff will join an Adaptation Resource Team and complete qualitative interviews to identify how elements of CDST or service delivery may need to be adapted to optimize its effectiveness or viability for veterans and the VA context. During aim 2, an open trial will be conducted with veterans in a VA Psychosocial Rehabilitation and Recovery Center (PRRC) to assess additional adaptations, feasibility, and initial evidence of effectiveness. Discussion This study will be the first to evaluate a collaborative decision-making intervention among veterans with serious mental illness. It will also contribute to the field’s understanding of perceptions of collaborative decision-making among veterans with serious mental illness and VA clinicians, and result in a service delivery manual that may be used to understand adaptation needs generally in VA PRRCs

A pragmatic randomized trial of mailed fecal immunochemical testing to increase colorectal cancer screening among low‐income and minoritized populations

BackgroundColorectal cancer (CRC) screening is underused, particularly among low-income and minoritized populations, for whom the coronavirus disease 2019 (COVID-19) pandemic has challenged progress in achieving equity.MethodsA hub-and-spoke model was used. The hub was a nonacademic organization and the spokes were three community health center (CHC) systems overseeing numerous clinic sites. Via a cluster-randomized trial design, nine clinic sites were randomized to intervention and 16 clinic sites were randomized to usual care. Patient-level interventions included invitation letters, mailed fecal immunochemical tests (FITs), and call/text-based reminders. Year 1 intervention impact, which took place during the COVID-19 pandemic, was assessed as the proportion completing screening among individuals not up to date at baseline, which compared intervention and nonintervention clinics accounting for intraclinic cluster variation; confidence intervals (CIs) around differences not including 0 were interpreted as statistically significant.ResultsAmong 26,736 patients who met eligibility criteria, approximately 58% were female, 55% were Hispanic individuals, and 44% were Spanish speaking. The proportion completing screening was 11.5 percentage points (ppts) (95% CI, 6.1-16.9 ppts) higher in intervention versus usual care clinics. Variation in differences between intervention and usual care clinics was observed by sex (12.6 ppts [95% CI, 7.2-18.0 ppts] for females; 8.8 ppts [95% CI, 4.7-13.9 ppts] for males) and by racial and ethnic group (13.8 ppts [95% CI, 7.0-20.6 ppts] for Hispanic individuals; 13.0 ppts [95% CI, 3.6-22.4 ppts] for Asian individuals; 11.3 ppts [95% CI, 5.8-16.8 ppts] for non-Hispanic White individuals; 6.1 ppts [95% CI, 0.8-10.4 ppts] for Black individuals).ConclusionsA regional mailed FIT intervention was effective for increasing CRC screening rates across CHC systems serving diverse, low-income populations

Understanding and applying the RE-AIM framework: Clarifications and resources

Introduction: Understanding, categorizing, and using implementation science theories, models, and frameworks is a complex undertaking. The issues involved are even more challenging given the large number of frameworks and that some of them evolve significantly over time. As a consequence, researchers and practitioners may be unintentionally mischaracterizing frameworks or basing actions and conclusions on outdated versions of a framework. Methods: This paper addresses how the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework has been described, summarizes how the model has evolved over time, and identifies and corrects several misconceptions. Results: We address 13 specific areas where misconceptions have been noted concerning the use of RE-AIM and summarize current guidance on these issues. We also discuss key changes to RE-AIM over the past 20 years, including the evolution to Pragmatic Robust Implementation and Sustainability Model, and provide resources for potential users to guide application of the framework. Conclusions: RE-AIM and many other theories and frameworks have evolved, been misunderstood, and sometimes been misapplied. To some degree, this is inevitable, but we conclude by suggesting some actions that reviewers, framework developers, and those selecting or applying frameworks can do to prevent or alleviate these problems.Ye

Individual and setting level predictors of the implementation of a skin cancer prevention program: a multilevel analysis

<p>Abstract</p> <p>Background</p> <p>To achieve widespread cancer control, a better understanding is needed of the factors that contribute to successful implementation of effective skin cancer prevention interventions. This study assessed the relative contributions of individual- and setting-level characteristics to implementation of a widely disseminated skin cancer prevention program.</p> <p>Methods</p> <p>A multilevel analysis was conducted using data from the Pool Cool Diffusion Trial from 2004 and replicated with data from 2005. Implementation of Pool Cool by lifeguards was measured using a composite score (implementation variable, range 0 to 10) that assessed whether the lifeguard performed different components of the intervention. Predictors included lifeguard background characteristics, lifeguard sun protection-related attitudes and behaviors, pool characteristics, and enhanced (<it>i.e</it>., more technical assistance, tailored materials, and incentives are provided) versus basic treatment group.</p> <p>Results</p> <p>The mean value of the implementation variable was 4 in both years (2004 and 2005; SD = 2 in 2004 and SD = 3 in 2005) indicating a moderate implementation for most lifeguards. Several individual-level (lifeguard characteristics) and setting-level (pool characteristics and treatment group) factors were found to be significantly associated with implementation of Pool Cool by lifeguards. All three lifeguard-level domains (lifeguard background characteristics, lifeguard sun protection-related attitudes and behaviors) and six pool-level predictors (number of weekly pool visitors, intervention intensity, geographic latitude, pool location, sun safety and/or skin cancer prevention programs, and sun safety programs and policies) were included in the final model. The most important predictors of implementation were the number of weekly pool visitors (inverse association) and enhanced treatment group (positive association). That is, pools with fewer weekly visitors and pools in the enhanced treatment group had significantly higher program implementation in both 2004 and 2005.</p> <p>Conclusions</p> <p>More intense, theory-driven dissemination strategies led to higher levels of implementation of this effective skin cancer prevention program. Issues to be considered by practitioners seeking to implement evidence-based programs in community settings, include taking into account both individual-level and setting-level factors, using active implementation approaches, and assessing local needs to adapt intervention materials.</p