Using formative evaluation in an implementation project to increase vaccination rates in high-risk veterans: QUERI Series

<p>Abstract</p> <p>Background</p> <p>Implementation of research into practice in health care systems is a challenging and often unsuccessful endeavor. The United States Department of Veterans Affairs (VA) Quality Enhancement Research Initiative (QUERI) research teams include formative evaluations (FE) in their action-oriented VA implementation projects to identify critical information about the processes of implementation that can guide adjustments to project activities, in order to better meet project goals. This article describes the development and use of FE in an action-oriented implementation research project.</p> <p>Methods</p> <p>This two-year action-oriented implementation research project was conducted at 23 VA Spinal Cord Injury (SCI) Centers, and targeted patients, staff and the system of care, such as administration and information technology. Data for FE were collected by electronic and paper surveys, semi-structured and open-ended interviews, notes during conference calls, and exchange of e-mail messages. Specific questions were developed for each intervention (designed to improve vaccination rates for influenza in veterans with spinal cord injury and disorder); informants were selected for their knowledge of interventions and their use in SCI Centers.</p> <p>Results</p> <p>Data from FE were compiled separately for each intervention to describe barriers to progress and guide adjustments to implementation activities. These data addressed the processes of implementing the interventions, problem-solving activities and the status of interventions at SCI Centers.</p> <p>Conclusion</p> <p>Formative evaluations provided the project team with a broad view of the processes of implementing multi-targeted interventions as well as the evolving status of the related best practice. Using FE was useful, although the challenges of conducting FE for non-field researchers should be addressed. Work is needed to develop methods for conducting FE across multiple sites, as well as acknowledging variations in local contexts that affect implementation of interventions.</p

Role of "external facilitation" in implementation of research findings: a qualitative evaluation of facilitation experiences in the Veterans Health Administration

BACKGROUND: Facilitation has been identified in the literature as a potentially key component of successful implementation. It has not, however, either been well-defined or well-studied. Significant questions remain about the operational definition of facilitation and about the relationship of facilitation to other interventions, especially to other change agent roles when used in multi-faceted implementation projects. Researchers who are part of the Quality Enhancement Research Initiative (QUERI) are actively exploring various approaches and processes, including facilitation, to enable implementation of best practices in the Veterans Health Administration health care system – the largest integrated healthcare system in the United States. This paper describes a systematic, retrospective evaluation of implementation-related facilitation experiences within QUERI, a quality improvement program developed by the US Department of Veterans Affairs. METHODS: A post-hoc evaluation was conducted through a series of semi-structured interviews to examine the concept of facilitation across several multi-site QUERI implementation studies. The interview process is based on a technique developed in the field of education, which systematically enhances learning through experience by stimulating recall and reflection regarding past complex activities. An iterative content analysis approach relative to a set of conceptually-based interview questions was used for data analysis. FINDINGS: Findings suggest that facilitation, within an implementation study initiated by a central change agency, is a deliberate and valued process of interactive problem solving and support that occurs in the context of a recognized need for improvement and a supportive interpersonal relationship. Facilitation was described primarily as a distinct role with a number of potentially crucial behaviors and activities. Data further suggest that external facilitators were likely to use or integrate other implementation interventions, while performing this problem-solving and supportive role. PRELIMINARY CONCLUSIONS: This evaluation provides evidence to suggest that facilitation could be considered a distinct implementation intervention, just as audit and feedback, educational outreach, or similar methods are considered to be discrete interventions. As such, facilitation should be well-defined and explicitly evaluated for its perceived usefulness within multi-intervention implementation projects. Additionally, researchers should better define the specific contribution of facilitation to the success of implementation in different types of projects, different types of sites, and with evidence and innovations of varying levels of strength and complexity

Preoperative Functional Expectations and Postoperative Outcomes Among Patients Undergoing First Eye Cataract Surgery

Expectations regarding visual functioning after cataract surgery are very high, and in most cases such expectations are fulfilled. In selected cases, more comprehensive counseling may reduce the discrepancy between expectations and actual outcomes of cataract surgery. © 1995, American Medical Association. All rights reserved

The Role of Formative Evaluation in Implementation Research and the QUERI Experience

This article describes the importance and role of 4 stages of formative evaluation in our growing understanding of how to implement research findings into practice in order to improve the quality of clinical care. It reviews limitations of traditional approaches to implementation research and presents a rationale for new thinking and use of new methods. Developmental, implementation-focused, progress-focused, and interpretive evaluations are then defined and illustrated with examples from Veterans Health Administration Quality Enhancement Research Initiative projects. This article also provides methodologic details and highlights challenges encountered in actualizing formative evaluation within implementation research

Reproducibility and Responsiveness of the VF-14: An Index of Functional Impairment in Patients With Cataracts

The VF-14 was reproducible in stable patients during an 8-month period, and it was more responsive to clinically significant changes in vision than was a generic health status measure (ie, the Sickness Impact Profile). © 1995, American Medical Association. All rights reserved