Validity and usefulness of members reports of implementation progress in a quality improvement initiative: findings from the Team Check-up Tool (TCT)

<p>Abstract</p> <p>Background</p> <p>Team-based interventions are effective for improving safety and quality of healthcare. However, contextual factors, such as team functioning, leadership, and organizational support, can vary significantly across teams and affect the level of implementation success. Yet, the science for measuring context is immature. The goal of this study is to validate measures from a short instrument tailored to track dynamic context and progress for a team-based quality improvement (QI) intervention.</p> <p>Methods</p> <p>Design: Secondary cross-sectional and longitudinal analysis of data from a clustered randomized controlled trial (RCT) of a team-based quality improvement intervention to reduce central line-associated bloodstream infection (CLABSI) rates in intensive care units (ICUs).</p> <p>Setting: Forty-six ICUs located within 35 faith-based, not-for-profit community hospitals across 12 states in the U.S.</p> <p>Population: Team members participating in an ICU-based QI intervention.</p> <p>Measures: The primary measure is the Team Check-up Tool (TCT), an original instrument that assesses context and progress of a team-based QI intervention. The TCT is administered monthly. Validation measures include CLABSI rate, Team Functioning Survey (TFS) and Practice Environment Scale (PES) from the Nursing Work Index.</p> <p>Analysis: Temporal stability, responsiveness and validity of the TCT.</p> <p>Results</p> <p>We found evidence supporting the temporal stability, construct validity, and responsiveness of TCT measures of intervention activities, perceived group-level behaviors, and barriers to team progress.</p> <p>Conclusions</p> <p>The TCT demonstrates good measurement reliability, validity, and responsiveness. By having more validated measures on implementation context, researchers can more readily conduct rigorous studies to identify contextual variables linked to key intervention and patient outcomes and strengthen the evidence base on successful spread of efficacious team-based interventions. QI teams participating in an intervention should also find data from a validated tool useful for identifying opportunities to improve their own implementation.</p

Entrustment and Mapping of Observable Practice Activities for Resident Assessment

Entrustable Professional Activities (EPAs) and the Next Accreditation System reporting milestones reduce general competencies into smaller evaluable parts. However, some EPAs and reporting milestones may be too broad to use as direct assessment tools. We describe our internal medicine residency curriculum and assessment system, which uses entrustment and mapping of observable practice activities (OPAs) for resident assessment. We created discrete OPAs for each resident rotation and learning experience. In combination, these serve as curricular foundation and tools for assessment. OPA performance is measured via a 5-point entrustment scale, and mapped to milestones and EPAs. Entrustment ratings of OPAs provide an opportunity for immediate structured feedback of specific clinical skills, and mapping OPAs to milestones and EPAs can be used for longitudinal assessment, promotion decisions, and reporting. Direct assessment and demonstration of progressive entrustment of trainee skill over time are important goals for all training programs. Systems that use OPAs mapped to milestones and EPAs provide the opportunity for achieving both, but require validation

Complexity in Graduate Medical Education: A Collaborative Education Agenda for Internal Medicine and Geriatric Medicine

Internal medicine residents today face significant challenges in caring for an increasingly complex patient population within ever-changing education and health care environments. As a result, medical educators, health care system leaders, payers, and patients are demanding change and accountability in graduate medical education (GME). A 2012 Society of General Internal Medicine (SGIM) retreat identified medical education as an area for collaboration between internal medicine and geriatric medicine. The authors first determined a short-term research agenda for resident education by mapping selected internal medicine reporting milestones to geriatrics competencies, and listing available sample learner assessment tools. Next, the authors proposed a strategy for long-term collaboration in three priority areas in clinical medicine that are challenging for residents today: (1) team-based care, (2) transitions and readmissions, and (3) multi-morbidity. The short-term agenda focuses on learner assessment, while the long-term agenda allows for program evaluation and improvement. This model of collaboration in medical education combines the resources and expertise of internal medicine and geriatric medicine educators with the goal of increasing innovation and improving outcomes in GME targeting the needs of our residents and their patients