12 research outputs found
Targeting Simulation-Based Assessment for the Pediatric Milestones: A Survey of Simulation Experts and Program Directors.
OBJECTIVE: To determine which of the 21 general pediatrics milestone subcompetencies are most difficult to assess using traditional methodologies and which are best suited to simulation-based assessment. METHODS: We surveyed 2 samples: pediatric simulation experts and pediatric program directors. Respondents were asked about current use of simulation for assessment and to select 5 of the 21 pediatric subcompetencies most difficult to assess using traditional methods and the 5 best suited to simulation-based assessment. Spearman rank correlation was used to determine a correlation between how the 2 samples ranked the subcompetencies. RESULTS: Forty-eight percent (29 of 60) simulation experts and 20% (115 of 571) program directors completed the survey. Few respondents reported using simulation for summative assessment. There are clear differences across the pediatric subcompetencies in perceived difficulty of assessment and suitability to simulation-based assessment. The 3 most difficult to assess subcompetencies were “recognize ambiguity,” “demonstrate emotional insight,” and “identify one’s own strengths and deficiencies.” The subcompetencies most suitable to assessment using simulation were “interprofessional teamwork,” “clinical decision making,” and “effective communication.” Program directors and simulation experts had high agreement for both questions: difficult to assess (rho = 0.76, P \u3c .001) and suitable to simulation-based assessment (rho = 0.94, P \u3c .001). CONCLUSIONS: Several general pediatrics milestone subcompetencies were identified by pediatric simulation experts and pediatric program directors as difficult to assess using current methodologies and as amenable to simulation-based assessment. The pediatric simulation community should target development of simulation-based assessment tools to these areas
Recommended from our members
Key Factors in Clinical Competency Committee Members' Decisions Regarding Residents' Readiness to Serve as Supervisors: A National Study
Entrustment has become a popular assessment framework in recent years. Most research in this area has focused on how frontline assessors determine when a learner can be entrusted. However, less work has focused on how these entrustment decisions are made. The authors sought to understand the key factors that pediatric residency program clinical competency committee (CCC) members consider when recommending residents to a supervisory role. CCC members at 14 pediatric residency programs recommended residents to one of five progressive supervisory roles (from not serving as a supervisory resident to serving as a supervisory resident in all settings). They then responded to a free-text prompt, describing the key factors that led them to that decision. The authors analyzed these responses, by role recommendation, using a thematic analysis. Of the 155 CCC members at the participating programs, 84 completed 769 supervisory role recommendations during the 2015-2016 academic year. Four themes emerged from the thematic analysis: (1) Determining supervisory ability follows from demonstrated trustworthiness; (2) demonstrated performance matters, but so does experience; (3) ability to lead a team is considered; and (4) contextual considerations external to the resident are at play. CCC members considered resident and environmental factors in their summative entrustment decision making. The interplay between these factors should be considered as CCC processes are optimized and studied further.12 month embargo; published online: 25 September 2018This item from the UA Faculty Publications collection is made available by the University of Arizona with support from the University of Arizona Libraries. If you have questions, please contact us at [email protected]
Recommended from our members
I-PASS Mentored Implementation Handoff Curriculum: Champion Training Materials
IntroductionThe I-PASS Handoff Program is a comprehensive handoff curriculum that has been shown to decrease rates of medical errors and adverse events during patient handoffs. I-PASS champions are a critical part of the implementation and sustainment of this curriculum, and therefore, a rigorous program to support their training is necessary.MethodsThe I-PASS Handoff champion training materials were created for the original I-PASS Study and adapted for the Society of Hospital Medicine (SHM) I-PASS Mentored Implementation Program. The adapted materials embrace a flipped classroom approach and adult learning theory. The training includes an overview of I-PASS handoff techniques, an opportunity to practice evaluating handoffs with the I-PASS observation tools using a handoff video vignette, and other key implementation principles.ResultsAs part of the SHM I-PASS Mentored Implementation Program, 366 champions were trained at 32 sites across North America and participated in a total of 3,491 handoff observations. A total of 346 champions completed the I-PASS Champion Workshop evaluation form at the end of their training (response rate: 94.5%). After receiving the training, over 90% agreed/strongly agreed that it provided them with knowledge or skills critical to their patient care activities and that they were able to distinguish the difference between high- and poor-quality handoffs, competently use the I-PASS handoff assessment tools, and articulate the importance of handoff observations.ConclusionThe I-PASS champion training materials were rated highly by those trained and are an integral part of a successful I-PASS Handoff Program implementation
Recommended from our members
Family, nurse, and physician beliefs on family‐centered rounds: A 21‐site study
BackgroundVariation exists in family-centered rounds (FCR).ObjectiveWe sought to understand patient/family and clinician FCR beliefs/attitudes and practices to support implementation efforts.Designs, settings and participantsPatients/families and clinicians at 21 geographically diverse US community/academic pediatric teaching hospitals participated in a prospective cohort dissemination and implementation study.InterventionWe inquired about rounding beliefs/attitudes, practices, and demographics using a 26-question survey coproduced with family/nurse/attending-physician collaborators, informed by prior research and the Consolidated Framework for Implementation Research.Main outcome and measuresOut of 2578 individuals, 1647 (64%) responded to the survey; of these, 1313 respondents participated in FCR and were included in analyses (616 patients/families, 243 nurses, 285 resident physicians, and 169 attending physicians). Beliefs/attitudes regarding the importance of FCR elements varied by role, with resident physicians rating the importance of several FCR elements lower than others. For example, on adjusted multivariable analysis, attending physicians (odds ratio [OR] 3.0, 95% confidence interval [95% CI] 1.2-7.8) and nurses (OR 3.1, 95% CI 1.3-7.4) were much more likely than resident physicians to report family participation on rounds as very/extremely important. Clinician support for key FCR elements was higher than self-reported practice (e.g., 88% believed family participation was important on rounds; 68% reported it often/always occurred). In practice, key elements of FCR were reported to often/always occur only 23%-70% of the time.ResultSupport for nurse and family participation in FCR is high among clinicians but varies by role. Physicians, particularly resident physicians, endorse several FCR elements as less important than nurses and patients/families. The gap between attitudes and practice and between clinician types suggests that attitudinal, structural, and cultural barriers impede FCR
I-PASS Mentored Implementation Handoff Curriculum: Frontline Provider Training Materials
IntroductionThe I-PASS Handoff Program is a comprehensive handoff curriculum that has been shown to decrease rates of medical errors and adverse events during patient handoffs. Frontline providers are the key individuals participating in handoffs of patient care. It is important they receive robust handoff training.MethodsThe I-PASS Mentored Implementation Handoff Curriculum frontline provider training materials were created as part of the original I-PASS Study and adapted for the Society of Hospital Medicine (SHM) I-PASS Mentored Implementation Program. The adapted materials embrace a flipped classroom approach with an emphasis on adult learning theory principles. The training includes an overview of I-PASS handoff techniques, TeamSTEPPS team communication strategies, verbal handoff simulation scenarios, and a printed handoff document exercise.ResultsAs part of the SHM I-PASS Mentored Implementation Program, 2,735 frontline providers were trained at 32 study sites (16 adult and 16 pediatric) across North America. At the end of their training, 1,762 frontline providers completed the workshop evaluation form (64% response rate). After receiving the training, over 90% agreed/strongly agreed that they were able to distinguish a good- from a poor-quality handoff, articulate the elements of the I-PASS mnemonic, construct a high-quality patient summary, advocate for an appropriate environment for handoffs, and participate in handoff simulations. Universally, the training provided them with knowledge and skills relevant to their patient care activities.DiscussionThe I-PASS frontline training materials were rated highly by those trained and are an integral part of a successful I-PASS Handoff Program implementation
I-PASS Mentored Implementation Handoff Curriculum: Implementation Guide and Resources
IntroductionCommunication failures during shift-to-shift handoffs of patient care have been identified as a leading cause of adverse events in health care institutions. The I-PASS Handoff Program is a comprehensive handoff program that has been shown to decrease rates of medical errors and adverse events. As part of the spread and adaptation of this program, a comprehensive implementation guide was created to assist individuals in the implementation process.MethodsThe I-PASS Mentored Implementation Guide grew out of materials created for the original I-PASS Study, Society of Hospital Medicine (SHM) mentored implementation programs, and the experience of members of the I-PASS Study Group. The guide provides a comprehensive framework of all elements required to implement the large-scale I-PASS Handoff Program and contains detailed information on generating institutional support, training activities, a campaign, measuring impact, and sustaining the program.ResultsThirty-two sites across North America utilized the guide as part of the SHM program. The guide served as a main reference for 477 hours of mentoring phone calls between site leads and their mentors. Postprogram surveys from wave 2 sites revealed that 85% (N = 34) of respondents felt the quality of the guide was very good/excellent. Site leads noted that they referenced the guide most often during the early part of the program and that they referenced the sections on the curriculum and handoff observations most often.DiscussionThe I-PASS Mentored Implementation Guide is an essential resource for those looking to implement the large-scale I-PASS Handoff Program at their institution
Recommended from our members
Implementation of the I-PASS handoff program in diverse clinical environments: A multicenter prospective effectiveness implementation study.
BACKGROUND: Handoff miscommunications are a leading source of medical errors. Harmful medical errors decreased in pediatric academic hospitals following implementation of the I-PASS handoff improvement program. However, implementation across specialties has not been assessed. OBJECTIVE: To determine if I-PASS implementation across diverse settings would be associated with improvements in patient safety and communication. DESIGN: Prospective Type 2 Hybrid effectiveness implementation study. SETTINGS AND PARTICIPANTS: Residents from diverse specialties across 32 hospitals (12 community, 20 academic). INTERVENTION: External teams provided longitudinal coaching over 18 months to facilitate implementation of an enhanced I-PASS program and monthly metric reviews. MAIN OUTCOME AND MEASURES: Systematic surveillance surveys assessed rates of resident-reported adverse events. Validated direct observation tools measured verbal and written handoff quality. RESULTS: 2735 resident physicians and 760 faculty champions from multiple specialties (16 internal medicine, 13 pediatric, 3 other) participated. 1942 error surveillance reports were collected. Major and minor handoff-related reported adverse events decreased 47% following implementation, from 1.7 to 0.9 major events/person-year (p < .05) and 17.5 to 9.3 minor events/person-year (p < .001). Implementation was associated with increased inclusion of all five key handoff data elements in verbal (20% vs. 66%, p < .001, n = 4812) and written (10% vs. 74%, p < .001, n = 1787) handoffs, as well as increased frequency of handoffs with high quality verbal (39% vs. 81% p < .001) and written (29% vs. 78%, p < .001) patient summaries, verbal (29% vs. 78%, p < .001) and written (24% vs. 73%, p < .001) contingency plans, and verbal receiver syntheses (31% vs. 83%, p < .001). Improvement was similar across provider types (adult vs. pediatric) and settings (community vs. academic)