Assessment of Emergency Medicine Resident Performance in an Adult Simulation Using a Multisource Feedback Approach.

Introduction: The Accreditation Council for Graduate Medical Education (ACGME) specifically notes multisource feedback (MSF) as a recommended means of resident assessment in the emergency medicine (EM) Milestones. High-fidelity simulation is an environment wherein residents can receive MSF from various types of healthcare professionals. Previously, the Queen\u27s Simulation Assessment Tool (QSAT) has been validated for faculty to assess residents in five categories: assessment; diagnostic actions; therapeutic actions; interpersonal communication, and overall assessment. We sought to determine whether the QSAT could be used to provide MSF using a standardized simulation case. Methods: Prospectively after institutional review board approval, residents from a dual ACGME/osteopathic-approved postgraduate years (PGY) 1-4 EM residency were consented for participation. We developed a standardized resuscitation after overdose case with specific 1-5 Likert anchors used by the QSAT. A PGY 2-4 resident participated in the role of team leader, who completed a QSAT as self-assessment. The team consisted of a PGY-1 peer, an emergency medical services (EMS) provider, and a nurse. Two core faculty were present to administer the simulation case and assess. Demographics were gathered from all participants completing QSATs. We analyzed QSATs by each category and on cumulative score. Hypothesis testing was performed using intraclass correlation coefficients (ICC), with 95% confidence intervals. Interpretation of ICC results was based on previously published definitions. Results: We enrolled 34 team leader residents along with 34 nurses. A single PGY-1, a single EMS provider and two faculty were also enrolled. Faculty provided higher cumulative QSAT scores than the other sources of MSF. QSAT scores did not increase with team leader PGY level. ICC for inter-rater reliability for all sources of MSF was 0.754 (0.572-0.867). Removing the self-evaluation scores increased inter-rater reliability to 0.838 (0.733-0.910). There was lesser agreement between faculty and nurse evaluations than from the EMS or peer evaluation. Conclusion: In this single-site cohort using an internally developed simulation case, the QSAT provided MSF with excellent reliability. Self-assessment decreases the reliability of the MSF, and our data suggest self-assessment should not be a component of MSF. Use of the QSAT for MSF may be considered as a source of data for clinical competency committees

Were the blue of the skies like the blue of your eyes [first line of chorus]

Performance Medium: Piano and Voice (with lyrics

Compliance with centers for disease control guidelines for ED patients with sexually transmitted diseases.

Reported cases of notifiable sexually transmitted diseases (STDs) have increased for the first time since 2006, according to data published by the Centers for Disease Control and Prevention (CDC) in the 2014 STD Surveillance Report [1] . As the disease burden increases, the need for patients to receive care compliant with CDC recommendations becomes increasingly important and patients with STD\u27s are frequently seen in the Emergency Department (ED) [2] . A prior study indicates that compliance with CDC standards of care for sexually transmitted diseases (STDs), as measured by chart review of documentation in free form and unsupported order entry, is poor [3]