Emergency Medicine Providers Systematically Underestimate Their Opioid Prescribing Practices

Background: Opioid misuse is a known public health problem, nationwide and in Massachusetts. The Massachusetts Hospital Association (MHA) developed recommendations to address opioid prescribing in the ED setting, and UMassMemorial Health Care recently implemented a system-wide opioid practice guideline mirroring the MHA policy. Little is known about methods to influence behavior change among ED providers related to opioid prescribing practices. Guideline implementation provided a unique opportunity for a natural experiment related to prescribing patterns, and we hypothesized that a simultaneous experimental intervention to provide clinicians with their individual prescribing data would alter their practices beyond any effect achieved solely by being subject to the new guidelines. Methods: As part of an ongoing, prospective, randomized trial of an intervention hypothesized to influence providers’ opioid prescribing, we developed a survey instrument consisting of graphical depictions of the distributions of three measures of opioid prescribing among all ED providers at four UMass-affiliated EDs (attending and resident physicians and advanced practice providers). Clinicians randomized to the intervention arm were asked to identify his/her perceived position on each distribution. We compared each provider’s self-perception to their actual decile. Results: Fifty-one providers were randomized to the intervention arm. Forty-eight completed the survey (94%). Providers underestimated their decile of opioid prescriptions per hundred total prescriptions by a median of one decile (p=0.0399 for difference from zero). Attendings underestimated their decile of percentage of patients dispositioned with an opioid prescription by a median of two deciles (p=0.0292), while residents did not exhibit a significant difference. Providers showed systematic disagreement with their raw number of prescriptions for extended-release opioid formulations (kappa -0.18), underestimating by a median of one. Conclusions: Based upon three measures of ED opioid prescribing, providers’ self-perceptions of their practices systematically underestimated their actual prescribing, which likely has implications related to efforts to influence clinician behavior change

Accuracy of emergency physicians\u27 self-estimates of CT scan utilization and its potential effect on an audit and feedback intervention: a randomized trial

BACKGROUND: Audit and feedback (AandF) has been used as a strategy to modify clinician behavior with moderate success. Although AandF is theorized to work by improving the accuracy of clinicians\u27 estimates of their own behavior, few interventions have included assessment of clinicians\u27 estimates at baseline to examine whether they account for intervention success or failure. We tested an AandF intervention to reduce computed tomography (CT) ordering by emergency physicians, while also examining the physicians\u27 baseline estimates of their own behavior compared to peers. METHODS: Our study was a prospective, multi-site, 20-month, randomized trial to examine the effect of an AandF intervention on CT ordering rates, overall and by test subtype. From the electronic health record, we obtained 12 months of baseline CT ordering per 100 patients treated for every physician from four emergency departments. Those who were randomized to receive AandF were shown a de-identified graph of the group\u27s baseline CT utilization, asked to estimate wherein the distribution of their own CT order practices fell, and then shown their actual performance. All participants also received a brief educational intervention. CT ordering rates were collected for all physicians for 6 months after the intervention. Pre-post ordering rates were compared using independent and repeated measures t tests. RESULTS: Fifty-one of 52 eligible physicians participated. The mean CT ordering rate increased significantly in both experimental conditions after the intervention (intervention pre = 35.7, post = 40.3, t = 4.13, p \u3c 0.001; control pre = 33.9, post = 38.9, t = 3.94, p = 0.001), with no significant between-group difference observed at follow-up (t = 0.43, p = 0.67). Within the intervention group, physicians had poor accuracy in estimating their own ordering behavior at baseline: most overestimated and all guessed that they were in the upper half of the distribution of their peers. CT ordering increased regardless of self-estimate accuracy. CONCLUSIONS: Our AandF intervention failed to reduce physician CT ordering: our feedback to the physicians showed most of them that they had overestimated their CT ordering behavior, and they were therefore unlikely to reduce it as a result. After audit, it may be prudent to assess baseline clinician awareness of behavior before moving toward a feedback intervention

Delayed Recognition of Acute Stroke by Emergency Department Staff Following Failure to Activate Stroke by Emergency Medical Services

Introduction: Early recognition and pre-notification by emergency medical services (EMS) improves the timeliness of emergency department (ED) stroke care; however, little is known regarding the effects on care should EMS providers fail to pre-notify. We sought to determine if potential stroke patients transported by EMS, but for whom EMS did not provide pre-notification, suffer delays in ED door-to-stroke-team activation (DTA) as compared to the other available cohort of patients for whom the ED is not pre-notified-those arriving by private vehicle. Methods: We queried our prospective stroke registry to identify consecutive stroke team activation patients over 12 months and retrospectively reviewed the electronic health record for each patient to validate registry data and abstract other clinical and operational data. We compared patients arriving by private vehicle to those arriving by EMS without pre-notification, and we employed a multivariable, penalized regression model to assess the probability of meeting the national DTA goal of \u3c /=15 minutes, controlling for a variety of clinical factors. Results: Our inclusion criteria were met by 200 patients. Overall performance of the regression model was excellent (area under the curve 0.929). Arrival via EMS without pre-notification, compared to arrival by private vehicle, was associated with an adjusted risk ratio of 0.55 (95% confidence interval, 0.27-0.96) for achieving DTA \u3c /= 15 minutes. Conclusion: Our single-center data demonstrate that potential stroke patients arriving via EMS without pre-notification are less likely to meet the national DTA goal than patients arriving via other means. These data suggest a negative, unintended consequence of otherwise highly successful EMS efforts to improve stroke care, the root of which may be ED staff over-reliance on EMS for stroke recognition

Clinical operations of academic versus non-academic emergency departments: a descriptive comparison of two large emergency department operations surveys

BACKGROUND: Academic and non-academic emergency departments (EDs) are regularly compared in clinical operations benchmarking despite suggestion that the two groups may differ in their clinical operations characteristics. and outcomes. We sought to describe and compare clinical operations characteristics of academic versus non-academic EDs. METHODS: We performed a descriptive, comparative analysis of academic and non-academic adult and general EDs with 40,000+ annual encounters, using the Academy of Academic Administrators of Emergency Medicine (AAAEM)/Association of Academic Chairs of Emergency Medicine (AACEM) and Emergency Department Benchmarking Alliance (EDBA) survey results. We defined academic EDs as primary teaching sites for emergency medicine (EM) residencies and non-academic EDs as sites with minimal resident involvement. We constructed the academic and non-academic cohorts from the AAAEM/AACEM and EDBA surveys, respectively, and analyzed metrics common to both surveys. RESULTS: Eighty and 454 EDs met inclusion criteria for academic and non-academic EDs, respectively. Academic EDs had more median annual patient encounters (73,001 vs 54,393), lower median proportion of pediatric patients (6.3% vs 14.5%), higher median proportion of EMS patients (27% vs 19%), and were more commonly designated as Level I or II Trauma Centers (94% vs 24%). Median patient arrival-to-provider times did not differ (26 vs 25 min). Median length-of-stay was longer (277 vs 190 min) for academic EDs, and left-before-treatment-complete was higher (5.7% vs 2.9%). MRI utilization was higher for academic EDs (2.2% patients with at least one MRI vs 1.0 MRIs performed per 100 patients). Patients-per-hour of provider coverage was lower for academic EDs with and without consideration for advanced practice providers and residents. CONCLUSIONS: Demographic and operational performance measures differ between academic and non-academic EDs, suggesting that the two groups may be inappropriate operational performance comparators. Causes for the differences remain unclear but the differences appear not to be attributed solely to the academic mission

Patient safety incident capture resulting from incident reports: a comparative observational analysis

BACKGROUND: Patient safety incident (PSI) discovery is an essential component of quality improvement. When submitted, incident reports may provide valuable opportunities for PSI discovery. However, little objective information is available to date to quantify or demonstrate this value. The objective of this investigation was to assess how often Emergency Department (ED) incident reports submitted by different sources led to the discovery of PSIs. METHODS: A standardized peer review process was implemented to evaluate all incident reports submitted to the ED. Findings of the peer review analysis were recorded prospectively in a quality improvement database. A retrospective analysis of the quality improvement database was performed to calculate the PSI capture rates for incident reports submitted by different source groups. RESULTS: 363 incident reports were analyzed over a period of 18 months; 211 were submitted by healthcare providers (HCPs) and 126 by non-HCPs. PSIs were identified in 108 resulting in an overall capture rate of 31%. HCP-generated reports resulted in a 44% capture rate compared to 10% for non-HCPs (p \u3c 0.001). There was no difference in PSI capture between sub-groups of HCPs and non-HCPs. CONCLUSION: HCP-generated ED incident reports were much more likely to capture PSIs than reports submitted by non-HCPs. However, HCP reports still led to PSI discovery less than half the time. Further research is warranted to develop effective strategies to improve the utility of incident reports from both HCPs and non-HCPs

Emergency department patient safety incident characterization: an observational analysis of the findings of a standardized peer review process

BACKGROUND: Emergency Department (ED) care has been reported to be prone to patient safety incidents (PSIs). Improving our understanding of PSIs is essential to prevent them. A standardized, peer review process was implemented to identify and analyze ED PSIs. The primary objective of this investigation was to characterize ED PSIs identified by the peer review process. A secondary objective was to characterize PSIs that led to patient harm. In addition, we sought to provide a detailed description of the peer review process for others to consider as they conduct their own quality improvement initiatives. METHODS: An observational study was conducted in a large, urban, tertiary-care ED. Over a two-year period, all ED incident reports were investigated via a standardized, peer review process. PSIs were identified and analyzed for contributing factors including systems failures and practitioner-based errors. The classification system for factors contributing to PSIs was developed based on systems previously reported in the emergency medicine literature as well as the investigators\u27 experience in quality improvement and peer review. All cases in which a PSI was discovered were further adjudicated to determine if patient harm resulted. RESULTS: In 24 months, 469 cases were investigated, identifying 152 PSIs. In total, 188 systems failures and 96 practitioner-based errors were found to have contributed to the PSIs. In twelve cases, patient harm was determined to have resulted from PSIs. Systems failures were identified in eleven of the twelve cases in which a PSI resulted in patient harm. CONCLUSION: Systems failures were almost twice as likely as practitioner-based errors to contribute to PSIs, and systems failures were present in the majority of cases resulting in patient harm. To effectively reduce PSIs, ED quality improvement initiatives should focus on systems failure reduction

Validation of a self-efficacy instrument and its relationship to performance of crisis resource management skills

Self-efficacy is thought to be important for resuscitation proficiency in that it influences the development of and access to the associated medical knowledge, procedural skills and crisis resource management (CRM) skills. Since performance assessment of CRM skills is challenging, self-efficacy is often used as a measure of competence in this area. While self-efficacy may influence performance, the true relationship between self-efficacy and performance in this setting has not been delineated. We developed an instrument to measure pediatric residents’ self-efficacy in CRM skills and assessed its content validity, internal structure, and relationship to other variables. After administering the instrument to 125 pediatric residents, critical care fellows and faculty, we performed an exploratory factor analysis within a confirmatory factor analysis as well as a known group comparison. The analyses specified four factors that we defined as: situation awareness, team management, environment management, and decision making. Pediatric residents reported lower self-efficacy than fellows and faculty in each factor. We also examined the correlation between self-efficacy and performance scores for a subset of 30 residents who led video recorded simulated resuscitations and had their performances rated by three observers. We found a significant, positive correlation between residents’ self-efficacy in situation awareness and environment management and their overall performance of CRM skills. Our findings suggest that in a specific context, self-efficacy as a form of self-assessment may be informative with regards to performance

A Queue-Based Monte Carlo Analysis to Support Decision Making for Implementation of an Emergency Department Fast Track

Emergency departments (EDs) are seeking ways to utilize existing resources more efficiently as they face rising numbers of patient visits. This study explored the impact on patient wait times and nursing resource demand from the addition of a fast track, or separate unit for low-acuity patients, in the ED using a queue-based Monte Carlo simulation in MATLAB. The model integrated principles of queueing theory and expanded the discrete event simulation to account for time-based arrival rates. Additionally, the ED occupancy and nursing resource demand were modeled and analyzed using the Emergency Severity Index (ESI) levels of patients, rather than the number of beds in the department. Simulation results indicated that the addition of a separate fast track with an additional nurse reduced overall median wait times by 35.8 ± 2.2 percent and reduced average nursing resource demand in the main ED during hours of operation. This novel modeling approach may be easily disseminated and informs hospital decision-makers of the impact of implementing a fast track or similar system on both patient wait times and acuity-based nursing resource demand

Improving Accessibility in the Emergency Department for Patients with Disabilities: A Qualitative Study

Introduction: The emergency department (ED) is a critical service area for patients living with disabilities in the United States. Despite this, there is limited research on best practices from the patient experience regarding accommodation and accessibility for those with disabilities. In this study we investigate the ED experience from the perspective of patients living with physical and cognitive disability, as well as visual impairment and blindness, to better understand the barriers to accessibility in the ED for these populations.Methods: Twelve individuals with either physical or cognitive disabilities, visual impairments or blindness were interviewed regarding their ED experiences, particularly related to accessibility. Interviews were transcribed and coded for qualitative analysis with generation of significant themes relating to accessibility in the ED.Results: Major themes from coded analysis were as follows: 1) inadequate communication between staff and  patients with visual impairments and physical disabilities; 2) the need for electronic delivery for after-visit summaries for individuals with cognitive and visual disabilities; 3) the importance of mindful listening and patience by healthcare staff; 4) the role of increased hospital support including greeters and volunteers; and 5) comprehensive training with both prehospital and hospital staff around assistive devices and services.Conclusion: This study serves as an important first step toward improving the ED environment to ensure accessibility and inclusivity for patients presenting with various types of disabilities. Implementing specific training, policies, and infrastructure changes may improve the experiences and healthcare of this population

Factors Associated with Overutilization of Computed Tomography of the Cervical Spine

Introduction: Despite the wide availability of clinical decision rules for imaging of the cervical spine after a traumatic injury (eg, NEXUS C-spine rule and Canadian C-spine rule), there is significant overutilization of computed tomography (CT) imaging in patients who are deemed to be at low risk for a clinically significant cervical spine injury by these clinical decision rules. The purpose of this study was to identify the major factors associated with the overuse of CT cervical spine imaging using a logistic regression model.Methods: This was a retrospective review of all adult patients who underwent CT cervical spine imaging for evaluation of a traumatic injury at a tertiary academic emergency department (ED) and three affiliate community EDs in January and February 2019. We performed multivariable logistic regression to identify factors associated with obtaining CT cervical spine imaging despite low-risk classification by the NEXUS C-spine Rule.Results: A total of 1,051 patients underwent CT cervical spine imaging for traumatic indications during the study period, and 889 patients were included in the analysis. Of these patients, 376 (42.3%) were negative by the NEXUS C-spine rule. Variables that were associated with increased likelihood of unnecessary imaging included age over 65, Emergency Severity Index (ESI) score 2 and 3, arrival as a walk-in, and anticoagulation status. Patients who presented to the tertiary academic ED had a significantly lower likelihood of unnecessary imaging. Twenty-one patients (2.4%) were found to have cervical spine fractures on imaging, two of whom were negative by the NEXUS C-spine rule, but neither had a clinically significant fracture.Conclusion: Cervical spine imaging is vastly overused in patients presenting to the ED with traumatic injuries, as adjudicated using the NEXUS C-spine rule as a reference standard. Older age, ESI level, arrival as a walk-in, and taking anticoagulation drugs were associated with overutilization of CT imaging. Conversely, presenting to the tertiary academic ED was associated with a lower likelihood of undergoing unnecessary imaging. This model can guide future interventions to optimize ED CT utilization and minimize unnecessary testing