Providers’ Perception of Alert Fatigue After Implementation of User-Filtered Warnings

Alert fatigue is a complex problem that many health institutions face when using an electronic health record (EHR). The addition of user-filtered warnings (UFW) is a physicians’ proposed intervention at Inova Health System (IHS), a large 5-hospital health system in Northern Virginia, that allows prescribers to filter out specific drug-drug interactions and pregnancy and lactation medication alerts for a 30-day period. This study aims to determine the impact of UFW on physicians’ perception of alert fatigue and to calculate the reduction of medication alerts. It was hypothesized that the reduction in alerts will significantly impact physicians’ perception of alert fatigue in a positive manner. Physician perception of alert fatigue was assessed using online surveys before and after the implementation of UFW. Data from Medications Warnings Statistics reports were used to assess the reduction of alerts fired post-implementation of UFW. For the primary outcome, there was no significant difference in the overall perception of alert fatigue before and after the implementation of UFW. For the secondary outcome, the number of medication alerts was decreased by 16.7% post UFW implementation. Overall, the data does not support UFW to reduce alert fatigue

Retrospective descriptive assessment of clinical decision support medication-related alerts in two Saudi Arabian hospitals

OBJECTIVES: To determine the frequency of clinical decision support system (CDSS) medication-related alerts generated, accepted, or overridden, to assess appropriateness of alert display and overrides, and to characterise the documentation of clinician justification for these overrides in an academic medical centre in Saudi Arabia. MATERIALS AND METHODS: System-generated CDSS reports for the period June 2015 to December 2017 were retrospectively reviewed and analysed. Alerts were classified into different types, and rates of alert overrides calculated as percentages of all generated alerts. A subset of 307 overridden alerts was assessed for appropriateness of display and override by two clinical pharmacists. Physician documentation of reasons for overriding alerts were categorised. RESULTS: A total of 4,446,730 medication-related alerts were generated from both inpatient and outpatient settings, and 4,231,743 (95.2%) were overridden. The most common alert type was 'duplicate drug', accounting for 3,549,736 (79.8%) of alerts. Of 307 alerts assessed for appropriateness, 246 (80%) were judged to be appropriately displayed and 244 (79%) were overridden appropriately. New drug allergy and drug allergy alerts had the highest percentage of being judged as inappropriately overridden. For 1,594,313 alerts (37.7%), 'no overridden reason selected' was chosen from the drop-down menu. CONCLUSIONS: The alert generation and override rate were higher than reported previously in the literature. The small sample size of 307 alerts assessed for appropriateness of alert display and override is a potential limitation. Revision of the CDSS rules for alerts (focusing on specificity and relevance for the local context) is now recommended. Future research should prospectively assess providers' perspectives, and determine patient harm associated with overridden alerts

Understanding physicians’ behavior toward alerts about nephrotoxic medications in outpatients: a cross-sectional analysis

Background: Although most outpatients are relatively healthy, many have chronic renal insufficiency, and high override rates for suggestions on renal dosing have been observed. To better understand the override of renal dosing alerts in an outpatient setting, we conducted a study to evaluate which patients were more frequently prescribed contraindicated medications, to assess providers’ responses to suggestions, and to examine the drugs involved and the reasons for overrides. Methods: We obtained data on renal alert overrides and the coded reasons for overrides cited by providers at the time of prescription from outpatient clinics and ambulatory hospital-based practices at a large academic health care center over a period of 3 years, from January 2009 to December 2011. For detailed chart review, a group of 6 trained clinicians developed the appropriateness criteria with excellent inter-rater reliability (κ = 0.93). We stratified providers by override frequency and then drew samples from the high- and low-frequency groups. We measured the rate of total overrides, rate of appropriate overrides, medications overridden, and the reason(s) for override. Results: A total of 4120 renal alerts were triggered by 584 prescribers in the study period, among which 78.2% (3,221) were overridden. Almost half of the alerts were triggered by 40 providers and one-third was triggered by high-frequency overriders. The appropriateness rates were fairly similar, at 28.4% and 31.6% for high- and low-frequency overriders, respectively. Metformin, glyburide, hydrochlorothiazide, and nitrofurantoin were the most common drugs overridden. Physicians’ appropriateness rates were higher than the rates for nurse practitioners (32.9% vs. 22.1%). Physicians with low frequency override rates had higher levels of appropriateness for metformin than the high frequency overriders (P = 0.005). Conclusion: A small number of providers accounted for a large fraction of overrides, as was the case with a small number of drugs. These data suggest that a focused intervention targeting primarily these providers and medications has the potential to improve medication safety

Impact of an Electronic Medical Record Implementation on Drug Allergy Overrides in a Large Southeastern HMO Setting

Renny Varghese Impact of an Electronic Medical Record Implementation on Drug Allergy Overrides in a Large Southeastern HMO Setting (Under the direction of Russell Toal, Associate Professor) Electronic medical records (EMRs) have become recognized as an important tool for improving patient safety and quality of care. Decision support tools such as alerting functions for patient medication allergies are a key part of reducing the frequency of serious medication problems. Kaiser Permanente Georgia (KPGA) implemented its EMR system in the primary care departments at Kaiser\u27s twelve facilities in the greater metro Atlanta area over a six month period beginning in June 2005 and ending December 2005. The aim of this study is to analyze the impact of the EMR implementation on the number of drug allergy overrides within this large HMO outpatient setting. Research was conducted by comparing the rate of drug allergy overrides during pre and post EMR implementation. The timeline will be six months pre and post implementation. Observing the impact of the incidence rate of drug allergy alerts after the implementation provided insight into the effectiveness of EMRs in reducing contraindicated drug allergies. Results show that the incidence rate of drug allergy overrides per 1,000 filled prescriptions rose by a statistically significant 5.9% (ñ \u3e 0.0002; 95% CI [-1.531, -0.767]) following the implementation. Although results were unexpected, several factors are discussed as to the reason for the increase. Further research is recommended to explore trends in provider behavior, KPGA specific facilities and departments, and in other KP regions and non-KP healthcare settings. INDEX WORDS: electronic medical records, drug allergy overrides, patient safety, medication errors, decision support tools, outpatient setting, primary care, computerized provider order entr

An investigation of healthcare professionals’ experiences of training and using electronic prescribing systems: four literature reviews and two qualitative studies undertaken in the UK hospital context

Electronic prescribing (ePrescribing) is the process of ordering medicines electronically for a patient and has been associated with reduced medication errors and improved patient safety. However, these systems have also been associated with unintended adverse consequences. There is a lack of published research about users’ experiences of these systems in UK hospitals. The aim of this research was therefore to firstly describe the literature pertaining to the recent developments and persisting issues with ePrescribing and clinical decision support systems (CDS) (chapter 2). Two further systematic literature reviews (chapters 3 and 4) were then conducted to understand the unintended consequences of ePrescribing and clinical decision support (CDS) systems across both adult and paediatric patients. These revealed a taxonomy of factors, which have contributed to errors during use of these systems e.g., the screen layout, default settings and inappropriate drug-dosage support. The researcher then conducted a qualitative study (chapters 7-10) to explore users’ experiences of using and being trained to use ePrescribing systems. This study involved conducting semi-structured interviews and observations, which revealed key challenges facing users, including issues with using the ‘Medication List’ and how information was presented. Users experienced benefits and challenges when customising the system, including the screen display; however, the process was sometimes overly complex. Users also described the benefits and challenges associated with different forms of interruptive and passive CDS. Order sets, for instance, encouraged more efficient prescribing, yet users often found them difficult to find within the system. A lack of training resulted in users failing to use all features of the ePrescribing system and left some healthcare staff feeling underprepared for using the system in their role. A further literature review (chapter 5) was then performed to complement emerging themes relating to how users were trained to use ePrescribing systems, which were generated as part of a qualitative study. This review revealed the range of approaches used to train users and the need for further research in this area. The literature review and qualitative study-based findings led to a follow-on study (chapter 10), whereby the researcher conducted semi-structured interviews to examine how users were trained to use ePrescribing systems across four NHS Hospital Trusts. A range of approaches were used to train users; tailored training, using clinically specific scenarios or matching the user’s profession to that of the trainer were preferred over lectures and e-learning may offer an efficient way of training large numbers of staff. However, further research is needed to investigate this and whether alternative approaches such as the use of students as trainers could be useful. This programme of work revealed the importance of human factors and user involvement in the design and ongoing development of ePrescribing systems. Training also played a role in users’ experiences of using the system and hospitals should carefully consider the training approaches used. This thesis provides recommendations gathered from the literature and primary data collection that can help inform organisations, system developers and further research in this area

Actionable Patient Safety Solution (APSS) #3D: Pediatric Adverse Drug Events

This report presents a plan of action for introducing a program to reduce the incidence of pediatric adverse drug events (pADEs) and harm ... [that] combine[s] leadership strategies, software (healthcare IT), hardware (drug compounding systems, drug delivery technology, and physiological monitoring systems), and most importantly people (changes in clinical practice, protocols and education) to protect pediatric patients

On the alert: future priorities for alerts in clinical decision support for computerized physician order entry identified from a European workshop

Background: Clinical decision support (CDS) for electronic prescribing systems (computerized physician order entry) should help prescribers in the safe and rational use of medicines. However, the best ways to alert users to unsafe or irrational prescribing are uncertain. Specifically, CDS systems may generate too many alerts, producing unwelcome distractions for prescribers, or too few alerts running the risk of overlooking possible harms. Obtaining the right balance of alerting to adequately improve patient safety should be a priority. Methods: A workshop funded through the European Regional Development Fund was convened by the University Hospitals Birmingham NHS Foundation Trust to assess current knowledge on alerts in CDS and to reach a consensus on a future research agenda on this topic. Leading European researchers in CDS and alerts in electronic prescribing systems were invited to the workshop. Results: We identified important knowledge gaps and suggest research priorities including (1) the need to determine the optimal sensitivity and specificity of alerts; (2) whether adaptation to the environment or characteristics of the user may improve alerts; and (3) whether modifying the timing and number of alerts will lead to improvements. We have also discussed the challenges and benefits of using naturalistic or experimental studies in the evaluation of alerts and suggested appropriate outcome measures. Conclusions: We have identified critical problems in CDS, which should help to guide priorities in research to evaluate alerts. It is hoped that this will spark the next generation of novel research from which practical steps can be taken to implement changes to CDS systems that will ultimately reduce alert fatigue and improve the design of future systems