A review of human factors principles for the design and implementation of medication safety alerts in clinical information systems.

The objective of this review is to describe the implementation of human factors principles for the design of alerts in clinical information systems. First, we conduct a review of alarm systems to identify human factors principles that are employed in the design and implementation of alerts. Second, we review the medical informatics literature to provide examples of the implementation of human factors principles in current clinical information systems using alerts to provide medication decision support. Last, we suggest actionable recommendations for delivering effective clinical decision support using alerts. A review of studies from the medical informatics literature suggests that many basic human factors principles are not followed, possibly contributing to the lack of acceptance of alerts in clinical information systems. We evaluate the limitations of current alerting philosophies and provide recommendations for improving acceptance of alerts by incorporating human factors principles in their design

Impact of an Electronic Medical Record Implementation on Drug Allergy Overrides in a Large Southeastern HMO Setting

Renny Varghese Impact of an Electronic Medical Record Implementation on Drug Allergy Overrides in a Large Southeastern HMO Setting (Under the direction of Russell Toal, Associate Professor) Electronic medical records (EMRs) have become recognized as an important tool for improving patient safety and quality of care. Decision support tools such as alerting functions for patient medication allergies are a key part of reducing the frequency of serious medication problems. Kaiser Permanente Georgia (KPGA) implemented its EMR system in the primary care departments at Kaiser\u27s twelve facilities in the greater metro Atlanta area over a six month period beginning in June 2005 and ending December 2005. The aim of this study is to analyze the impact of the EMR implementation on the number of drug allergy overrides within this large HMO outpatient setting. Research was conducted by comparing the rate of drug allergy overrides during pre and post EMR implementation. The timeline will be six months pre and post implementation. Observing the impact of the incidence rate of drug allergy alerts after the implementation provided insight into the effectiveness of EMRs in reducing contraindicated drug allergies. Results show that the incidence rate of drug allergy overrides per 1,000 filled prescriptions rose by a statistically significant 5.9% (ñ \u3e 0.0002; 95% CI [-1.531, -0.767]) following the implementation. Although results were unexpected, several factors are discussed as to the reason for the increase. Further research is recommended to explore trends in provider behavior, KPGA specific facilities and departments, and in other KP regions and non-KP healthcare settings. INDEX WORDS: electronic medical records, drug allergy overrides, patient safety, medication errors, decision support tools, outpatient setting, primary care, computerized provider order entr

The vulnerabilities of computerized physician order entry systems: a qualitative study

Objective To test the vulnerabilities of a wide range of computerized physician order entry (CPOE) systems to different types of medication errors, and develop a more comprehensive qualitative understanding of how their design could be improved. Materials and Methods The authors reviewed a random sample of 63 040 medication error reports from the US Pharmacopeia (USP) MEDMARX reporting system where CPOE systems were considered a “contributing factor” to errors and flagged test scenarios that could be tested in current CPOE systems. Testers entered these orders in 13 commercial and homegrown CPOE systems across 16 different sites in the United States and Canada, using both usual practice and where-needed workarounds. Overarching themes relevant to interface design and usability/workflow issues were identified. Results CPOE systems often failed to detect and prevent important medication errors. Generation of electronic alert warnings varied widely between systems, and depended on a number of factors, including how the order information was entered. Alerts were often confusing, with unrelated warnings appearing on the same screen as those more relevant to the current erroneous entry. Dangerous drug-drug interaction warnings were displayed only after the order was placed rather than at the time of ordering. Testers illustrated various workarounds that allowed them to enter these erroneous orders. Discussion and Conclusion The authors found high variability in ordering approaches between different CPOE systems, with major deficiencies identified in some systems. It is important that developers reflect on these findings and build in safeguards to ensure safer prescribing for patients

Development of a context model to prioritize drug safety alerts in CPOE systems

Background: Computerized physician order entry systems (CPOE) can reduce the number of medication errors and adverse drug events (ADEs) in healthcare institutions. Unfortunately, they tend to produce a large number of partly irrelevant alerts, in turn leading to alert overload and causing alert fatigue. The objective of this work is to identify factors that can be used to prioritize and present alerts depending on the 'context' of a clinical situation. Methods: We used a combination of literature searches and expert interviews to identify and validate the possible context factors. The internal validation of the context factors was performed by calculating the inter-rater agreement of two researcher's classification of 33 relevant articles. Results: We developed a context model containing 20 factors. We grouped these context factors into three categories: characteristics of the patient or case (e. g. clinical status of the patient); characteristics of the organizational unit or user (e. g. professional experience of the user); and alert characteristics (e. g. severity of the effect). The internal validation resulted in nearly perfect agreement (Cohen's Kappa value of 0.97). Conclusion: To our knowledge, this is the first structured attempt to develop a comprehensive context model for prioritizing drug safety alerts in CPOE systems. The outcome of this work can be used to develop future tailored drug safety alerting in CPOE systems

Rising drug allergy alert overrides in electronic health records: an observational retrospective study of a decade of experience

Objective There have been growing concerns about the impact of drug allergy alerts on patient safety and provider alert fatigue. The authors aimed to explore the common drug allergy alerts over the last 10 years and the reasons why providers tend to override these alerts. Design: Retrospective observational cross-sectional study (2004–2013). Materials and Methods Drug allergy alert data (n = 611,192) were collected from two large academic hospitals in Boston, MA (USA). Results Overall, the authors found an increase in the rate of drug allergy alert overrides, from 83.3% in 2004 to 87.6% in 2013 (P < .001). Alarmingly, alerts for immune mediated and life threatening reactions with definite allergen and prescribed medication matches were overridden 72.8% and 74.1% of the time, respectively. However, providers were less likely to override these alerts compared to possible (cross-sensitivity) or probable (allergen group) matches (P < .001). The most common drug allergy alerts were triggered by allergies to narcotics (48%) and other analgesics (6%), antibiotics (10%), and statins (2%). Only slightly more than one-third of the reactions (34.2%) were potentially immune mediated. Finally, more than half of the overrides reasons pointed to irrelevant alerts (i.e., patient has tolerated the medication before, 50.9%) and providers were significantly more likely to override repeated alerts (89.7%) rather than first time alerts (77.4%, P < .001). Discussion and Conclusions These findings underline the urgent need for more efforts to provide more accurate and relevant drug allergy alerts to help reduce alert override rates and improve alert fatigue

Usability flaws of medication-related alerting functions: A systematic qualitative review

AbstractIntroductionMedication-related alerting functions may include usability flaws that limit their optimal use. A first step on the way to preventing usability flaws is to understand the characteristics of these usability flaws. This systematic qualitative review aims to analyze the type of usability flaws found in medication-related alerting functions.MethodPapers were searched via PubMed, Scopus and Ergonomics Abstracts databases, along with references lists. Paper selection, data extraction and data analysis was performed by two to three Human Factors experts. Meaningful semantic units representing instances of usability flaws were the main data extracted. They were analyzed through qualitative methods: categorization following general usability heuristics and through an inductive process for the flaws specific to medication-related alerting functions.Main resultsFrom the 6380 papers initially identified, 26 met all eligibility criteria. The analysis of the papers identified a total of 168 instances of usability flaws that could be classified into 13 categories of usability flaws representing either violations of general usability principles (i.e. they could be found in any system, e.g. guidance and workload issues) or infractions specific to medication-related alerting functions. The latter refer to issues of low signal-to-noise ratio, incomplete content of alerts, transparency, presentation mode and timing, missing alert features, tasks and control distribution.Main conclusionThe list of 168 instances of usability flaws of medication-related alerting functions provides a source of knowledge for checking the usability of medication-related alerting functions during their design and evaluation process and ultimately constructs evidence-based usability design principles for these functions

Effect of CPOE User Interface Design on User-Initiated Access to Educational and Patient Information during Clinical Care

Objective: Authors evaluated whether displaying context sensitive links to infrequently accessed educational materials and patient information via the user interface of an inpatient computerized care provider order entry (CPOE) system would affect access rates to the materials. Design: The CPOE of Vanderbilt University Hospital (VUH) included "baseline” clinical decision support advice for safety and quality. Authors augmented this with seven new primarily educational decision support features. A prospective, randomized, controlled trial compared clinicians' utilization rates for the new materials via two interfaces. Control subjects could access study-related decision support from a menu in the standard CPOE interface. Intervention subjects received active notification when study-related decision support was available through context sensitive, visibly highlighted, selectable hyperlinks. Measurements: Rates of opportunities to access and utilization of study-related decision support materials from April 1999 through March 2000 on seven VUH Internal Medicine wards. Results: During 4,466 intervention subject-days, there were 240,504 (53.9/subject-day) opportunities for study-related decision support, while during 3,397 control subject-days, there were 178,235 (52.5/subject-day) opportunities for such decision support, respectively (p = 0.11). Individual intervention subjects accessed the decision support features at least once on 3.8% of subject-days logged on (278 responses); controls accessed it at least once on 0.6% of subject-days (18 responses), with a response rate ratio adjusted for decision support frequency of 9.17 (95% confidence interval 4.6-18, p < 0.0005). On average, intervention subjects accessed study-related decision support materials once every 16 days individually and once every 1.26 days in aggregate. Conclusion: Highlighting availability of context-sensitive educational materials and patient information through visible hyperlinks significantly increased utilization rates for study-related decision support when compared to "standard” VUH CPOE methods, although absolute response rates were lo