Recommendations for selecting drug-drug interactions for clinical decision support

To recommend principles for including drug-drug interactions (DDIs) in clinical decision support

Rising drug allergy alert overrides in electronic health records: an observational retrospective study of a decade of experience

Objective There have been growing concerns about the impact of drug allergy alerts on patient safety and provider alert fatigue. The authors aimed to explore the common drug allergy alerts over the last 10 years and the reasons why providers tend to override these alerts. Design: Retrospective observational cross-sectional study (2004–2013). Materials and Methods Drug allergy alert data (n = 611,192) were collected from two large academic hospitals in Boston, MA (USA). Results Overall, the authors found an increase in the rate of drug allergy alert overrides, from 83.3% in 2004 to 87.6% in 2013 (P < .001). Alarmingly, alerts for immune mediated and life threatening reactions with definite allergen and prescribed medication matches were overridden 72.8% and 74.1% of the time, respectively. However, providers were less likely to override these alerts compared to possible (cross-sensitivity) or probable (allergen group) matches (P < .001). The most common drug allergy alerts were triggered by allergies to narcotics (48%) and other analgesics (6%), antibiotics (10%), and statins (2%). Only slightly more than one-third of the reactions (34.2%) were potentially immune mediated. Finally, more than half of the overrides reasons pointed to irrelevant alerts (i.e., patient has tolerated the medication before, 50.9%) and providers were significantly more likely to override repeated alerts (89.7%) rather than first time alerts (77.4%, P < .001). Discussion and Conclusions These findings underline the urgent need for more efforts to provide more accurate and relevant drug allergy alerts to help reduce alert override rates and improve alert fatigue

The vulnerabilities of computerized physician order entry systems: a qualitative study

Objective To test the vulnerabilities of a wide range of computerized physician order entry (CPOE) systems to different types of medication errors, and develop a more comprehensive qualitative understanding of how their design could be improved. Materials and Methods The authors reviewed a random sample of 63 040 medication error reports from the US Pharmacopeia (USP) MEDMARX reporting system where CPOE systems were considered a “contributing factor” to errors and flagged test scenarios that could be tested in current CPOE systems. Testers entered these orders in 13 commercial and homegrown CPOE systems across 16 different sites in the United States and Canada, using both usual practice and where-needed workarounds. Overarching themes relevant to interface design and usability/workflow issues were identified. Results CPOE systems often failed to detect and prevent important medication errors. Generation of electronic alert warnings varied widely between systems, and depended on a number of factors, including how the order information was entered. Alerts were often confusing, with unrelated warnings appearing on the same screen as those more relevant to the current erroneous entry. Dangerous drug-drug interaction warnings were displayed only after the order was placed rather than at the time of ordering. Testers illustrated various workarounds that allowed them to enter these erroneous orders. Discussion and Conclusion The authors found high variability in ordering approaches between different CPOE systems, with major deficiencies identified in some systems. It is important that developers reflect on these findings and build in safeguards to ensure safer prescribing for patients

On the alert: future priorities for alerts in clinical decision support for computerized physician order entry identified from a European workshop

Background: Clinical decision support (CDS) for electronic prescribing systems (computerized physician order entry) should help prescribers in the safe and rational use of medicines. However, the best ways to alert users to unsafe or irrational prescribing are uncertain. Specifically, CDS systems may generate too many alerts, producing unwelcome distractions for prescribers, or too few alerts running the risk of overlooking possible harms. Obtaining the right balance of alerting to adequately improve patient safety should be a priority. Methods: A workshop funded through the European Regional Development Fund was convened by the University Hospitals Birmingham NHS Foundation Trust to assess current knowledge on alerts in CDS and to reach a consensus on a future research agenda on this topic. Leading European researchers in CDS and alerts in electronic prescribing systems were invited to the workshop. Results: We identified important knowledge gaps and suggest research priorities including (1) the need to determine the optimal sensitivity and specificity of alerts; (2) whether adaptation to the environment or characteristics of the user may improve alerts; and (3) whether modifying the timing and number of alerts will lead to improvements. We have also discussed the challenges and benefits of using naturalistic or experimental studies in the evaluation of alerts and suggested appropriate outcome measures. Conclusions: We have identified critical problems in CDS, which should help to guide priorities in research to evaluate alerts. It is hoped that this will spark the next generation of novel research from which practical steps can be taken to implement changes to CDS systems that will ultimately reduce alert fatigue and improve the design of future systems

Does Computerized Physician Order Entry Reduce Medical Errors?

Introduction: Computerized Physician Order Entry (CPOE) is a system that allows physicians to electronically order patient services. The services that can be ordered, but are not limited to include: prescriptions, labs, x-rays, and referrals. Adopting CPOE will eliminate the use of paper orders with illegible hand writing. The purpose of this research project was to examine the cause of medical errors and to determine if adopting a CPOE system would be an effective solution to this problem. Results: The results of this study show that CPOE can reduce medical errors and adverse drug events significantly. CPOE coupled with other systems has shown a positive outcome preventing medical errors. Some major barriers of adoption and implementation of a CPOE system is the cost associated with it and older physicians being stuck in old ways of practicing medicine. Discussion/Conclusion: Adoption and implementation of CPOE has been growing in recent years with the HITECH Act of 2009. While preventable medical errors and ADE’s continue to increase; this study will show that adopting a CPOE system can reduce medical errors and ADE’s

Development and preliminary evidence for the validity of an instrument assessing implementation of human-factors principles in medication-related decision-support systems—I-MeDeSA

Background Medication-related decision support can reduce the frequency of preventable adverse drug events. However, the design of current medication alerts often results in alert fatigue and high over-ride rates, thus reducing any potential benefits. Methods The authors previously reviewed human-factors principles for relevance to medication-related decision support alerts. In this study, instrument items were developed for assessing the appropriate implementation of these human-factors principles in drug-drug interaction (DDI) alerts. User feedback regarding nine electronic medical records was considered during the development process. Content validity, construct validity through correlation analysis, and inter-rater reliability were assessed. Results The final version of the instrument included 26 items associated with nine human-factors principles. Content validation on three systems resulted in the addition of one principle (Corrective Actions) to the instrument and the elimination of eight items. Additionally, the wording of eight items was altered. Correlation analysis suggests a direct relationship between system age and performance of DDI alerts (p=0.0016). Inter-rater reliability indicated substantial agreement between raters (κ=0.764). Conclusion The authors developed and gathered preliminary evidence for the validity of an instrument that measures the appropriate use of human-factors principles in the design and display of DDI alerts. Designers of DDI alerts may use the instrument to improve usability and increase user acceptance of medication alerts, and organizations selecting an electronic medical record may find the instrument helpful in meeting their clinicians' usability need

An investigation of healthcare professionals’ experiences of training and using electronic prescribing systems: four literature reviews and two qualitative studies undertaken in the UK hospital context

Electronic prescribing (ePrescribing) is the process of ordering medicines electronically for a patient and has been associated with reduced medication errors and improved patient safety. However, these systems have also been associated with unintended adverse consequences. There is a lack of published research about users’ experiences of these systems in UK hospitals. The aim of this research was therefore to firstly describe the literature pertaining to the recent developments and persisting issues with ePrescribing and clinical decision support systems (CDS) (chapter 2). Two further systematic literature reviews (chapters 3 and 4) were then conducted to understand the unintended consequences of ePrescribing and clinical decision support (CDS) systems across both adult and paediatric patients. These revealed a taxonomy of factors, which have contributed to errors during use of these systems e.g., the screen layout, default settings and inappropriate drug-dosage support. The researcher then conducted a qualitative study (chapters 7-10) to explore users’ experiences of using and being trained to use ePrescribing systems. This study involved conducting semi-structured interviews and observations, which revealed key challenges facing users, including issues with using the ‘Medication List’ and how information was presented. Users experienced benefits and challenges when customising the system, including the screen display; however, the process was sometimes overly complex. Users also described the benefits and challenges associated with different forms of interruptive and passive CDS. Order sets, for instance, encouraged more efficient prescribing, yet users often found them difficult to find within the system. A lack of training resulted in users failing to use all features of the ePrescribing system and left some healthcare staff feeling underprepared for using the system in their role. A further literature review (chapter 5) was then performed to complement emerging themes relating to how users were trained to use ePrescribing systems, which were generated as part of a qualitative study. This review revealed the range of approaches used to train users and the need for further research in this area. The literature review and qualitative study-based findings led to a follow-on study (chapter 10), whereby the researcher conducted semi-structured interviews to examine how users were trained to use ePrescribing systems across four NHS Hospital Trusts. A range of approaches were used to train users; tailored training, using clinically specific scenarios or matching the user’s profession to that of the trainer were preferred over lectures and e-learning may offer an efficient way of training large numbers of staff. However, further research is needed to investigate this and whether alternative approaches such as the use of students as trainers could be useful. This programme of work revealed the importance of human factors and user involvement in the design and ongoing development of ePrescribing systems. Training also played a role in users’ experiences of using the system and hospitals should carefully consider the training approaches used. This thesis provides recommendations gathered from the literature and primary data collection that can help inform organisations, system developers and further research in this area