Criteria for assessing high-priority drug-drug interactions for clinical decision support in electronic health records

Background: High override rates for drug-drug interaction (DDI) alerts in electronic health records (EHRs) result in the potentially dangerous consequence of providers ignoring clinically significant alerts. Lack of uniformity of criteria for determining the severity or validity of these interactions often results in discrepancies in how these are evaluated. The purpose of this study was to identify a set of criteria for assessing DDIs that should be used for the generation of clinical decision support (CDS) alerts in EHRs. Methods: We conducted a 20-year systematic literature review of MEDLINE and EMBASE to identify characteristics of high-priority DDIs. These criteria were validated by an expert panel consisting of medication knowledge base vendors, EHR vendors, in-house knowledge base developers from academic medical centers, and both federal and private agencies involved in the regulation of medication use. Results: Forty-four articles met the inclusion criteria for assessing characteristics of high-priority DDIs. The panel considered five criteria to be most important when assessing an interaction- Severity, Probability, Clinical Implications of the interaction, Patient characteristics, and the Evidence supporting the interaction. In addition, the panel identified barriers and considerations for being able to utilize these criteria in medication knowledge bases used by EHRs. Conclusions: A multi-dimensional approach is needed to understanding the importance of an interaction for inclusion in medication knowledge bases for the purpose of CDS alerting. The criteria identified in this study can serve as a first step towards a uniform approach in assessing which interactions are critical and warrant interruption of a provider’s workflow

Recommendations for selecting drug-drug interactions for clinical decision support

To recommend principles for including drug-drug interactions (DDIs) in clinical decision support

Retrospective descriptive assessment of clinical decision support medication-related alerts in two Saudi Arabian hospitals

OBJECTIVES: To determine the frequency of clinical decision support system (CDSS) medication-related alerts generated, accepted, or overridden, to assess appropriateness of alert display and overrides, and to characterise the documentation of clinician justification for these overrides in an academic medical centre in Saudi Arabia. MATERIALS AND METHODS: System-generated CDSS reports for the period June 2015 to December 2017 were retrospectively reviewed and analysed. Alerts were classified into different types, and rates of alert overrides calculated as percentages of all generated alerts. A subset of 307 overridden alerts was assessed for appropriateness of display and override by two clinical pharmacists. Physician documentation of reasons for overriding alerts were categorised. RESULTS: A total of 4,446,730 medication-related alerts were generated from both inpatient and outpatient settings, and 4,231,743 (95.2%) were overridden. The most common alert type was 'duplicate drug', accounting for 3,549,736 (79.8%) of alerts. Of 307 alerts assessed for appropriateness, 246 (80%) were judged to be appropriately displayed and 244 (79%) were overridden appropriately. New drug allergy and drug allergy alerts had the highest percentage of being judged as inappropriately overridden. For 1,594,313 alerts (37.7%), 'no overridden reason selected' was chosen from the drop-down menu. CONCLUSIONS: The alert generation and override rate were higher than reported previously in the literature. The small sample size of 307 alerts assessed for appropriateness of alert display and override is a potential limitation. Revision of the CDSS rules for alerts (focusing on specificity and relevance for the local context) is now recommended. Future research should prospectively assess providers' perspectives, and determine patient harm associated with overridden alerts

Impact of an Electronic Medical Record Implementation on Drug Allergy Overrides in a Large Southeastern HMO Setting

Renny Varghese Impact of an Electronic Medical Record Implementation on Drug Allergy Overrides in a Large Southeastern HMO Setting (Under the direction of Russell Toal, Associate Professor) Electronic medical records (EMRs) have become recognized as an important tool for improving patient safety and quality of care. Decision support tools such as alerting functions for patient medication allergies are a key part of reducing the frequency of serious medication problems. Kaiser Permanente Georgia (KPGA) implemented its EMR system in the primary care departments at Kaiser\u27s twelve facilities in the greater metro Atlanta area over a six month period beginning in June 2005 and ending December 2005. The aim of this study is to analyze the impact of the EMR implementation on the number of drug allergy overrides within this large HMO outpatient setting. Research was conducted by comparing the rate of drug allergy overrides during pre and post EMR implementation. The timeline will be six months pre and post implementation. Observing the impact of the incidence rate of drug allergy alerts after the implementation provided insight into the effectiveness of EMRs in reducing contraindicated drug allergies. Results show that the incidence rate of drug allergy overrides per 1,000 filled prescriptions rose by a statistically significant 5.9% (ñ \u3e 0.0002; 95% CI [-1.531, -0.767]) following the implementation. Although results were unexpected, several factors are discussed as to the reason for the increase. Further research is recommended to explore trends in provider behavior, KPGA specific facilities and departments, and in other KP regions and non-KP healthcare settings. INDEX WORDS: electronic medical records, drug allergy overrides, patient safety, medication errors, decision support tools, outpatient setting, primary care, computerized provider order entr

Process Improvement to Reduce Route of Medication Administration Errors in Patients with Enteral Feeding Tubes

Advances in health information management in the form electronic health records, computerized provider order entry systems, and clinical decision support systems and tools have enhanced the productivity, effectiveness, and efficiency of healthcare. However, the cost of these positive effects does come at the expense of other factors. Along with the introduction of Clinical Provider Order Entry (CPOE) systems, organizations have experienced new possibilities for medication errors and risks to patient safety. Factors associated with these errors should be evaluated in detail in order to mitigate the causes of these types of errors and to plan strategies for prevention. Continued research into how to improve the quality of these systems is necessary to promote the usability and acceptance of CPOE systems by prescribers and to continue to make an impact on the frequency of medication errors within health care organizations. Health care organizations must develop strategies to improve the rate of medication errors caused by CPOE systems. Strategies may vary from organization to organization, and depend upon organization-specific resources. Ideally, a plan to improve patient safety and prevent errors related to CPOE systems would include stakeholders such as the clinical team and providers, involve a system that can audit the frequency of errors, and include ongoing education about the problem and the proposed solution. A plan to prevent errors and improve patient safety that is not-dependent upon the intricacies of a specific electronic medical record is ideal. A strategy that can carry-over from one electronic medical record system to the next and that can address the central problem with accuracy, efficiency, and evidence-based research will be proposed

Live usability testing of two complex clinical decision support tools: Observational study

© 2019 Journal of Medical Internet Research. All rights reserved. Background: Potential of the electronic health records (EHR) and clinical decision support (CDS) systems to improve the practice of medicine has been tempered by poor design and the resulting burden they place on providers. CDS is rarely tested in the real clinical environment. As a result, many tools are hard to use, placing strain on providers and resulting in low adoption rates. The existing CDS usability literature relies primarily on expert opinion and provider feedback via survey. This is the first study to evaluate CDS usability and the provider-computer-patient interaction with complex CDS in the real clinical environment. Objective: This study aimed to further understand the barriers and facilitators of meaningful CDS usage within a real clinical context. Methods: This qualitative observational study was conducted with 3 primary care providers during 6 patient care sessions. In patients with the chief complaint of sore throat, a CDS tool built with the Centor Score was used to stratify the risk of group A Streptococcus pharyngitis. In patients with a chief complaint of cough or upper respiratory tract infection, a CDS tool built with the Heckerling Rule was used to stratify the risk of pneumonia. During usability testing, all human-computer interactions, including audio and continuous screen capture, were recorded using the Camtasia software. Participants\u27 comments and interactions with the tool during clinical sessions and participant comments during a postsession brief interview were placed into coding categories and analyzed for generalizable themes. Results: In the 6 encounters observed, primary care providers toggled between addressing either the computer or the patient during the visit. Minimal time was spent listening to the patient without engaging the EHR. Participants mostly used the CDS tool with the patient, asking questions to populate the calculator and discussing the results of the risk assessment; they reported the ability to do this as the major benefit of the tool. All providers were interrupted during their use of the CDS tool by the need to refer to other sections of the chart. In half of the visits, patients\u27 clinical symptoms challenged the applicability of the tool to calculate the risk of bacterial infection. Primary care providers rarely used the incorporated incentives for CDS usage, including progress notes and patient instructions. Conclusions: Live usability testing of these CDS tools generated insights about their role in the patient-provider interaction. CDS may contribute to the interaction by being simultaneously viewed by the provider and patient. CDS can improve usability and lessen the strain it places on providers by being short, flexible, and customizable to unique provider workflow. A useful component of CDS is being as widely applicable as possible and ensuring that its functions represent the fastest way to perform a particular task

Contextualized Drug–Drug Interaction Management Improves Clinical Utility Compared With Basic Drug–Drug Interaction Management in Hospitalized Patients

Drug–drug interactions (DDIs) frequently trigger adverse drug events or reduced efficacy. Most DDI alerts, however, are overridden because of irrelevance for the specific patient. Basic DDI clinical decision support (CDS) systems offer limited possibilities for decreasing the number of irrelevant DDI alerts without missing relevant ones. Computerized decision tree rules were designed to context-dependently suppress irrelevant DDI alerts. A crossover study was performed to compare the clinical utility of contextualized and basic DDI management in hospitalized patients. First, a basic DDI-CDS system was used in clinical practice while contextualized DDI alerts were collected in the background. Next, this process was reversed. All medication orders (MOs) from hospitalized patients with at least one DDI alert were included. The following outcome measures were used to assess clinical utility: positive predictive value (PPV), negative predictive value (NPV), number of pharmacy interventions (PIs)/1,000 MOs, and the median time spent on DDI management/1,000 MOs. During the basic DDI management phase 1,919 MOs/day were included, triggering 220 DDI alerts/1,000 MOs; showing 57 basic DDI alerts/1,000 MOs to pharmacy staff; PPV was 2.8% with 1.6 PIs/1,000 MOs costing 37.2 minutes/1,000 MOs. No DDIs were missed by the contextualized CDS system (NPV 100%). During the contextualized DDI management phase 1,853 MOs/day were included, triggering 244 basic DDI alerts/1,000 MOs, showing 9.6 contextualized DDIs/1,000 MOs to pharmacy staff; PPV was 41.4% (P < 0.01), with 4.0 PIs/1,000 MOs (P < 0.01) and 13.7 minutes/1,000 MOs. The clinical utility of contextualized DDI management exceeds that of basic DDI management

An investigation of healthcare professionals’ experiences of training and using electronic prescribing systems: four literature reviews and two qualitative studies undertaken in the UK hospital context

Electronic prescribing (ePrescribing) is the process of ordering medicines electronically for a patient and has been associated with reduced medication errors and improved patient safety. However, these systems have also been associated with unintended adverse consequences. There is a lack of published research about users’ experiences of these systems in UK hospitals. The aim of this research was therefore to firstly describe the literature pertaining to the recent developments and persisting issues with ePrescribing and clinical decision support systems (CDS) (chapter 2). Two further systematic literature reviews (chapters 3 and 4) were then conducted to understand the unintended consequences of ePrescribing and clinical decision support (CDS) systems across both adult and paediatric patients. These revealed a taxonomy of factors, which have contributed to errors during use of these systems e.g., the screen layout, default settings and inappropriate drug-dosage support. The researcher then conducted a qualitative study (chapters 7-10) to explore users’ experiences of using and being trained to use ePrescribing systems. This study involved conducting semi-structured interviews and observations, which revealed key challenges facing users, including issues with using the ‘Medication List’ and how information was presented. Users experienced benefits and challenges when customising the system, including the screen display; however, the process was sometimes overly complex. Users also described the benefits and challenges associated with different forms of interruptive and passive CDS. Order sets, for instance, encouraged more efficient prescribing, yet users often found them difficult to find within the system. A lack of training resulted in users failing to use all features of the ePrescribing system and left some healthcare staff feeling underprepared for using the system in their role. A further literature review (chapter 5) was then performed to complement emerging themes relating to how users were trained to use ePrescribing systems, which were generated as part of a qualitative study. This review revealed the range of approaches used to train users and the need for further research in this area. The literature review and qualitative study-based findings led to a follow-on study (chapter 10), whereby the researcher conducted semi-structured interviews to examine how users were trained to use ePrescribing systems across four NHS Hospital Trusts. A range of approaches were used to train users; tailored training, using clinically specific scenarios or matching the user’s profession to that of the trainer were preferred over lectures and e-learning may offer an efficient way of training large numbers of staff. However, further research is needed to investigate this and whether alternative approaches such as the use of students as trainers could be useful. This programme of work revealed the importance of human factors and user involvement in the design and ongoing development of ePrescribing systems. Training also played a role in users’ experiences of using the system and hospitals should carefully consider the training approaches used. This thesis provides recommendations gathered from the literature and primary data collection that can help inform organisations, system developers and further research in this area