Understanding physicians’ behavior toward alerts about nephrotoxic medications in outpatients: a cross-sectional analysis

Background: Although most outpatients are relatively healthy, many have chronic renal insufficiency, and high override rates for suggestions on renal dosing have been observed. To better understand the override of renal dosing alerts in an outpatient setting, we conducted a study to evaluate which patients were more frequently prescribed contraindicated medications, to assess providers’ responses to suggestions, and to examine the drugs involved and the reasons for overrides. Methods: We obtained data on renal alert overrides and the coded reasons for overrides cited by providers at the time of prescription from outpatient clinics and ambulatory hospital-based practices at a large academic health care center over a period of 3 years, from January 2009 to December 2011. For detailed chart review, a group of 6 trained clinicians developed the appropriateness criteria with excellent inter-rater reliability (κ = 0.93). We stratified providers by override frequency and then drew samples from the high- and low-frequency groups. We measured the rate of total overrides, rate of appropriate overrides, medications overridden, and the reason(s) for override. Results: A total of 4120 renal alerts were triggered by 584 prescribers in the study period, among which 78.2% (3,221) were overridden. Almost half of the alerts were triggered by 40 providers and one-third was triggered by high-frequency overriders. The appropriateness rates were fairly similar, at 28.4% and 31.6% for high- and low-frequency overriders, respectively. Metformin, glyburide, hydrochlorothiazide, and nitrofurantoin were the most common drugs overridden. Physicians’ appropriateness rates were higher than the rates for nurse practitioners (32.9% vs. 22.1%). Physicians with low frequency override rates had higher levels of appropriateness for metformin than the high frequency overriders (P = 0.005). Conclusion: A small number of providers accounted for a large fraction of overrides, as was the case with a small number of drugs. These data suggest that a focused intervention targeting primarily these providers and medications has the potential to improve medication safety

Effect of a Computer-Based Decision Support Intervention on Autism Spectrum Disorder Screening in Pediatric Primary Care Clinics: A Cluster Randomized Clinical Trial

Importance: Universal early screening for autism spectrum disorder (ASD) is recommended but not routinely performed. Objective: To determine whether computer-automated screening and clinical decision support can improve ASD screening rates in pediatric primary care practices. Design, Setting, and Participants: This cluster randomized clinical trial, conducted between November 16, 2010, and November 21, 2012, compared ASD screening rates among a random sample of 274 children aged 18 to 24 months in urban pediatric clinics of an inner-city county hospital system with or without an ASD screening module built into an existing decision support software system. Statistical analyses were conducted from February 6, 2017, to June 1, 2018. Interventions: Four clinics were matched in pairs based on patient volume and race/ethnicity, then randomized within pairs. Decision support with the Child Health Improvement Through Computer Automation system (CHICA) was integrated with workflow and with the electronic health record in intervention clinics. Main Outcomes and Measures: The main outcome was screening rates among children aged 18 to 24 months. Because the intervention was discontinued among children aged 18 months at the request of the participating clinics, only results for those aged 24 months were collected and analyzed. Rates of positive screening results, clinicians' response rates to screening results in the computer system, and new cases of ASD identified were also measured. Main results were controlled for race/ethnicity and intracluster correlation. Results: Two clinics were randomized to receive the intervention, and 2 served as controls. Records from 274 children (101 girls, 162 boys, and 11 missing information on sex; age range, 23-30 months) were reviewed (138 in the intervention clinics and 136 in the control clinics). Of 263 children, 242 (92.0%) were enrolled in Medicaid, 138 (52.5%) were African American, and 96 (36.5%) were Hispanic. Screening rates in the intervention clinics increased from 0% (95% CI, 0%-5.5%) at baseline to 68.4% (13 of 19) (95% CI, 43.4%-87.4%) in 6 months and to 100% (18 of 18) (95% CI, 81.5%-100%) in 24 months. Control clinics had no significant increase in screening rates (baseline, 7 of 64 children [10.9%]; 6-24 months after the intervention, 11 of 72 children [15.3%]; P = .46). Screening results were positive for 265 of 980 children (27.0%) screened by CHICA during the study period. Among the 265 patients with positive screening results, physicians indicated any response in CHICA in 151 (57.0%). Two children in the intervention group received a new diagnosis of ASD within the time frame of the study. Conclusions and Relevance: The findings suggest that computer automation, when integrated with clinical workflow and the electronic health record, increases screening of children for ASD, but follow-up by physicians is still flawed. Automation of the subsequent workup is still needed

A review of human factors principles for the design and implementation of medication safety alerts in clinical information systems.

The objective of this review is to describe the implementation of human factors principles for the design of alerts in clinical information systems. First, we conduct a review of alarm systems to identify human factors principles that are employed in the design and implementation of alerts. Second, we review the medical informatics literature to provide examples of the implementation of human factors principles in current clinical information systems using alerts to provide medication decision support. Last, we suggest actionable recommendations for delivering effective clinical decision support using alerts. A review of studies from the medical informatics literature suggests that many basic human factors principles are not followed, possibly contributing to the lack of acceptance of alerts in clinical information systems. We evaluate the limitations of current alerting philosophies and provide recommendations for improving acceptance of alerts by incorporating human factors principles in their design

Retrospective descriptive assessment of clinical decision support medication-related alerts in two Saudi Arabian hospitals

OBJECTIVES: To determine the frequency of clinical decision support system (CDSS) medication-related alerts generated, accepted, or overridden, to assess appropriateness of alert display and overrides, and to characterise the documentation of clinician justification for these overrides in an academic medical centre in Saudi Arabia. MATERIALS AND METHODS: System-generated CDSS reports for the period June 2015 to December 2017 were retrospectively reviewed and analysed. Alerts were classified into different types, and rates of alert overrides calculated as percentages of all generated alerts. A subset of 307 overridden alerts was assessed for appropriateness of display and override by two clinical pharmacists. Physician documentation of reasons for overriding alerts were categorised. RESULTS: A total of 4,446,730 medication-related alerts were generated from both inpatient and outpatient settings, and 4,231,743 (95.2%) were overridden. The most common alert type was 'duplicate drug', accounting for 3,549,736 (79.8%) of alerts. Of 307 alerts assessed for appropriateness, 246 (80%) were judged to be appropriately displayed and 244 (79%) were overridden appropriately. New drug allergy and drug allergy alerts had the highest percentage of being judged as inappropriately overridden. For 1,594,313 alerts (37.7%), 'no overridden reason selected' was chosen from the drop-down menu. CONCLUSIONS: The alert generation and override rate were higher than reported previously in the literature. The small sample size of 307 alerts assessed for appropriateness of alert display and override is a potential limitation. Revision of the CDSS rules for alerts (focusing on specificity and relevance for the local context) is now recommended. Future research should prospectively assess providers' perspectives, and determine patient harm associated with overridden alerts

Adaptive design of a clinical decision support tool: What the impact on utilization rates means for future CDS research

© The Author(s) 2019. OBJECTIVE: We employed an agile, user-centered approach to the design of a clinical decision support tool in our prior integrated clinical prediction rule study, which achieved high adoption rates. To understand if applying this user-centered process to adapt clinical decision support tools is effective in improving the use of clinical prediction rules, we examined utilization rates of a clinical decision support tool adapted from the original integrated clinical prediction rule study tool to determine if applying this user-centered process to design yields enhanced utilization rates similar to the integrated clinical prediction rule study. MATERIALS & METHODS: We conducted pre-deployment usability testing and semi-structured group interviews at 6 months post-deployment with 75 providers at 14 intervention clinics across the two sites to collect user feedback. Qualitative data analysis is bifurcated into immediate and delayed stages; we reported on immediate-stage findings from real-time field notes used to generate a set of rapid, pragmatic recommendations for iterative refinement. Monthly utilization rates were calculated and examined over 12 months. RESULTS: We hypothesized a well-validated, user-centered clinical decision support tool would lead to relatively high adoption rates. Then 6 months post-deployment, integrated clinical prediction rule study tool utilization rates were substantially lower than anticipated based on the original integrated clinical prediction rule study trial (68%) at 17% (Health System A) and 5% (Health System B). User feedback at 6 months resulted in recommendations for tool refinement, which were incorporated when possible into tool design; however, utilization rates at 12 months post-deployment remained low at 14% and 4% respectively. DISCUSSION: Although valuable, findings demonstrate the limitations of a user-centered approach given the complexity of clinical decision support. CONCLUSION: Strategies for addressing persistent external factors impacting clinical decision support adoption should be considered in addition to the user-centered design and implementation of clinical decision support

Experience with decision support system and comfort with topic predict clinicians’ responses to alerts and reminders

Objective Clinicians at our institution typically respond to about half of the prompts they are given by the clinic’s computer decision support system (CDSS). We sought to examine factors associated with clinician response to CDSS prompts as part of a larger, ongoing quality improvement effort to optimize CDSS use. Methods We examined patient, prompt, and clinician characteristics associated with clinician response to decision support prompts from the Child Health Improvement through Computer Automation (CHICA) system. We asked pediatricians who were nonusers of CHICA to rate decision support topics as “easy” or “not easy” to discuss with patients and their guardians. We analyzed these ratings and data, from July 1, 2009 to January 29, 2013, utilizing a hierarchical regression model, to determine whether factors such as comfort with the prompt topic and the length of the user’s experience with CHICA contribute to user response rates. Results We examined 414 653 prompts from 22 260 patients. The length of time a clinician had been using CHICA was associated with an increase in their prompt response rate. Clinicians were more likely to respond to topics rated as “easy” to discuss. The position of the prompt on the page, clinician gender, and the patient’s age, race/ethnicity, and preferred language were also predictive of prompt response rate. Conclusion This study highlights several factors associated with clinician prompt response rates that could be generalized to other health information technology applications, including the clinician’s length of exposure to the CDSS, the prompt’s position on the page, and the clinician’s comfort with the prompt topic. Incorporating continuous quality improvement efforts when designing and implementing health information technology may ensure that its use is optimized

An investigation of healthcare professionals’ experiences of training and using electronic prescribing systems: four literature reviews and two qualitative studies undertaken in the UK hospital context

Electronic prescribing (ePrescribing) is the process of ordering medicines electronically for a patient and has been associated with reduced medication errors and improved patient safety. However, these systems have also been associated with unintended adverse consequences. There is a lack of published research about users’ experiences of these systems in UK hospitals. The aim of this research was therefore to firstly describe the literature pertaining to the recent developments and persisting issues with ePrescribing and clinical decision support systems (CDS) (chapter 2). Two further systematic literature reviews (chapters 3 and 4) were then conducted to understand the unintended consequences of ePrescribing and clinical decision support (CDS) systems across both adult and paediatric patients. These revealed a taxonomy of factors, which have contributed to errors during use of these systems e.g., the screen layout, default settings and inappropriate drug-dosage support. The researcher then conducted a qualitative study (chapters 7-10) to explore users’ experiences of using and being trained to use ePrescribing systems. This study involved conducting semi-structured interviews and observations, which revealed key challenges facing users, including issues with using the ‘Medication List’ and how information was presented. Users experienced benefits and challenges when customising the system, including the screen display; however, the process was sometimes overly complex. Users also described the benefits and challenges associated with different forms of interruptive and passive CDS. Order sets, for instance, encouraged more efficient prescribing, yet users often found them difficult to find within the system. A lack of training resulted in users failing to use all features of the ePrescribing system and left some healthcare staff feeling underprepared for using the system in their role. A further literature review (chapter 5) was then performed to complement emerging themes relating to how users were trained to use ePrescribing systems, which were generated as part of a qualitative study. This review revealed the range of approaches used to train users and the need for further research in this area. The literature review and qualitative study-based findings led to a follow-on study (chapter 10), whereby the researcher conducted semi-structured interviews to examine how users were trained to use ePrescribing systems across four NHS Hospital Trusts. A range of approaches were used to train users; tailored training, using clinically specific scenarios or matching the user’s profession to that of the trainer were preferred over lectures and e-learning may offer an efficient way of training large numbers of staff. However, further research is needed to investigate this and whether alternative approaches such as the use of students as trainers could be useful. This programme of work revealed the importance of human factors and user involvement in the design and ongoing development of ePrescribing systems. Training also played a role in users’ experiences of using the system and hospitals should carefully consider the training approaches used. This thesis provides recommendations gathered from the literature and primary data collection that can help inform organisations, system developers and further research in this area