Usability Evaluation of a Computerized Physician Order Entry for Medication Ordering

Despite CPOE (Computerized Physician Order Entry) systems’ potential to enhance patient safety by reducing medication errors, recent studies have cast some doubts on their role in error reduction. CPOE systems with poorly designed interfaces have proven to cause users dissatisfaction and to introduce new kind of errors in the ordering process, suggesting a threat instead of an enhancement of patient safety. The main objective of this study is to identify usability problems related to a CPOE medication system’s design and determining their severities. Two experts completed a cognitive walkthrough (CW) of an ordering task based on a clinical scenario for ordering the consolidation phase of chemotherapy for a leukemic patient. Fifty five usability problems were found and classified into eleven categories. CW identified cosmetic to catastrophic problems leading to inefficient use of the CPOE system and potentially resulting in users’ confusion, longer ordering duration, and medication errors. The complexity of the CPOE design, its rigidness and lack of user guidance suggests the necessity to redesign the current user interface in order to match clinicians’ ordering behaviors and to fully support them in the medication ordering process

CPOE System Design Aspects and Their Qualitative Effect on Usability

Although many studies have discussed the benefits of Computerized Provider Order Entry (CPOE) systems, their configuration can have a great impact on clinicians’ adoption of these systems. Poorly designed CPOE systems can lead to usability problems, users’ dissatisfaction and may disrupt normal flow of clinical activities. This paper reports on a literature review focused on the identification of CPOE medication systems’ design aspects that impact CPOE systems’ usability and create opportunities for medication errors. Our review is based on a systematic literature search in PubMed, EMBASE and Ovid MEDLINE for relevant publications from 1986-2006. We categorized the design aspects extracted from relevant publications into six different groups: 1) timing of alerts, 2) log in/out procedures, 3) pick lists and drop down menus, 4) clues and guidelines, 5) documentation and data entry options, and 6) screen display and layout. Our review shows that the manner in which a CPOE system is configured can have a high impact on ease of system use, task behavior of clinicians in ordering drugs, and medication errors. Characterization of consequences associated with certain CPOE design aspects provides insight into how CPOE system designs can be improved to enhance physicians’ adoption of these systems and their success. Recommendations are provided to enable CPOE system designers to create CPOE systems that are not only more user friendly and efficient but safer

Understanding workflow in telehealth video visits: Observations from the IDEATel project

AbstractHome telemedicine is an emerging healthcare paradigm that has the potential to transform the treatment of chronic illness. The purpose of this paper is to: (1) develop a theoretical and methodological framework for studying workflow in telemediated clinician–patient encounters drawing on a distributed cognition approach and (2) employ the framework in an in-depth analysis of workflow in the IDEATel project, a telemedicine program for older adults with diabetes. The methods employed in this research included (a) videotaped observations of 27 nurse–patient encounters and (b) semi-structured interviews with participants. The analyses were used to provide a descriptive analysis of video visits, understand the mediating role of different technologies and to characterize the ways in which artifacts and representations are used to understand the state of the patient. The study revealed barriers to productive use of telehealth technology as well as adaptations that circumvented such limitations. This research has design implications for: (a) improving the coordination of communication and (b) developing tools that better integrate and display information. Although home telemedicine programs will differ in important respects, there are invariant properties across such systems. Explicating these properties can serve as a needs requirement analysis to develop more effective systems and implementation plans

Improving Usability and Adoption of Tablet-based Electronic Health Record (EHR) Applications

abstract: The technological revolution has caused the entire world to migrate to a digital environment and health care is no exception to this. Electronic Health Records (EHR) or Electronic Medical Records (EMR) are the digital repository for health data of patients. Nation wide efforts have been made by the federal government to promote the usage of EHRs as they have been found to improve quality of health service. Although EHR systems have been implemented almost everywhere, active use of EHR applications have not replaced paper documentation. Rather, they are often used to store transcribed data from paper documentation after each clinical procedure. This process is found to be prone to errors such as data omission, incomplete data documentation and is also time consuming. This research aims to help improve adoption of real-time EHRs usage while documenting data by improving the usability of an iPad based EHR application that is used during resuscitation process in the intensive care unit. Using Cognitive theories and HCI frameworks, this research identified areas of improvement and customizations in the application that were required to exclusively match the work flow of the resuscitation team at the Mayo Clinic. In addition to this, a Handwriting Recognition Engine (HRE) was integrated into the application to support a stylus based information input into EHR, which resembles our target users’ traditional pen and paper based documentation process. The EHR application was updated and then evaluated with end users at the Mayo clinic. The users found the application to be efficient, usable and they showed preference in using this application over the paper-based documentation.Dissertation/ThesisMasters Thesis Computer Science 201

Exploring medical device design and use through layers of distributed cognition: How a glucometer is coupled with its context

cmtheme: cmoutput: journalcmtheme: cmoutput: journalThis work was supported by the UK Engineering and Physical Sciences Research Council [EP/G059063/1]

Conceptual knowledge acquisition in biomedicine: A methodological review

AbstractThe use of conceptual knowledge collections or structures within the biomedical domain is pervasive, spanning a variety of applications including controlled terminologies, semantic networks, ontologies, and database schemas. A number of theoretical constructs and practical methods or techniques support the development and evaluation of conceptual knowledge collections. This review will provide an overview of the current state of knowledge concerning conceptual knowledge acquisition, drawing from multiple contributing academic disciplines such as biomedicine, computer science, cognitive science, education, linguistics, semiotics, and psychology. In addition, multiple taxonomic approaches to the description and selection of conceptual knowledge acquisition and evaluation techniques will be proposed in order to partially address the apparent fragmentation of the current literature concerning this domain

Master of Science

thesisElectronic Health Record (EHR) adoption rates have been low in the United States. A key reason for this low adoption rate is poor EHR usability. Currently no standards exist for design, testing and monitoring the usability of EHRs. Therefore, we conducted a usability evaluation of a vendor's product in the Emergency Department at the University of Utah. In the first objective of this study, we evaluated a newly implemented computerized provider order entry application. Four usability experts used the Zhang et al 14 heuristics and 23 predefined tasks to perform the evaluation. The experts found 48 usability problems categorized into 51 heuristic violations. There were 4 cosmetic, 120 minor, 64 major, and 4 catastrophic problems identified. The interrater reliability was 0.81 using Fleis' Kappa, showing a high level of consistency in ratings across evaluators. For the second objective, we used an electronic version of Questionnaire of User Interaction Satisfaction (QUIS 7.0) to evaluate physician satisfaction with the CPOE application in the ED. The physician response rate was 50% (25/50). The total survey mean was 4.87, lower than the -a priori‖ definition for acceptable satisfaction score of 5.0 (of a possible 9). The lowest scale scores were for overall user reaction and learning iv and the highest were for screen, terminology and system capabilities. Further analyses were completed to determine any differences for satisfaction scores between physician trainees and attending. A multifactor ANOVA was performed to examine the combined effect of the different experience levels and sections of the QUIS. The results were significant at -1.43 (p < 0.05) for screen and terminology and system capabilities. In this setting, the ED CPOE application had a high level of usability issues and low mean satisfaction scores among physician end-users. The responsibility for improved usability lies with both vendors developing the product and facilities implementing the product and both should be educated on usability principles. The combination of a user-based and expert-based inspection method yielded congruent findings and was an accurate and efficient means of evaluation

Predicting prescription patterns

Thesis (S.M.)--Harvard-MIT Division of Health Sciences and Technology, 2008.Includes bibliographical references (leaves 43-49).Electronic prescription software is replacing traditional handwritten medication orders. This development however doesn't come without a cost and speed has been one of the most complained about issues. It is important to address this problem and develop methods to reduce the time spent entering medication orders into computerized prescription software. The objective of this study was to understand the structure of prescription patterns and explore the possibility of designing a method that will predict prescription patterns with only the knowledge of past prescription history. Various machine-learning methods were used and their performance measured by the accuracy of prediction as well as their ability to produce desirable results, within practical time limits. This paper presents a method to transform prescription data into a stochastic time series for prediction. The paper also presents a new nonlinear local algorithm based on nearest neighbor search. In analyzing the database the drug patterns were found to be diverse and over 30% of the patients were unique, in the sense that no other patient had been prescribed the same set of active ingredients. In spite of this diversity, it was possible to create a list of 20 drugs that contained the drug to be prescribed next for 70.2% of patients. This suggests that probabilistically created pick lists, tailored specifically for one patient at the time of prescription, might be used to ease the prescription process. However, further research is needed to evaluate the impact of such lists on prescription habits.by Ívar S. Helgason.S.M

The Impact of CPOE Medication Systems’ Design Aspects on Usability, Workflow and Medication Orders

Objectives: To examine the impact of design aspects of computerized physician order entry (CPOE) systems for medication ordering on usability, physicians’ workflow and on medication orders. Methods: We systematically searched Pub - Med, EMBASE and Ovid MEDLINE for articles published from 1986 to 2007. We also evaluated reference lists of reviews and relevant articles captured by our search strategy, and the web-based inventory of evaluation studies in medical informatics 1982–2005. Data about design aspects were extracted from the relevant articles. Identified design aspects were categorized in groups derived from principles for computer screen and dialogue design and user guidance from the International Stan-dard Organization, and if CPOE-specific, from the collected data. Results: A total of 19 papers met our inclusion criteria. Sixteen studies used qualitative evaluation methods and the rest both qualitative and quantitative. In total 42 CPOE design aspects were identified and categorized in seven groups: 1) documentation and data entry components, 2) alerting, 3) visual clues and icons, 4) drop-down lists and menus, 5) safeguards, 6) screen displays, and 7) auxiliary functions. Conclusions: Beside the range of functionalities provided by a CPOE system, their subtle design is important to increase physicians’ adoption and to reduce medication errors. This requires continuous evaluations to investigate whether interfaces of CPOE systems follow normal flow of actions in the ordering process and if they are cognitively easy to understand and use for physicians. This paper provides general recommendations for CPOE (re)design based on the characteristics of CPOE design aspects found