CPOE System Design Aspects and Their Qualitative Effect on Usability

Although many studies have discussed the benefits of Computerized Provider Order Entry (CPOE) systems, their configuration can have a great impact on clinicians’ adoption of these systems. Poorly designed CPOE systems can lead to usability problems, users’ dissatisfaction and may disrupt normal flow of clinical activities. This paper reports on a literature review focused on the identification of CPOE medication systems’ design aspects that impact CPOE systems’ usability and create opportunities for medication errors. Our review is based on a systematic literature search in PubMed, EMBASE and Ovid MEDLINE for relevant publications from 1986-2006. We categorized the design aspects extracted from relevant publications into six different groups: 1) timing of alerts, 2) log in/out procedures, 3) pick lists and drop down menus, 4) clues and guidelines, 5) documentation and data entry options, and 6) screen display and layout. Our review shows that the manner in which a CPOE system is configured can have a high impact on ease of system use, task behavior of clinicians in ordering drugs, and medication errors. Characterization of consequences associated with certain CPOE design aspects provides insight into how CPOE system designs can be improved to enhance physicians’ adoption of these systems and their success. Recommendations are provided to enable CPOE system designers to create CPOE systems that are not only more user friendly and efficient but safer

Context Sensitive Health Informatics: Concepts, Methods and Tools

__Abstract__ Context is a key consideration when designing and evaluating health information technology (HIT) and cannot be overstated. Unintended consequences are common post HIT implementation and even well designed technology may not achieve desired outcomes because of contextual issues. While context should be considered in the design and evaluation of health information systems (HISs) there is a shortcoming of empirical research on contextual aspects of HIT. This conference integrates the sociotechnical and Human-Centered-Design (HCD) approaches and showcases current research on context sensitive health informatics. The papers and presentations outlines theories and models for studying contextual issues and insights on how we can better design HIT to accommodate different healthcare contexts

Usability Evaluation of a Computerized Physician Order Entry for Medication Ordering

Despite CPOE (Computerized Physician Order Entry) systems’ potential to enhance patient safety by reducing medication errors, recent studies have cast some doubts on their role in error reduction. CPOE systems with poorly designed interfaces have proven to cause users dissatisfaction and to introduce new kind of errors in the ordering process, suggesting a threat instead of an enhancement of patient safety. The main objective of this study is to identify usability problems related to a CPOE medication system’s design and determining their severities. Two experts completed a cognitive walkthrough (CW) of an ordering task based on a clinical scenario for ordering the consolidation phase of chemotherapy for a leukemic patient. Fifty five usability problems were found and classified into eleven categories. CW identified cosmetic to catastrophic problems leading to inefficient use of the CPOE system and potentially resulting in users’ confusion, longer ordering duration, and medication errors. The complexity of the CPOE design, its rigidness and lack of user guidance suggests the necessity to redesign the current user interface in order to match clinicians’ ordering behaviors and to fully support them in the medication ordering process

A usability study to improve a clinical decision support system for the prescription of antibiotic drugs

Objective A clinical decision support system (CDSS) for empirical antibiotic treatment has the potential to increase appropriate antibiotic use. Before using such a system on a broad scale, it needs to be tailored to the users prefer

Limitations of the new ISO standard for health and wellness apps

International audienc

Sleep Quality among Breast and Prostate Cancer Patients: A Comparison between Subjective and Objective Measurements

Breast and prostate cancer patients may experience physical and psychological distress, and a possible decrease in sleep quality. Subjective and objective methods measure different aspects of sleep quality. Our study attempted to determine differences between objective and subjective measurements of sleep quality using bivariate and Pearson’s correlation data analysis. Forty breast (n = 20) and prostate (n = 20) cancer patients were recruited in this observational study. Participants were given an actigraphy device (ACT) and asked to continuously wear it for seven consecutive days, for objective data collection. Following this period, they filled out the Pittsburgh Sleep Quality Index Questionnaire (PSQI) to collect subjective data on sleep quality. The correlation results showed that, for breast cancer patients, PSQI sleep duration was moderately correlated with ACT total sleeping time (TST) (r = −0.534, p < 0.05), and PSQI daytime dysfunction was related to ACT efficiency (r = 0.521, p < 0.05). For prostate cancer patients, PSQI sleep disturbances were related to ACT TST (r = 0.626, p < 0.05). Both objective and subjective measurements are important in validating and determining details of sleep quality, with combined results being more insightful, and can also help in personalized care to further improve quality of life among cancer patients.Ministry of Science and Technology, Taiwan (grant numbers 108-2221-E-038-013 and 110-2923-E-038-001-MY3)Taipei Medical University, Taiwan (grant number 108-3805-009-110)Ministry of Education, Taiwan (grant number 108-6604-002-400)Wanfang hospital, Taiwan (grant number 106TMU-WFH-01-4

Prediction of individualized lifetime benefit from cholesterol lowering, blood pressure lowering, antithrombotic therapy, and smoking cessation in apparently healthy people.

AIMS: The benefit an individual can expect from preventive therapy varies based on risk-factor burden, competing risks, and treatment duration. We developed and validated the LIFEtime-perspective CardioVascular Disease (LIFE-CVD) model for the estimation of individual-level 10 years and lifetime treatment-effects of cholesterol lowering, blood pressure lowering, antithrombotic therapy, and smoking cessation in apparently healthy people. METHODS AND RESULTS: Model development was conducted in the Multi-Ethnic Study of Atherosclerosis (n = 6715) using clinical predictors. The model consists of two complementary Fine and Gray competing-risk adjusted left-truncated subdistribution hazard functions: one for hard cardiovascular disease (CVD)-events, and one for non-CVD mortality. Therapy-effects were estimated by combining the functions with hazard ratios from preventive therapy trials. External validation was performed in the Atherosclerosis Risk in Communities (n = 9250), Heinz Nixdorf Recall (n = 4177), and the European Prospective Investigation into Cancer and Nutrition-Netherlands (n = 25 833), and Norfolk (n = 23 548) studies. Calibration of the LIFE-CVD model was good and c-statistics were 0.67-0.76. The output enables the comparison of short-term vs. long-term therapy-benefit. In two people aged 45 and 70 with otherwise identical risk-factors, the older patient has a greater 10-year absolute risk reduction (11.3% vs. 1.0%) but a smaller gain in life-years free of CVD (3.4 vs. 4.5 years) from the same therapy. The model was developed into an interactive online calculator available via www.U-Prevent.com. CONCLUSION: The model can accurately estimate individual-level prognosis and treatment-effects in terms of improved 10-year risk, lifetime risk, and life-expectancy free of CVD. The model is easily accessible and can be used to facilitate personalized-medicine and doctor-patient communication

A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence

OBJECTIVE: Usability evaluation is now widely recognized as critical to the success of interactive health care applications. However, the broad range of usability inspection and testing methods available may make it difficult to decide on a usability assessment plan. To guide novices in the human-computer interaction field, we provide an overview of the methodological and empirical research available on the three usability inspection and testing methods most often used. METHODS: We describe two 'expert-based' and one 'user-based' usability method: (1) the heuristic evaluation, (2) the cognitive walkthrough, and (3) the think aloud. RESULTS: All three usability evaluation methods are applied in laboratory settings. Heuristic evaluation is a relatively efficient usability evaluation method with a high benefit-cost ratio, but requires high skills and usability experience of the evaluators to produce reliable results. The cognitive walkthrough is a more structured approach than the heuristic evaluation with a stronger focus on the learnability of a computer application. Major drawbacks of the cognitive walkthrough are the required level of detail of task and user background descriptions for an adequate application of the latest version of the technique. The think aloud is a very direct method to gain deep insight in the problems end users encounter in interaction with a system but data analyses is extensive and requires a high level of expertise both in the cognitive ergonomics and in computer system application domain. DISCUSSION AND CONCLUSIONS: Each of the three usability evaluation methods has shown its usefulness, has its own advantages and disadvantages; no single method has revealed any significant results indicating that it is singularly effective in all circumstances. A combination of different techniques that compliment one another should preferably be used as their collective application will be more powerful than applied in isolation. Innovative mobile and automated solutions to support end-user testing have emerged making combined approaches of laboratory, field and remote usability evaluations of new health care applications more feasibl

Classification and regression tree and computer adaptive testing in cardiac rehabilitation: Instrument validation study

Background: There is a need for shorter-length assessments that capture patient questionnaire data while attaining high data quality without an undue response burden on patients. Computerized adaptive testing (CAT) and classification and regression tree (CART) methods have the potential to meet these needs and can offer attractive options to shorten questionnaire lengths. Objective: The objective of this study was to test whether CAT or CART was best suited to reduce the number of questionnaire items in multiple domains (eg, anxiety, depression, quality of life, and social support) used for a needs assessment procedure (NAP) within the field of cardiac rehabilitation (CR) without the loss of data quality. Methods: NAP data of 2837 CR patients from a multicenter Cardiac Rehabilitation Decision Support System (CARDSS) Web-based program was used. Patients used a Web-based portal, MyCARDSS, to provide their data. CAT and CART were assessed based on their performances in shortening the NAP procedure and in terms of sensitivity and specificity. Results: With CAT and CART, an overall reduction of 36% and 72% of NAP questionnaire length, respectively, was achieved, with a mean sensitivity and specificity of 0.765 and 0.817 for CAT, 0.777 and 0.877 for classification trees, and 0.743 and 0.40 for regression trees, respectively. Conclusions: Both CAT and CART can be used to shorten the questionnaires of the NAP used within the field of CR. CART, however, showed the best performance, with a twice as large overall decrease in the number of questionnaire items of the NAP compared to CAT and the highest sensitivity and specificity. To our knowledge, our study is the first to assess the differences in performance between CAT and CART for shortening questionnaire lengths. Future research should consider administering varied assessments of patients over time to monitor their progress in multiple domains. For CR professionals, CART integrated with MyCARDSS would provide a feedback loop that informs the rehabilitation progress of their patients by providing real-time patient measurements

SEWA: A framework for sociotechnical analysis of electronic health record system workarounds

Objective: To develop a conceptual framework, SEWA, to address challenges of studying workarounds emerging from Electronic Health Record (EHR) system usage. Materials and methods: SEWA is based on direct observations and follow-up interviews with physicians, nurses and clerks using their EHR at a large academic hospital. SEWA was developed by an iterative process: each new version was reviewed by experts (case study participants, hospital management, EHR developers) and refined accordingly till deemed final. Results: SEWA defines the work system and its five components constituting the context in which EHR workarounds are created. It also contains 15 rationales for creating EHR workarounds. Furthermore, four attributes are included that define EHR workarounds: cascadedness, anticipatedness, avoidability, and repetitiveness. Finally, SEWA lists the possible effects of workarounds on outcomes of clinical processes in terms of scope and impact. Discussion: SEWA provides a grounded foundation for performing sociotechnical analyses of EHR workarounds based on components of the work system. SEWA can likewise be supportive in planning redesign efforts of the work system. Finally, workarounds are subject to gradual change caused by e.g. changes in one's knowledge of the EHR, hospital policies, care directives, and system updates. Snapshots of SEWA can be taken over time and compared to gain insights into the evolution of workarounds. Conclusion: Given the absence of a sociotechnical framework to study EHR workarounds, SEWA could aid researchers and practitioners to identify, analyze and resolve workarounds, and thereby contribute to improved patient safety, effectiveness of care and efficiency of care