Usability analysis of contending electronic health record systems

In this paper, we report measured usability of two leading EHR systems during procurement. A total of 18 users participated in paired-usability testing of three scenarios: ordering and managing medications by an outpatient physician, medicine administration by an inpatient nurse and scheduling of appointments by nursing staff. Data for audio, screen capture, satisfaction rating, task success and errors made was collected during testing. We found a clear difference between the systems for percentage of successfully completed tasks, two different satisfaction measures and perceived learnability when looking at the results over all scenarios. We conclude that usability should be evaluated during procurement and the difference in usability between systems could be revealed even with fewer measures than were used in our study. © 2019 American Psychological Association Inc. All rights reserved.Peer reviewe

How do health service professionals consider human factors when purchasing interactive medical devices? A qualitative interview study

We present findings of a UK study into how those involved in purchasing interactive medical devices go about evaluating usability, the challenges that arise, and opportunities for improvement. The study focused on procurement of infusion devices because these are used by various professionals across healthcare. A semi-structured interview study was carried out involving a range of stakeholders (20 in total) involved in or impacted by medical device procurement. Data was analysed using thematic analysis, a qualitative method designed to support the identification, analysis and reporting of patterns. In principle, health service purchasing was found to accommodate consideration of equipment usability. In practice, the evaluation process was driven primarily by engineering standards; assessment of local needs did not accommodate substantive assessment of usability; and choice was limited by the availability of equipment on the marketplace. We discuss ways in which purchasing could be improved through techniques that account for social circumstances

Safety in home care: A research protocol for studying medication management

<p>Abstract</p> <p>Background</p> <p>Patient safety is an ongoing global priority, with medication safety considered a prevalent, high-risk area of concern. Yet, we have little understanding of the supports and barriers to safe medication management in the Canadian home care environment. There is a clear need to engage the providers and recipients of care in studying and improving medication safety with collaborative approaches to exploring the nature and safety of medication management in home care.</p> <p>Methods</p> <p>A socio-ecological perspective on health and health systems drives our iterative qualitative study on medication safety with elderly home care clients, family members and other informal caregivers, and home care providers. As we purposively sample across four Canadian provinces: Alberta (AB), Ontario (ON), Quebec (QC) and Nova Scotia (NS), we will collect textual and visual data through home-based interviews, participant-led photo walkabouts of the home, and photo elicitation sessions at clients' kitchen tables. Using successive rounds of interpretive description and human factors engineering analyses, we will generate robust descriptions of managing medication at home within each provincial sample and across the four-province group. We will validate our initial interpretations through photo elicitation focus groups with home care providers in each province to develop a refined description of the phenomenon that can inform future decision-making, quality improvement efforts, and research.</p> <p>Discussion</p> <p>The application of interpretive and human factors lenses to the visual and textual data is expected to yield findings that advance our understanding of the issues, challenges, and risk-mitigating strategies related to medication safety in home care. The images are powerful knowledge translation tools for sharing what we learn with participants, decision makers, other healthcare audiences, and the public. In addition, participants engage in knowledge exchange throughout the study with the use of participatory data collection methods.</p

Consolidation of CDA-based documents from multiple sources : a modular approach

Indiana University-Purdue University Indianapolis (IUPUI)Physicians receive multiple CCDs for a single patient encompassing various encounters and medical history recorded in different information systems. It is cumbersome for providers to explore different pages of CCDs to find specific data which can be duplicated or even conflicted. This study describes the steps towards a system that integrates multiple CCDs into one consolidated document for viewing or processing patient-level data. Also, the impact of the system on healthcare providers’ perceived workload is evaluated. A modular system is developed to consolidate and de-duplicate CDA-based documents. The system is engineered to be scalable, extensible and open source. The system’s performance and output has evaluated first based on synthesized data and later based on real-world CCDs obtained from INPC database. The accuracy of the consolidation system along with the gaps in identification of the duplications were assessed. Finally, the impact of the system on healthcare providers’ workload is evaluated using NASA TLX tool. All of the synthesized CCDs were successfully consolidated, and no data were lost. The de-duplication accuracy was 100% based on synthesized data and the processing time for each document was 1.12 seconds. For real-world CCDs, our system de-duplicated 99.1% of the problems, 87.0% of allergies, and 91.7% of medications. Although the accuracy of the system is still very promising, however, there is a minor inaccuracy. Due to system improvements, the processing time for each document is reduced to average 0.38 seconds for each CCD. The result of NASA TLX evaluation shows that the system significantly decreases healthcare providers’ perceived workload. Also, it is observed that information reconciliation reduces the medical errors. The time for review of medical documents review time is significantly reduced after CCD consolidation. Given increasing adoption and use of Health Information Exchange (HIE) to share data and information across the care continuum, duplication of information is inevitable. A novel system designed to support automated consolidation and de-duplication of information across clinical documents as they are exchanged shows promise. Future work is needed to expand the capabilities of the system and further test it using heterogeneous vocabularies across multiple HIE scenarios

Design, Implementation, and Evaluation of a User Training Program for Integrating Health Information Technology into Clinical Processes

Health information technology (IT) implementation can be costly, and remains a challenging problem with mixed outcomes on patient safety and quality of care. Systems engineering and IT management experts have advocated the use of sociotechnical models to understand the impact of health IT on user and organizational factors. Sociotechnical models suggest the need for user-centered implementation approaches, such as user training and support, and focus on processes to mitigate the negative impact and facilitate optimal IT use during training. The training design and development should also follow systematic processes guided by instructional development models. It should take into account of users’ characteristics of learning, and employ scientific training theories to adopt validated methods that facilitate learning and health IT integration. My study aimed to develop and evaluate a scientific model-guided and systematically developed health IT user training program that explicitly mitigate IT negative impact and facilitate optimal use. I used an electronic health record (EHR) as the health IT, and used medication reconciliation as the clinical task. I developed a sociotechnical model to guide analysis of users’ clinical tasks and their IT interaction, and utilized this model to analyze technical aspects of an EHR, and explicitly integrate the EHR into the workflow of a medication reconciliation task. I designed and developed the training program following existing models, and designed cognitive mapping based interventions to facilitate learning and health IT integration. I implemented and evaluated the training program using a controlled experiment with nursing senior baccalaureate students. Evaluation of participants’ training performance showed that the developed training program was effective. The training program improved trainees’ system use competency by comparing trainees’ pre- and post- training performance, i.e., trainees were able to conduct clinical tasks using the EHR correctly and efficiently, and transfer the competency to use another EHR after training. The training also improved trainees’ clinical outcomes by comparing clinical outcomes between the two training conditions, i.e., trainees who learned cognitive mapping were more competent to identify medication discrepancies. This result implied the proposed methodology could be used as an approach to health IT training, and may be generalizable to other clinical tasks, environments, or role-types