Modeling Clinicians’ Cognitive and Collaborative Work in Post-Operative Hospital Care

abstract: Clinicians confront formidable challenges with information management and coordination activities. When not properly integrated into clinical workflow, technologies can further burden clinicians’ cognitive resources, which is associated with medical errors and risks to patient safety. An understanding of workflow is necessary to redesign information technologies (IT) that better support clinical processes. This is particularly important in surgical care, which is among the most clinical and resource intensive settings in healthcare, and is associated with a high rate of adverse events. There are a growing number of tools to study workflow; however, few produce the kinds of in-depth analyses needed to understand health IT-mediated workflow. The goals of this research are to: (1) investigate and model workflow and communication processes across technologies and care team members in post-operative hospital care; (2) introduce a mixed-method framework, and (3) demonstrate the framework by examining two health IT-mediated tasks. This research draws on distributed cognition and cognitive engineering theories to develop a micro-analytic strategy in which workflow is broken down into constituent people, artifacts, information, and the interactions between them. It models the interactions that enable information flow across people and artifacts, and identifies dependencies between them. This research found that clinicians manage information in particular ways to facilitate planned and emergent decision-making and coordination processes. Barriers to information flow include frequent information transfers, clinical reasoning absent in documents, conflicting and redundant data across documents and applications, and that clinicians are burdened as information managers. This research also shows there is enormous variation in how clinicians interact with electronic health records (EHRs) to complete routine tasks. Variation is best evidenced by patterns that occur for only one patient case and patterns that contain repeated events. Variation is associated with the users’ experience (EHR and clinical), patient case complexity, and a lack of cognitive support provided by the system to help the user find and synthesize information. The methodology is used to assess how health IT can be improved to better support clinicians’ information management and coordination processes (e.g., context-sensitive design), and to inform how resources can best be allocated for clinician observation and training.Dissertation/ThesisDoctoral Dissertation Biomedical Informatics 201

Electronic Falls Reporting System Implementation: Evaluating Data Collection Methods and Studying User Acceptance

In this research, we detail the development of a novel, easy-to-use system to facilitate electronic patient falls reporting within a long-term residential care facility (LTRCF) using off-the-shelf technology that can be inexpensively implemented in a wide variety of settings. We report the results of four complimentary system evaluation measures that take into consideration varied organizational stakeholders’ perspectives: 1) System-level benefits and costs, 2) System usability, via scenario-based use cases, 3) A holistic assessment of users’ physical, cognitive, and marcoergonomic (work system) challenges in using the system, and 4) User technology acceptance. We report the viability of collecting and analyzing data specific to each evaluation measure and detail the relative merits of each measure in judging whether the system is acceptable to each stakeholder. The electronic falls reporting system was successfully implemented, with 100% electronic submission rate at 3-months post-implementation period. The system-level benefits and costs approach showed that the electronic system required no initial investment costs aside from personnel costs and significant benefits accrued from user time savings. The usability analysis revealed several fixable design flaws and demonstrated the importance of scenario-based user training. The technology acceptance model showed that users perceived the reporting system to be useful and easy to use, even more so after implementation. Finally, the holistic human factors evaluation identified challenges encountered when nurses used the system as a part of their daily work, guiding further system redesign. The four-pronged evaluation framework accounted for varied stakeholder perspectives and goals and is a highly scalable framework that can be easily applied to Health IT (Information Technology) implementations in other LTRCFs

A Fit between Clinical Workflow and Health Care Information Systems: Not waiting for Godot but making the journey

Health care has long suffered from inefficiencies due to the fragmentation of patient care information and the lack of coordination between health professionals [1]. Health care information systems (HISs) have been lauded as tools to remedy such inefficiencies [2, 3]. The primary idea behind the support of their implementation in health care is that these systems support clinical workflow and thereby decrease medical errors [2]. However, their introduction to health care settings have been accompanied by a transformation of the way their primary users, care providers, carry out clinical tasks and establish or maintain work relationships [4]. Studies have shown that these transformations have not always been productive [5, 6]

How Do Clinical Information Systems Affect the Cognitive Demands of General Practitioners?: Usability Study with a Focus on Cognitive Workload

oai:ojs.hijournal.bcs.org:article/85Background Clinical information systems in the National Health Service do not need to conform to any explicit usability requirements. Poor usability can increase the mental workload experienced by clinicians and cause fatigue, increase error rates and impact the overall patient safety. Mental workload can be used as a measure of usability.Objective To assess the subjective cognitive workload experienced by general practitioners (GPs) with their systems. To raise awareness of the importance of usability in system design among users, designers, developers and policymakers.Methods We used a modified version of the NASA Task Load Index, adapted for web. We developed a set of common clinical scenarios and computer tasks on an online survey. We emailed the study link to 199 clinical commissioning groups and 1,646 GP practices in England. Results Sixty-seven responders completed the survey. The respondents had spent an average of 17 years in general practice, had experience of using a mean of 1.5 GP computer systems and had used their current system for a mean time of 6.7 years. The mental workload score was not different among systems. There were significant differences among the task scores, but these differences were not specific to particular systems. The overall score and task scores were related to the length of experience with their present system. Conclusion Four tasks imposed a higher mental workload on GPs: ‘repeat prescribing’, ‘find episode’, ‘drug management’ and ‘overview records’. Further usability studies on GP systems should focus on these tasks. Users, policymakers, designers and developers should remain aware of the importance of usability in system design.What does this study add?• Current GP systems in England do not need to conform to explicit usability requirements. Poor usability can increase the mental workload of clinicians and lead to errors.• Some clinical computer tasks incur more cognitive workload than others and should be considered carefully during the design of a system.• GPs did not report overall very high levels of subjective cognitive workload when undertaking common clinical tasks with their systems.• Further usability studies on GP systems should focus on the tasks incurring higher cognitive workload.• Users, policymakers, and designers and developers should remain aware of the importance of usability in system design.

Constructive eHealth evaluation:Lessons from evaluation of EHR development in 4 Danish hospitals

Abstract Background Information and communication sources in the healthcare sector are replaced with new eHealth technologies. This has led to problems arising from the lack of awareness of the importance of end-user involvement in eHealth development and of the difficulties caused by using traditional summative evaluation methods. The Constructive eHealth evaluation method (CeHEM) provides a solution to these problems by offering an evaluation framework for supporting and facilitating end-user involvement during all phases of eHealth development. The aim of this paper is to support this process by sharing experiences of the eHealth evaluation method used in the introduction of electronic health records (EHR) in the North Denmark Region of Denmark. It is the first time the fully developed method and the experiences on using the CeHEM in all five phases of a full lifecycle framework is presented. Methods A case study evaluation of the EHR development process in the North Denmark Region was conducted from 2004 to 2010. The population consisted of clinicians, IT professionals, administrators, and vendors. The study involved 4 hospitals in the region. Data were collected using questionnaires, observations, interviews, and insight gathered from relevant documents. Results The evaluation showed a need for a) Early involvement of clinicians, b) The best possible representation of clinicians, and c) Workload reduction for those involved. The consequences of not providing this were a lack of ownership of decisions and negative attitudes towards the clinical benefits related to these decisions. Further, the result disclosed that by following the above recommendations, and by providing feedback to the 4 actor groups, the physicians’ involvement was improved. As a result they took ownership of decisions and gained a positive attitude to the clinical benefits. Conclusions The CeHEM has proven successful in formative evaluation of EHR development and can point at important issues that need to be taken care of by management. The method provides a framework that takes care of feedback and learning during eHealth development. It can thus support successful eHealth development in a broader context while building on a well-known success factor: end-user involvement in eHealth development

A human-factors approach to capture medical device safety, performance and usability

Advances in medical technology including computer aided and robotic surgery, digital health and increased use of portable devices have improved patient care in both hospital and home environments. These advancements have brought an increased level of complexity in patient care with new challenges to both patients and clinicians. The available performance data on medical devices (MD) is scarce and of variable quality despite work from regulatory bodies, with multiple associated challenges and lack of effective systems in place for its collection. This research used human factor methods to address i) the current state of safety and performance data availability for MDs and ii) methods of capturing safety and usability data in hospital and home environments by using human factor methods. Part A of this thesis concentrated on hospital based devices whilst Part B addressed home use MDs. End user experiences were utilised throughout to gain an understanding of the current system including its challenges and reasons leading to lack of data. Patients, clinicians, manufacturers, human factor specialists and MHRA were involved at all stages of this research. The studies led to the developments of the pathway map to reporting and information transfer in operating theatres and furthermore the development and initial evaluation of the MD-PRS concept (Medical Device Performance Reporting System) as a single dedicated method of reporting all MD malfunctions/ failures. The My-VID usability tool (My Voice in Design) was developed and evaluated as a method for collecting usability data directly from patients on home use MDs. In conclusion, this thesis used human factor methods to better understand the current system of data collection, available data sources on MDs and challenges faced prior to developing methods for improvement, based on end user experiences . Finally, methods of applying this research to clinical practice were addressed in the final chapter.Open Acces