7 research outputs found
Strategies for engaging clinical participants in the co-design of software for healthcare domains
Co-design is an effective method for designing software, but implementing it
within the clinical setting comes with a set of unique challenges. This makes
recruitment and engagement of participants difficult, which has been
demonstrated in our study. Our work focused on designing and evaluating a data
annotation tool, however, different types of interventions had to be carried
out due to poor engagement with the study. We evaluated the effectiveness and
feasibility of each of these strategies, their applicability to different
stages of co-design research and discussed the barriers to participation
present among participants from a clinical background.Comment: 4 pages, 4 figures, presented at Workgroup on Interactive Systems in
Healthcare (WISH) Symposium at ACM (Association of Computing Machinery) CHI
conference on Human Factors in Computing Systems in Hamburg 202
Capturing Requirements for a Data Annotation Tool for Intensive Care: Experimental User-Centered Design Study
Intensive care units (ICUs) are complex and data-rich environments. Data
routinely collected in the ICUs provides tremendous opportunities for machine
learning, but their use comes with significant challenges. Complex problems may
require additional input from humans which can be provided through a process of
data annotation. Annotation is a complex, time-consuming process that requires
domain expertise and technical proficiency. Existing data annotation tools fail
to provide an effective solution to this problem. In this study, we
investigated clinicians' approach to the annotation task. We focused on
establishing the characteristics of the annotation process in the context of
clinical data and identifying differences in the annotation workflow between
different staff roles. The overall goal was to elicit requirements for a
software tool that could facilitate an effective and time-efficient data
annotation. We conducted an experiment involving clinicians from the ICUs
annotating printed sheets of data. The participants were observed during the
task and their actions were analysed in the context of Norman's Interaction
Cycle to establish the requirements for the digital tool. The annotation
process followed a constant loop of annotation and evaluation, during which
participants incrementally analysed and annotated the data. No distinguishable
differences were identified between how different staff roles annotate data. We
observed preferences towards different methods for applying annotation which
varied between different participants and admissions. We established 11
requirements for the digital data annotation tool for the healthcare setting.
We conducted a manual data annotation activity to establish the requirements
for a digital data annotation tool, characterised the clinicians' approach to
annotation and elicited 11 key requirements for effective data annotation
software
Requirements for a Bespoke Intensive Care Unit Dashboard in Response to the COVID-19 Pandemic:Semistructured Interview Study
BACKGROUND: Intensive care units (ICUs) around the world are in high demand due to patients with COVID-19 requiring hospitalization. As researchers at the University of Bristol, we were approached to develop a bespoke data visualization dashboard to assist two local ICUs during the pandemic that will centralize disparate data sources in the ICU to help reduce the cognitive load on busy ICU staff in the ever-evolving pandemic. OBJECTIVE: The aim of this study was to conduct interviews with ICU staff in University Hospitals Bristol and Weston National Health Service Foundation Trust to elicit requirements for a bespoke dashboard to monitor the high volume of patients, particularly during the COVID-19 pandemic. METHODS: We conducted six semistructured interviews with clinical staff to obtain an overview of their requirements for the dashboard and to ensure its ultimate suitability for end users. Interview questions aimed to understand the job roles undertaken in the ICU, potential uses of the dashboard, specific issues associated with managing COVID-19 patients, key data of interest, and any concerns about the introduction of a dashboard into the ICU. RESULTS: From our interviews, we found the following design requirements: (1) a flexible dashboard, where the functionality can be updated quickly and effectively to respond to emerging information about the management of this new disease; (2) a mobile dashboard, which allows staff to move around on wards with a dashboard, thus potentially replacing paper forms to enable detailed and consistent data entry; (3) a customizable and intuitive dashboard, where individual users would be able to customize the appearance of the dashboard to suit their role; (4) real-time data and trend analysis via informative data visualizations that help busy ICU staff to understand a patient’s clinical trajectory; and (5) the ability to manage tasks and staff, tracking both staff and patient movements, handovers, and task monitoring to ensure the highest quality of care. CONCLUSIONS: The findings of this study confirm that digital solutions for ICU use would potentially reduce the cognitive load of ICU staff and reduce clinical errors at a time of notably high demand of intensive health care
Requirements for a Bespoke Intensive Care Unit Dashboard in Response to the COVID-19 Pandemic: Semistructured Interview Study (Preprint)
BACKGROUND: Intensive care units (ICUs) around the world are in high demand due to patients with COVID-19 requiring hospitalization. As researchers at the University of Bristol, we were approached to develop a bespoke data visualization dashboard to assist two local ICUs during the pandemic that will centralize disparate data sources in the ICU to help reduce the cognitive load on busy ICU staff in the ever-evolving pandemic. OBJECTIVE: The aim of this study was to conduct interviews with ICU staff in University Hospitals Bristol and Weston National Health Service Foundation Trust to elicit requirements for a bespoke dashboard to monitor the high volume of patients, particularly during the COVID-19 pandemic. METHODS: We conducted six semistructured interviews with clinical staff to obtain an overview of their requirements for the dashboard and to ensure its ultimate suitability for end users. Interview questions aimed to understand the job roles undertaken in the ICU, potential uses of the dashboard, specific issues associated with managing COVID-19 patients, key data of interest, and any concerns about the introduction of a dashboard into the ICU. RESULTS: From our interviews, we found the following design requirements: (1) a flexible dashboard, where the functionality can be updated quickly and effectively to respond to emerging information about the management of this new disease; (2) a mobile dashboard, which allows staff to move around on wards with a dashboard, thus potentially replacing paper forms to enable detailed and consistent data entry; (3) a customizable and intuitive dashboard, where individual users would be able to customize the appearance of the dashboard to suit their role; (4) real-time data and trend analysis via informative data visualizations that help busy ICU staff to understand a patient’s clinical trajectory; and (5) the ability to manage tasks and staff, tracking both staff and patient movements, handovers, and task monitoring to ensure the highest quality of care. CONCLUSIONS: The findings of this study confirm that digital solutions for ICU use would potentially reduce the cognitive load of ICU staff and reduce clinical errors at a time of notably high demand of intensive health care
Design and Evaluation of an Intensive Care Unit Dashboard Built in Response to the COVID-19 Pandemic: Semistructured Interview Study
BackgroundDashboards and interactive displays are becoming increasingly prevalent in most health care settings and have the potential to streamline access to information, consolidate disparate data sources and deliver new insights. Our research focuses on intensive care units (ICUs) which are heavily instrumented, critical care environments that generate vast amounts of data and frequently require individualized support for each patient. Consequently, clinicians experience a high cognitive load, which can translate to suboptimal performance. The global COVID-19 pandemic exacerbated this problem by generating a large number of additional hospitalizations, which necessitated a new tool that would help manage ICUs’ census. In a previous study, we interviewed clinicians at the University Hospitals Bristol and Weston National Health Service Foundation Trust to capture the requirements for bespoke dashboards that would alleviate this problem.
ObjectiveThis study aims to design, implement, and evaluate an ICU dashboard to allow for monitoring of the high volume of patients in need of critical care, particularly tailored to high-demand situations, such as those seen during the COVID-19 pandemic.
MethodsBuilding upon the previously gathered requirements, we developed a dashboard, integrated it within the ICU of a National Health Service trust, and allowed all staff to access our tool. For evaluation purposes, participants were recruited and interviewed following a 25-day period during which they were able to use the dashboard clinically. The semistructured interviews followed a topic guide aimed at capturing the usability of the dashboard, supplemented with additional questions asked post hoc to probe themes established during the interview. Interview transcripts were analyzed using a thematic analysis framework that combined inductive and deductive approaches and integrated the Technology Acceptance Model.
ResultsA total of 10 participants with 4 different roles in the ICU (6 consultants, 2 junior doctors, 1 nurse, and 1 advanced clinical practitioner) participated in the interviews. Our analysis generated 4 key topics that prevailed across the data: our dashboard met the usability requirements of the participants and was found useful and intuitive; participants perceived that it impacted their delivery of patient care by improving the access to the information and better equipping them to do their job; the tool was used in a variety of ways and for different reasons and tasks; and there were barriers to integration of our dashboard into practice, including familiarity with existing systems, which stifled the adoption of our tool.
ConclusionsOur findings show that the perceived utility of the dashboard had a positive impact on the clinicians’ workflows in the ICU. Improving access to information translated into more efficient patient care and transformed some of the existing processes. The introduction of our tool was met with positive reception, but its integration during the COVID-19 pandemic limited its adoption into practice