Improving Visual-Patient-Avatar Design Prior to Its Clinical Release: A Mixed Qualitative and Quantitative Study

Visual-Patient-avatar, an avatar-based visualisation of patient monitoring, is a newly developed technology aiming to promote situation awareness through user-centred design. Before the technology’s introduction into clinical practice, the initial design used to validate the concept had to undergo thorough examination and adjustments where necessary. This mixed qualitative and quantitative study, consisting of three different study parts, aimed to create a design with high user acceptance regarding perceived professionalism and potential for identification while maintaining its original functionality. The first qualitative part was based on structured interviews and explored anaesthesia personnel’s first impressions regarding the original design. Recurrent topics were identified using inductive coding, participants’ interpretations of the vital sign visualisations analysed and design modifications derived. The second study part consisted of a redesign process, in which the visualisations were adapted according to the results of the first part. In a third, quantitative study part, participants rated Likert scales about Visual-Patient-avatar’s appearance and interpreted displayed vital signs in a computer-based survey. The first, qualitative study part included 51 structured interviews. Twenty-eight of 51 (55%) participants mentioned the appearance of Visual-Patient-avatar. In 23 of 51 (45%) interviews, 26 statements about the general impression were identified with a balanced count of positive (14 of 26) and negative (12 of 26) comments. The analysis of vital sign visualisations showed deficits in several vital sign visualisations, especially central venous pressure. These findings were incorporated into part two, the redesign of Visual-Patient-avatar. In the subsequent quantitative analysis of study for part three, 20 of 30 (67%) new participants agreed that the avatar looks professional enough for medical use. Finally, the participants identified 73% (435 of 600 cases) of all vital sign visualisations intuitively correctly without prior instruction. This study succeeded in improving the original design with good user acceptance and a reasonable degree of intuitiveness of the new, revised design. Furthermore, the study identified aspects relevant for the release of Visual-Patient-avatar, such as the requirement for providing at least some training, despite the design’s intuitiveness. The results of this study will guide further research and improvement of the technology. The study provides a link between Visual-Patient-avatar as a scientific concept and as an actual product from a cognitive engineering point of view, and may serve as an example of methods to study the designs of technologies in similar contexts

User Perceptions of Different Vital Signs Monitor Modalities During High-Fidelity Simulation: Semiquantitative Analysis

Background: Patient safety during anesthesia is crucially dependent on the monitoring of vital signs. However, the values obtained must also be perceived and correctly classified by the attending care providers. To facilitate these processes, we developed Visual-Patient-avatar, an animated virtual model of the monitored patient, which innovatively presents numerical and waveform data following user-centered design principles. After a high-fidelity simulation study, we analyzed the participants' perceptions of 3 different monitor modalities, including this newly introduced technique. Objective: The aim of this study was to collect and evaluate participants' opinions and experiences regarding 3 different monitor modalities, which are Visual-Patient-avatar, Split Screen (avatar and Conventional monitor alongside each other), and Conventional monitor after using them during simulated critical anesthetic events. Methods: This study was a researcher-initiated, single-center, semiquantitative study. We asked 92 care providers right after finishing 3 simulated emergency scenarios about their positive and negative opinions concerning the different monitor modalities. We processed the field notes obtained and derived the main categories and corresponding subthemes following qualitative research methods. Results: We gained a total of 307 statements. Through a context-based analysis, we identified the 3 main categories of "Visual-Patient-avatar," "Split Screen," and "Conventional monitor" and divided them into 11 positive and negative subthemes. We achieved substantial interrater reliability in assigning the statements to 1 of the topics. Most of the statements concerned the design and usability features of the avatar or the Split Screen mode. Conclusions: This study semiquantitatively reviewed the clinical applicability of the Visual-Patient-avatar technique in a high-fidelity simulation study and revealed the strengths and limitations of the avatar only and Split Screen modality. In addition to valuable suggestions for improving the design, the requirement for training prior to clinical implementation was emphasized. The responses to the Split Screen suggest that this symbiotic modality generates better situation awareness in combination with numerical data and accurate curves. As a subsequent development step, a real-life introduction study is planned, where we will test the avatar in Split Screen mode under actual clinical conditions. Keywords: avatar; patient monitoring; semiquantitative research; simulation study; situation awareness; user-centered design; visual-patient-avata

Visual Attention of Anesthesia Providers in Simulated Anesthesia Emergencies Using Conventional Number-Based and Avatar-Based Patient Monitoring: Prospective Eye-Tracking Study

Background: Inadequate situational awareness accounts for two-thirds of preventable complications in anesthesia. An essential tool for situational awareness in the perioperative setting is the patient monitor. However, the conventional monitor has several weaknesses. Avatar-based patient monitoring may address these shortcomings and promote situation awareness, a prerequisite for good decision making. Objective: The spatial distribution of visual attention is a fundamental process for achieving adequate situation awareness and thus a potential quantifiable surrogate for situation awareness. Moreover, measuring visual attention with a head-mounted eye-tracker may provide insights into usage and acceptance of the new avatar-based patient monitoring modality. Methods: This prospective eye-tracking study compared anesthesia providers' visual attention on conventional and avatar-based patient monitors during simulated critical anesthesia events. We defined visual attention, measured as fixation count and dwell time, as our primary outcome. We correlated visual attention with the potential confounders: performance in managing simulated critical anesthesia events (task performance), work experience, and profession. We used mixed linear models to analyze the results. Results: Fifty-two teams performed 156 simulations. After a manual quality check of the eye-tracking footage, we excluded 57 simulations due to technical problems and quality issues. Participants had a median of 198 (IQR 92.5-317.5) fixations on the patient monitor with a median dwell time of 30.2 (IQR 14.9-51.3) seconds. We found no significant difference in participants' visual attention when using avatar-based patient monitoring or conventional patient monitoring. However, we found that with each percentage point of better task performance, the number of fixations decreased by about 1.39 (coefficient -1.39; 95% CI -2.44 to -0.34; P=.02), and the dwell time diminished by 0.23 seconds (coefficient -0.23; 95% CI: -0.4 to -0.06; P=.01). Conclusions: Using eye tracking, we found no significant difference in visual attention when anesthesia providers used avatar-based monitoring or conventional patient monitoring in simulated critical anesthesia events. However, we identified visual attention in conjunction with task performance as a surrogate for situational awareness. Keywords: Anesthesia; avatar based model; eye-tracking technology; patient monitoring; patient simulation; perioperative; simulated anesthesia; situation awareness; task performance; visual attention

Improved Task Performance, Low Workload, and User-Centered Design in Medical Diagnostic Equipment Enhance Decision Confidence of Anesthesia Providers: A Meta-Analysis and a Multicenter Online Survey

Decision confidence-the subjective belief to have made the right decision-is central in planning actions in a complex environment such as the medical field. It is unclear by which factors it is influenced. We analyzed a pooled data set of eight studies and performed a multicenter online survey assessing anesthesiologists' opinions on decision confidence. By applying mixed models and using multiple imputation to determine the effect of missing values from the dataset on the results, we investigated how task performance, perceived workload, the utilization of user-centered medical diagnostic devices, job, work experience, and gender affected decision confidence. The odds of being confident increased with better task performance (OR: 1.27, 95% CI: 0.94 to 1.7; p = 0.12; after multiple imputation OR: 3.19, 95% CI: 2.29 to 4.45; p < 0.001) and when user-centered medical devices were used (OR: 5.01, 95% CI: 3.67 to 6.85; p < 0.001; after multiple imputation OR: 3.58, 95% CI: 2.65 to 4.85; p < 0.001). The odds of being confident decreased with higher perceived workload (OR: 0.94, 95% CI: 0.93 to 0.95; p < 0.001; after multiple imputation, OR: 0.94, 95% CI: 0.93 to 0.95; p < 0.001). Other factors, such as gender, job, or professional experience, did not affect decision confidence. Most anesthesiologists who participated in the online survey agreed that task performance (25 of 30; 83%), perceived workload (24 of 30; 80%), work experience (28 of 30; 93%), and job (21 of 30; 70%) influence decision confidence. Improved task performance, lower perceived workload, and user-centered design in medical equipment enhanced the decision confidence of anesthesia providers. Keywords: diagnostic; diagnostic confidence; gender; online survey; over-confidence; self-assessment; under-confidence; user-centered design; workloa

Improved Task Performance, Low Workload, and User-Centered Design in Medical Diagnostic Equipment Enhance Decision Confidence of Anesthesia Providers: A Meta-Analysis and a Multicenter Online Survey

Decision confidence-the subjective belief to have made the right decision-is central in planning actions in a complex environment such as the medical field. It is unclear by which factors it is influenced. We analyzed a pooled data set of eight studies and performed a multicenter online survey assessing anesthesiologists' opinions on decision confidence. By applying mixed models and using multiple imputation to determine the effect of missing values from the dataset on the results, we investigated how task performance, perceived workload, the utilization of user-centered medical diagnostic devices, job, work experience, and gender affected decision confidence. The odds of being confident increased with better task performance (OR: 1.27, 95% CI: 0.94 to 1.7; p = 0.12; after multiple imputation OR: 3.19, 95% CI: 2.29 to 4.45; p < 0.001) and when user-centered medical devices were used (OR: 5.01, 95% CI: 3.67 to 6.85; p < 0.001; after multiple imputation OR: 3.58, 95% CI: 2.65 to 4.85; p < 0.001). The odds of being confident decreased with higher perceived workload (OR: 0.94, 95% CI: 0.93 to 0.95; p < 0.001; after multiple imputation, OR: 0.94, 95% CI: 0.93 to 0.95; p < 0.001). Other factors, such as gender, job, or professional experience, did not affect decision confidence. Most anesthesiologists who participated in the online survey agreed that task performance (25 of 30; 83%), perceived workload (24 of 30; 80%), work experience (28 of 30; 93%), and job (21 of 30; 70%) influence decision confidence. Improved task performance, lower perceived workload, and user-centered design in medical equipment enhanced the decision confidence of anesthesia providers. Keywords: diagnostic; diagnostic confidence; gender; online survey; over-confidence; self-assessment; under-confidence; user-centered design; workloa

Physicians' perceptions of two ways of algorithm presentation: graphic versus text-based approach

Acute bleeding during surgery or after trauma harms patients, and challenges involved physicians. Protocols and cognitive aids can help in such situations. This dual-centre study investigated physicians' opinions regarding two ways to present cognitive aids, graphic ‘Haemostasis Traffic Light’ and text-based, using the example of a coagulation management algorithm to identify the strengths and limitations of both presentation modalities. Using qualitative research methods, we identified recurring answer patterns and derived major topics and subthemes through inductive coding. Eighty-four physicians participated. We assigned each half randomly to one of the cognitive aids (graphic/text-based) and determined 447 usable statements. We qualitatively deduced the importance of having a cognitive aid for physicians. Furthermore, it is noticeable that the graphic group made more positive comments (154 of 242 (64%) statements), while the text-based participants made more negative annotations (126 of 205 (61%) statements), suggesting a generally stronger approval of this cognitive aid

Anesthesia personnel’s visual attention regarding patient monitoring in simulated non-critical and critical situations, an eye-tracking study

Background: Cognitive ergonomics design of patient monitoring may reduce human factor errors in high-stress environments. Eye-tracking is a suitable tool to gain insight into the distribution of visual attention of healthcare professionals with patient monitors, which may facilitate their further development. Methods: This prospective, exploratory, high-fidelity simulation study compared anesthesia personnel's visual attention (fixation count and dwell-time) to 15 areas of interest on the patient monitor during non-critical and critical anesthesia situations. Furthermore, we examined the extent to which participants' experience influenced visual attention and which vital signs displayed on the patient monitor received the most visual attention. We used mixed zero-inflated Poisson regression and mixed linear models to analyze the data. Results: Analyzing 23 ten-minute scenarios, we found significantly more fixations to the areas of interest on the patient monitor during critical than non-critical situations (rate ratio of 1.45; 95% CI 1.33 to 1.59; p < 0.001). However, the dwell-time on the areas of interest did not significantly differ between the non-critical and critical situations (coefficient of - 1.667; 95% CI - 4.549 to 1.229; p = 0.27). The professional experience did not significantly influence the visual attention (fixation: rate ratio of 0.88; 95% CI 0.54 to 1.43; p = 0.61 and dwell-time: coefficient of 0.889; 95% CI - 1.465 to 3.229; p = 0.27). Over all situations, anesthesia personnel paid the most attention to the vital signs blood pressure (fixation: mean [SD] of 108 [74.83]; dwell-time: mean [SD] of 27 [15.90] seconds), end-expiratory carbon dioxide (fixation: mean [SD] of 59 [47.39]; dwell-time: mean [SD] of 30 [21.51] seconds), and the electrocardiogram (fixation: mean [SD] of 58 [64.70]; dwell-time: mean [SD] of 15 [14.95] seconds). Conclusions: Critical anesthesia situations increased anesthesia personnel's visual interaction with the patient monitor. Furthermore, we found that their visual attention focused mainly on a few vital signs. To assist clinicians in critical situations, manufacturers should optimize monitors to convey necessary information as easily and quickly as possible and optimize the visibility of less frequently observed but equally critical vital signs, especially when they are in an abnormal range. Keywords: Anesthesia, general; Eye-tracking technology; Patient monitoring; Patient simulation; Situation awareness; Visual attention

Faster Time to Treatment Decision of Viscoelastic Coagulation Test Results through Improved Perception with the Animated Visual Clot: A Multicenter Comparative Eye-Tracking Study

As the interpretation of viscoelastic coagulation test results remains challenging, we created Visual Clot, an animated blood clot aiming to facilitate raw rotational thromboelastometry (ROTEM) parameters. This study investigated anesthesia personnel's cognitive processing in managing simulated bleeding scenarios using eye-tracking technology. This multicenter, international, computer-based study across five large, central European hospitals included 35 participants with minimal to no prior experience interpreting viscoelastic test results. Using eye-tracking technology and an iPad tagged with quick response codes, we defined the time to treatment decision and the time on screen surface in seconds of correctly solved scenarios as our outcomes. The median time to treatment decision was 52 s for Visual Clot and 205 s for ROTEM (p &lt; 0.0001). The probability of solving the scenario correctly was more than 8 times higher when using Visual Clot than when using ROTEM (Hazard ratio [HR] 8.54, 95% CI from 6.5 to 11.21; p &lt; 0.0001). Out of 194 correctly answered scenarios of participants with the eye-tracker, 154 (79.4%) were solved with Visual Clot and 40 (20.6%) with ROTEM. Participants spent on average 30 s less looking at the screen surface with Visual Clot compared to ROTEM (Coefficient -30.74 s, 95% CI from -39.27 to -22.27; p &lt; 0.0001). For a comparison of the two modalities in terms of information transfer, we calculated the percentage of time on the screen surface of the overall time to treatment decision, which with Visual Clot was 14 percentage points shorter than with ROTEM (Coefficient -14.55, 95% CI from -20.05 to -9.12; p &lt; 0.0001). Visual Clot seems to improve perception and detection of coagulopathies and leads to earlier initiation of the appropriate treatment. In a high-pressure working environment such as the operating and the resuscitation room, correct and timely decisions regarding bleeding management may have a relevant impact on patients' outcomes. Keywords: Visual Clot; avatar; blood coagulation; eye-tracking; point-of-care; rotational thromboelastometry; viscoelastic test; visual perception

Avatar-based patient monitoring improves information transfer, diagnostic confidence and reduces perceived workload in intensive care units: computer-based, multicentre comparison study

Patient monitoring is the foundation of intensive care medicine. High workload and information overload can impair situation awareness of staff, thus leading to loss of important information about patients’ conditions. To facilitate mental processing of patient monitoring data, we developed the Visual-Patient-avatar Intensive Care Unit (ICU), a virtual patient model animated from vital signs and patient installation data. It incorporates user-centred design principles to foster situation awareness. This study investigated the avatar’s effects on information transfer measured by performance, diagnostic confidence and perceived workload. This computer-based study compared Visual-Patient-avatar ICU and conventional monitor modality for the first time. We recruited 25 nurses and 25 physicians from five centres. The participants completed an equal number of scenarios in both modalities. Information transfer, as the primary outcome, was defined as correctly assessing vital signs and installations. Secondary outcomes included diagnostic confidence and perceived workload. For analysis, we used mixed models and matched odds ratios. Comparing 250 within-subject cases revealed that Visual-Patient-avatar ICU led to a higher rate of correctly assessed vital signs and installations [rate ratio (RR) 1.25; 95% CI 1.19–1.31; P < 0.001], strengthened diagnostic confidence [odds ratio (OR) 3.32; 95% CI 2.15–5.11, P < 0.001] and lowered perceived workload (coefficient − 7.62; 95% CI − 9.17 to − 6.07; P < 0.001) than conventional modality. Using Visual-Patient-avatar ICU, participants retrieved more information with higher diagnostic confidence and lower perceived workload compared to the current industry standard monitor

Emergence of contact injuries in invasion team sports : an ecological dynamics rationale

The incidence of contact injuries in team sports is considerable, and injury mechanisms need to be comprehensively understood to facilitate the adoption of preventive measures. In Association Football, evidence shows that the highest prevalence of contact injuries emerges in one-on-one interactions. However, previous studies have tended to operationally report injury mechanisms in isolation, failing to provide a theoretical rationale to explain how injuries might emerge from interactions between opposing players. In this position paper, we propose an ecological dynamics framework to enhance current understanding of behavioural processes leading to contact injuries in team sports. Based on previous research highlighting the dynamics of performer–environment interactions, contact injuries are proposed to emerge from symmetry-breaking processes during on-field interpersonal interactions among competing players and the ball. Central to this approach is consideration of candidate control parameters that may provide insights on the information sources used by players to reduce risk of contact injuries during performance. Clinically, an ecological dynamics analysis could allow sport practitioners to design training sessions based on selected parameter threshold values as primary and/or secondary preventing measures during training and rehabilitation sessions