User Perceptions of Different Vital Signs Monitor Modalities During High-Fidelity Simulation: Semiquantitative Analysis

Background: Patient safety during anesthesia is crucially dependent on the monitoring of vital signs. However, the values obtained must also be perceived and correctly classified by the attending care providers. To facilitate these processes, we developed Visual-Patient-avatar, an animated virtual model of the monitored patient, which innovatively presents numerical and waveform data following user-centered design principles. After a high-fidelity simulation study, we analyzed the participants' perceptions of 3 different monitor modalities, including this newly introduced technique. Objective: The aim of this study was to collect and evaluate participants' opinions and experiences regarding 3 different monitor modalities, which are Visual-Patient-avatar, Split Screen (avatar and Conventional monitor alongside each other), and Conventional monitor after using them during simulated critical anesthetic events. Methods: This study was a researcher-initiated, single-center, semiquantitative study. We asked 92 care providers right after finishing 3 simulated emergency scenarios about their positive and negative opinions concerning the different monitor modalities. We processed the field notes obtained and derived the main categories and corresponding subthemes following qualitative research methods. Results: We gained a total of 307 statements. Through a context-based analysis, we identified the 3 main categories of "Visual-Patient-avatar," "Split Screen," and "Conventional monitor" and divided them into 11 positive and negative subthemes. We achieved substantial interrater reliability in assigning the statements to 1 of the topics. Most of the statements concerned the design and usability features of the avatar or the Split Screen mode. Conclusions: This study semiquantitatively reviewed the clinical applicability of the Visual-Patient-avatar technique in a high-fidelity simulation study and revealed the strengths and limitations of the avatar only and Split Screen modality. In addition to valuable suggestions for improving the design, the requirement for training prior to clinical implementation was emphasized. The responses to the Split Screen suggest that this symbiotic modality generates better situation awareness in combination with numerical data and accurate curves. As a subsequent development step, a real-life introduction study is planned, where we will test the avatar in Split Screen mode under actual clinical conditions. Keywords: avatar; patient monitoring; semiquantitative research; simulation study; situation awareness; user-centered design; visual-patient-avata

Improving Visual-Patient-Avatar Design Prior to Its Clinical Release: A Mixed Qualitative and Quantitative Study

Visual-Patient-avatar, an avatar-based visualisation of patient monitoring, is a newly developed technology aiming to promote situation awareness through user-centred design. Before the technology’s introduction into clinical practice, the initial design used to validate the concept had to undergo thorough examination and adjustments where necessary. This mixed qualitative and quantitative study, consisting of three different study parts, aimed to create a design with high user acceptance regarding perceived professionalism and potential for identification while maintaining its original functionality. The first qualitative part was based on structured interviews and explored anaesthesia personnel’s first impressions regarding the original design. Recurrent topics were identified using inductive coding, participants’ interpretations of the vital sign visualisations analysed and design modifications derived. The second study part consisted of a redesign process, in which the visualisations were adapted according to the results of the first part. In a third, quantitative study part, participants rated Likert scales about Visual-Patient-avatar’s appearance and interpreted displayed vital signs in a computer-based survey. The first, qualitative study part included 51 structured interviews. Twenty-eight of 51 (55%) participants mentioned the appearance of Visual-Patient-avatar. In 23 of 51 (45%) interviews, 26 statements about the general impression were identified with a balanced count of positive (14 of 26) and negative (12 of 26) comments. The analysis of vital sign visualisations showed deficits in several vital sign visualisations, especially central venous pressure. These findings were incorporated into part two, the redesign of Visual-Patient-avatar. In the subsequent quantitative analysis of study for part three, 20 of 30 (67%) new participants agreed that the avatar looks professional enough for medical use. Finally, the participants identified 73% (435 of 600 cases) of all vital sign visualisations intuitively correctly without prior instruction. This study succeeded in improving the original design with good user acceptance and a reasonable degree of intuitiveness of the new, revised design. Furthermore, the study identified aspects relevant for the release of Visual-Patient-avatar, such as the requirement for providing at least some training, despite the design’s intuitiveness. The results of this study will guide further research and improvement of the technology. The study provides a link between Visual-Patient-avatar as a scientific concept and as an actual product from a cognitive engineering point of view, and may serve as an example of methods to study the designs of technologies in similar contexts

Faster Time to Treatment Decision of Viscoelastic Coagulation Test Results through Improved Perception with the Animated Visual Clot: A Multicenter Comparative Eye-Tracking Study

As the interpretation of viscoelastic coagulation test results remains challenging, we created Visual Clot, an animated blood clot aiming to facilitate raw rotational thromboelastometry (ROTEM) parameters. This study investigated anesthesia personnel's cognitive processing in managing simulated bleeding scenarios using eye-tracking technology. This multicenter, international, computer-based study across five large, central European hospitals included 35 participants with minimal to no prior experience interpreting viscoelastic test results. Using eye-tracking technology and an iPad tagged with quick response codes, we defined the time to treatment decision and the time on screen surface in seconds of correctly solved scenarios as our outcomes. The median time to treatment decision was 52 s for Visual Clot and 205 s for ROTEM (p < 0.0001). The probability of solving the scenario correctly was more than 8 times higher when using Visual Clot than when using ROTEM (Hazard ratio [HR] 8.54, 95% CI from 6.5 to 11.21; p < 0.0001). Out of 194 correctly answered scenarios of participants with the eye-tracker, 154 (79.4%) were solved with Visual Clot and 40 (20.6%) with ROTEM. Participants spent on average 30 s less looking at the screen surface with Visual Clot compared to ROTEM (Coefficient -30.74 s, 95% CI from -39.27 to -22.27; p < 0.0001). For a comparison of the two modalities in terms of information transfer, we calculated the percentage of time on the screen surface of the overall time to treatment decision, which with Visual Clot was 14 percentage points shorter than with ROTEM (Coefficient -14.55, 95% CI from -20.05 to -9.12; p < 0.0001). Visual Clot seems to improve perception and detection of coagulopathies and leads to earlier initiation of the appropriate treatment. In a high-pressure working environment such as the operating and the resuscitation room, correct and timely decisions regarding bleeding management may have a relevant impact on patients' outcomes. Keywords: Visual Clot; avatar; blood coagulation; eye-tracking; point-of-care; rotational thromboelastometry; viscoelastic test; visual perception

Improved Task Performance, Low Workload, and User-Centered Design in Medical Diagnostic Equipment Enhance Decision Confidence of Anesthesia Providers: A Meta-Analysis and a Multicenter Online Survey

Decision confidence-the subjective belief to have made the right decision-is central in planning actions in a complex environment such as the medical field. It is unclear by which factors it is influenced. We analyzed a pooled data set of eight studies and performed a multicenter online survey assessing anesthesiologists' opinions on decision confidence. By applying mixed models and using multiple imputation to determine the effect of missing values from the dataset on the results, we investigated how task performance, perceived workload, the utilization of user-centered medical diagnostic devices, job, work experience, and gender affected decision confidence. The odds of being confident increased with better task performance (OR: 1.27, 95% CI: 0.94 to 1.7; p = 0.12; after multiple imputation OR: 3.19, 95% CI: 2.29 to 4.45; p < 0.001) and when user-centered medical devices were used (OR: 5.01, 95% CI: 3.67 to 6.85; p < 0.001; after multiple imputation OR: 3.58, 95% CI: 2.65 to 4.85; p < 0.001). The odds of being confident decreased with higher perceived workload (OR: 0.94, 95% CI: 0.93 to 0.95; p < 0.001; after multiple imputation, OR: 0.94, 95% CI: 0.93 to 0.95; p < 0.001). Other factors, such as gender, job, or professional experience, did not affect decision confidence. Most anesthesiologists who participated in the online survey agreed that task performance (25 of 30; 83%), perceived workload (24 of 30; 80%), work experience (28 of 30; 93%), and job (21 of 30; 70%) influence decision confidence. Improved task performance, lower perceived workload, and user-centered design in medical equipment enhanced the decision confidence of anesthesia providers. Keywords: diagnostic; diagnostic confidence; gender; online survey; over-confidence; self-assessment; under-confidence; user-centered design; workloa

Improved Task Performance, Low Workload, and User-Centered Design in Medical Diagnostic Equipment Enhance Decision Confidence of Anesthesia Providers: A Meta-Analysis and a Multicenter Online Survey

Decision confidence-the subjective belief to have made the right decision-is central in planning actions in a complex environment such as the medical field. It is unclear by which factors it is influenced. We analyzed a pooled data set of eight studies and performed a multicenter online survey assessing anesthesiologists' opinions on decision confidence. By applying mixed models and using multiple imputation to determine the effect of missing values from the dataset on the results, we investigated how task performance, perceived workload, the utilization of user-centered medical diagnostic devices, job, work experience, and gender affected decision confidence. The odds of being confident increased with better task performance (OR: 1.27, 95% CI: 0.94 to 1.7; p = 0.12; after multiple imputation OR: 3.19, 95% CI: 2.29 to 4.45; p < 0.001) and when user-centered medical devices were used (OR: 5.01, 95% CI: 3.67 to 6.85; p < 0.001; after multiple imputation OR: 3.58, 95% CI: 2.65 to 4.85; p < 0.001). The odds of being confident decreased with higher perceived workload (OR: 0.94, 95% CI: 0.93 to 0.95; p < 0.001; after multiple imputation, OR: 0.94, 95% CI: 0.93 to 0.95; p < 0.001). Other factors, such as gender, job, or professional experience, did not affect decision confidence. Most anesthesiologists who participated in the online survey agreed that task performance (25 of 30; 83%), perceived workload (24 of 30; 80%), work experience (28 of 30; 93%), and job (21 of 30; 70%) influence decision confidence. Improved task performance, lower perceived workload, and user-centered design in medical equipment enhanced the decision confidence of anesthesia providers. Keywords: diagnostic; diagnostic confidence; gender; online survey; over-confidence; self-assessment; under-confidence; user-centered design; workloa

Visual Attention of Anesthesia Providers in Simulated Anesthesia Emergencies Using Conventional Number-Based and Avatar-Based Patient Monitoring: Prospective Eye-Tracking Study

Background: Inadequate situational awareness accounts for two-thirds of preventable complications in anesthesia. An essential tool for situational awareness in the perioperative setting is the patient monitor. However, the conventional monitor has several weaknesses. Avatar-based patient monitoring may address these shortcomings and promote situation awareness, a prerequisite for good decision making. Objective: The spatial distribution of visual attention is a fundamental process for achieving adequate situation awareness and thus a potential quantifiable surrogate for situation awareness. Moreover, measuring visual attention with a head-mounted eye-tracker may provide insights into usage and acceptance of the new avatar-based patient monitoring modality. Methods: This prospective eye-tracking study compared anesthesia providers' visual attention on conventional and avatar-based patient monitors during simulated critical anesthesia events. We defined visual attention, measured as fixation count and dwell time, as our primary outcome. We correlated visual attention with the potential confounders: performance in managing simulated critical anesthesia events (task performance), work experience, and profession. We used mixed linear models to analyze the results. Results: Fifty-two teams performed 156 simulations. After a manual quality check of the eye-tracking footage, we excluded 57 simulations due to technical problems and quality issues. Participants had a median of 198 (IQR 92.5-317.5) fixations on the patient monitor with a median dwell time of 30.2 (IQR 14.9-51.3) seconds. We found no significant difference in participants' visual attention when using avatar-based patient monitoring or conventional patient monitoring. However, we found that with each percentage point of better task performance, the number of fixations decreased by about 1.39 (coefficient -1.39; 95% CI -2.44 to -0.34; P=.02), and the dwell time diminished by 0.23 seconds (coefficient -0.23; 95% CI: -0.4 to -0.06; P=.01). Conclusions: Using eye tracking, we found no significant difference in visual attention when anesthesia providers used avatar-based monitoring or conventional patient monitoring in simulated critical anesthesia events. However, we identified visual attention in conjunction with task performance as a surrogate for situational awareness. Keywords: Anesthesia; avatar based model; eye-tracking technology; patient monitoring; patient simulation; perioperative; simulated anesthesia; situation awareness; task performance; visual attention

Checklisten in der Medizin

Einführung von medizinischen Checklisten, zu den WHO-Leitlinien für sichere Operationen und zu den wichtigsten Checklisten-Studien. Wir skizzieren die Vorteile von Checklisten und zu beachtende Überlegungen bei ihrer Einführung und geben Beispiele für verschiedene Checklisten. Wir kommen zu dem Schluss, dass Checklisten hilfreich sind und ihr bestmöglicher Nutzen von ihrer korrekten Umsetzung abhängt. = The Use of Checklists in Medicine Abstract. This mini-review highlights the success story of checklists in perioperative medicine. It provides a background to the introduction of medical checklists, the WHO Guidelines for Safe Surgery, and the most important checklist studies. We outline the advantages of checklists and possible difficulties in their implementation and provide examples of various checklists. We come to the conclusion that checklists are helpful and that their best potential benefit depends on their correct implementation. Keywords: Checklist; Checkliste; Liste de contrôle; Patientensicherheit; Situationsbewusstsein; Versorgungsqualität; conscience de la situation; facteurs humains; human factors; menschliches Leistungsvermögen; patient safety; quality of care; qualité des soins; situation awareness; sécurité des patients. = Cette mini-revue met en lumière l’histoire du succès des listes de contrôle dans la phase périopératoire. Elle décrit le contexte de l’introduction de ces listes, les directives de l’OMS pour une chirurgie sûre ainsi que les études les plus importantes les concernant. Dans cette mini-revue, nous décrivons les avantages des listes de contrôle tout comme les éventuelles difficultées à leur mise en œuvre et nous fournissons divers exemples. En conclusion, les listes de contrôle sont utiles, mais seulement avec leur utilisation correcte on en pourra tirer le plus grand bénéfice

The mechanisms responsible for improved information transfer in avatar-based patient monitoring: A Multicenter Comparative Eye-Tracking Study

Background: Patient monitoring is central to the safety of state-of-the-art perioperative and intensive care medicine. While current state-of-the-art patient monitors display vital signs in the form of numbers and curve forms, Visual Patient technology creates an easy to interpret virtual patient avatar model, which, in a previous study, enabled anesthesia providers to perceive more vital sign information during short glances than conventional monitoring. In this study, we used eye-tracking technology to study the deeper mechanisms underlying information perception in both, conventional and avatar-based patient monitoring. Objective:In this study, we used eye-tracking technology to study the deeper mechanisms underlying information perception in both, conventional and avatar-based patient monitoring. Methods: In this prospective, multi-center study with a within subject design, we showed 32 anesthesia experts (physicians and nurse anesthetists) a total of four 3- and 10-second monitoring scenarios alternatingly as either routine conventional or avatar-based monitoring in random sequence. All participants observed the same scenarios with both monitoring technologies. After each scenario, we asked participants to report the status of the vital signs. Using an eye-tracker, we recorded the participants’ gaze paths as they observed the scenarios. From the eye-tracking recordings, we evaluated which vital signs the participants had visually fixated, how often and for how long during a scenario, and therefore, could have potentially read and perceived this vital sign. We compared the frequencies and durations with which the participants had visually fixated the vital signs between the two monitoring technologies. Results: Participants visually fixated more vital signs per scenario, median (IQR): 10 (9-11) vs. 6 (4-8), p<0.001 in avatar-based monitoring (median of differences: 3 vital signs (95% confidence interval [95%CI 3-4]). In a multivariable linear regression, monitoring technology (conventional vs. avatar-based monitoring, difference -3.3, p<0.001) was an independent predictor of the number of visually fixated vital signs. Only scenario duration affected the difference in vital sign fixations between technologies. The difference was more prominent in 3-second scenarios, difference -1.5, p=0.04. Study center, profession, gender, and scenario order did not influence the differences between conventional and avatar-based monitoring. In all four scenarios, the participants visually fixated nine of the 11 total vital signs shown statistically significantly longer using the avatar (all p < 0.001). Four critical vital signs, i.e., pulse rate, blood pressure, oxygen saturation, and respiratory rate were visible almost the entire time of a scenario with avatar-based monitoring, while with conventional monitoring, these were only visible for fractions of the observations. Visual fixation of a certain vital sign was associated with the correct perception of that certain vital sign in both technologies. Phi coefficient for avatar: 0.358, for conventional monitoring: 0.515, both p<0.001. Conclusions: This study uncovered, by use of eye-tracking, one of the mechanisms responsible for the improved information transfer in avatar-based monitoring. The design of the avatar technology, which presents the information about multiple vital signs integrated into forms and colors of the corresponding anatomical parts of a patient model enabled parallel perception of multiple vital signs, and thereby increased the number of visually fixated vital signs and the time available to fixate each vital sign. With this finding confirmed by eye-tracking, this study adds a new and higher level of empirical evidence as to why avatar-based monitoring improves the perception of vital sign information compared to conventional monitoring

Avatar-based versus conventional vital sign display in a central monitor for monitoring multiple patients: a multicenter computer-based laboratory study

Background: Maintaining adequate situation awareness is crucial for patient safety. Previous studies found that the use of avatar-based monitoring (Visual Patient Technology) improved the perception of vital signs compared to conventional monitoring showing numerical and waveform data; and was further associated with a reduction of perceived workload. In this study, we aimed to evaluate the effectiveness of Visual Patient Technology on perceptive performance and perceived workload when monitoring multiple patients at the same time, such as in central station monitors in intensive care units or operating rooms. Methods: A prospective, within-subject, computer-based laboratory study was performed in two tertiary care hospitals in Switzerland in 2018. Thirty-eight physician and nurse anesthetists volunteered for the study. The participants were shown four different central monitor scenarios in sequence, where each scenario displayed two critical and four healthy patients simultaneously for 10 or 30 s. After each scenario, participants had to recall the vital signs of the critical patients. Perceived workload was assessed with the National Aeronautics and Space Administration Task-Load-Index (NASA TLX) questionnaire. Results: In the 10-s scenarios, the median number of remembered vital signs significantly improved from 7 to 11 using avatar-based versus conventional monitoring with a mean of differences of 4 vital signs, 95% confidence interval (CI) 2 to 6, p < 0.001. At the same time, the median NASA TLX scores were significantly lower for avatar-based monitoring (67 vs. 77) with a mean of differences of 6 points, 95% CI 0.5 to 11, p = 0.034. In the 30-s scenarios, vital sign perception and workload did not differ significantly. Conclusions: In central monitor multiple patient monitoring, we found a significant improvement of vital sign perception and reduction of perceived workload using Visual Patient Technology, compared to conventional monitoring. The technology enabled improved assessment of patient status and may, thereby, help to increase situation awareness and enhance patient safety

SafAIRway: an airway training for pulmonologists performing a flexible bronchoscopy with nonanesthesiologist administered propofol sedation: A prospective evaluation

Nonanesthesiologist administered propofol (NAAP) sedation for flexible bronchoscopy is controversial, because there is no established airway management (AM) training for pulmonologists. The aim was to investigate the performance and acceptance of a proposed AM algorithm and training for pulmonologists performing NAAP sedation. The algorithm includes using 3 maneuvers including bag mask ventilation (BMV), laryngeal tube (LT), and needle cricothyrotomy (NCT). During training (consisting of 2 sessions with a break of 9 weeks in between), these maneuvers were demonstrated and exercised, followed by 4 consecutive attempts to succeed with each of these devices. The primary outcome was the improvement of completion time needed for a competent airway. Secondary outcomes were the trainees' overall reactions to the training and algorithm, and the perceptions of psychological safety (PS). The 23 staff members of the Department of Pulmonology performed a total of 552 attempts at AM procedures (4 attempts at each of the 3 maneuvers in 2 sessions), and returned a total of 42 questionnaires (4 questionnaires were not returned). Median completion times of LT and NCT improved significantly between Sessions 1 and 2 (P = 0.005 and P = 0.04, respectively), whereas BMV was only marginally improved (P = 0.05). Trainees perceived training to be useful and expressed satisfaction with this training and the algorithm. The perception of PS increased after training. An AM algorithm and training for pulmonologists leads to improved technical AM skills, and is considered useful by trainees and raised their perception of PS during training. It thus represents a promising program