Development of a hand-held computer platform for real-time behavioral assessment of physicians and nurses

AbstractWe developed a hand-held data collection tool to facilitate real-time collection of data on the factors that affect hospital staff performance. To assure high-yield of data from busy clinicians, the design objectives included low response burden, the ability to collect complex real-time data in dynamic work environments, and automated data integration. Iterative user-centered design of custom interfaces resulted in a dynamic intuitive platform where branching logic was applied to present a series of survey questions dependent on the participant’s responses. Over a 12-month period, 304 inpatient physicians and nurses completed (with minimal initial training) a total of 11,381 survey responses. For randomly timed repeated survey prompts, complete (73%) or partial (12%) responses were obtained in a median time of 96s

Use of a Portable Functional Near-Infrared Spectroscopy (fNIRS) System to Examine Team Experience During Crisis Event Management in Clinical Simulations

Objective: The aim of this study was to investigate the utilization of a portable functional near-infrared spectroscopy (fNIRS) system, the fNIRS PioneerTM, to examine team experience in high-fidelity simulation-based crisis event management (CEM) training for anesthesiologists in operating rooms.Background: Effective evaluation of team performance and experience in CEM simulations is essential for healthcare training and research. Neurophysiological measures with wearable devices can provide useful indicators of team experience to compliment traditional self-report, observer ratings, and behavioral performance measures. fNIRS measured brain blood oxygenation levels and neural synchrony can be used as indicators of workload and team engagement, which is vital for optimal team performance.Methods: Thirty-three anesthesiologists, who were attending CEM training in two-person teams, participated in this study. The participants varied in their expertise level and the simulation scenarios varied in difficulty level. The oxygenated and de-oxygenated hemoglobin (HbO and HbR) levels in the participants’ prefrontal cortex were derived from data recorded by a portable one-channel fNIRS system worn by all participants throughout CEM training. Team neural synchrony was measured by HbO/HbR wavelet transformation coherence (WTC). Observer-rated workload and self-reported workload and mood were also collected.Results: At the individual level, the pattern of HbR level corresponded to changes of workload for the individuals in different roles during different phases of a scenario; but this was not the case for HbO level. Thus, HbR level may be a better indicator for individual workload in the studied setting. However, HbR level was insensitive to differences in scenario difficulty and did not correlate with observer-rated or self-reported workload. At the team level, high levels of HbO and HbR WTC were observed during active teamwork. Furthermore, HbO WTC was sensitive to levels of scenario difficulty.Conclusion: This study showed that it was feasible to use a portable fNIRS system to study workload and team engagement in high-fidelity clinical simulations. However, more work is needed to establish the sensitivity, reliability, and validity of fNIRS measures as indicators of team experience

Human Factors Research in Anesthesia Patient Safety: Techniques to Elucidate Factors Affecting Clinical Task Performance and Decision Making

Patient safety has become a major public concern. Human factors research in other high-risk fields has demonstrated how rigorous study of factors that affect job performance can lead to improved outcome and reduced errors after evidence-based redesign of tasks or systems. These techniques have increasingly been applied to the anesthesia work environment. This paper describes data obtained recently using task analysis and workload assessment during actual patient care and the use of cognitive task analysis to study clinical decision making. A novel concept of “non-routine events” is introduced and pilot data are presented. The results support the assertion that human factors research can make important contributions to patient safety. Information technologies play a key role in these efforts

Effects of Intraoperative Reading on Vigilance and Workload during Anesthesia Care in an Academic Medical Center

Background: During routine cases, anesthesia providers may divert their attention away from direct patient care to read clinical (e.g., medical records) and/or nonclinical materials. The authors sought to ascertain the incidence of intraoperative reading and measure its effects on clinicians' workload and vigilance. Methods: In 172 selected general anesthetic cases in an academic medical center, a trained observer categorized the anesthesia provider's activities into 37 possible tasks. Vigilance was assessed by the response time to a randomly illuminated alarm light. Observer-and subject-reported workload were scored at random intervals. Data from Reading and Non-Reading Periods of the same cases were compared to each other and to matched cases that contained no observed reading. The cases were matched before data analysis on the basis of case complexity and anesthesia type. Results: Reading was observed in 35% of cases. In these 60 cases, providers read during 25 ؎ 3% of maintenance but not during induction or emergence. While Non-Reading Cases (n ‫؍‬ 112) and Non-Reading Periods of Reading Cases did not differ in workload, vigilance, or task distribution, they both had significantly higher workload than Reading Periods. Vigilance was not different among the three groups. When reading, clinicians spent less time performing manual tasks, conversing with others, and recordkeeping. Conclusions: Anesthesia providers, even when being observed, read during a significant percentage of the maintenance period in many cases. However, reading occurred when workload was low and did not appear to affect a measure of vigilance