Solving the explainable AI conundrum by bridging clinicians’ needs and developers’ goals

Explainable artificial intelligence (XAI) has emerged as a promising solution for addressing the implementation challenges of AI/ML in healthcare. However, little is known about how developers and clinicians interpret XAI and what conflicting goals and requirements they may have. This paper presents the findings of a longitudinal multi-method study involving 112 developers and clinicians co-designing an XAI solution for a clinical decision support system. Our study identifies three key differences between developer and clinician mental models of XAI, including opposing goals (model interpretability vs. clinical plausibility), different sources of truth (data vs. patient), and the role of exploring new vs. exploiting old knowledge. Based on our findings, we propose design solutions that can help address the XAI conundrum in healthcare, including the use of causal inference models, personalized explanations, and ambidexterity between exploration and exploitation mindsets. Our study highlights the importance of considering the perspectives of both developers and clinicians in the design of XAI systems and provides practical recommendations for improving the effectiveness and usability of XAI in healthcare

Video object detection for privacy-preserving patient monitoring in intensive care

Patient monitoring in intensive care units, although assisted by biosensors, needs continuous supervision of staff. To reduce the burden on staff members, IT infrastructures are built to record monitoring data and develop clinical decision support systems. These systems, however, are vulnerable to artifacts (e.g. muscle movement due to ongoing treatment), which are often indistinguishable from real and potentially dangerous signals. Video recordings could facilitate the reliable classification of biosignals using object detection (OD) methods to find sources of unwanted artifacts. Due to privacy restrictions, only blurred videos can be stored, which severely impairs the possibility to detect clinically relevant events such as interventions or changes in patient status with standard OD methods. Hence, new kinds of approaches are necessary that exploit every kind of available information due to the reduced information content of blurred footage and that are at the same time easily implementable within the IT infrastructure of a normal hospital. In this paper, we propose a new method for exploiting information in the temporal succession of video frames. To be efficiently implementable using off-the-shelf object detectors that comply with given hardware constraints, we repurpose the image color channels to account for temporal consistency, leading to an improved detection rate of the object classes. Our method outperforms a standard YOLOv5 baseline model by +1.7% [email protected] while also training over ten times faster on our proprietary dataset. We conclude that this approach has shown effectiveness in the preliminary experiments and holds potential for more general video OD in the future.Comment: 4 pages, 3 figures, 2023 10th Swiss Conference on Data Science (SDS), code available at https://github.com/raember/yolov5r_autodidact and https://github.com/raember/VideoPro

Anatomy of an Alpine Bedload Transport Event: A Watershed‐Scale Seismic‐Network Perspective

The way Alpine rivers mobilize, convey and store coarse material during high-magnitude events is poorly understood, notably because it is difficult to obtain measurements of bedload transport at the watershed scale. Seismic sensor data, evaluated with appropriate seismic physical models, can provide that missing link by yielding time-varying estimates of bedload transport albeit with non-negligible uncertainty. Low cost and ease of installation allow for networks of sensors to be deployed, providing continuous, watershed-scale insights into bedload transport dynamics. Here, we deploy a network of 24 seismic sensors to estimate coarse material fluxes in a 13.4 km2 Alpine watershed during a high-magnitude transport event. First, we benchmark the seismic inversion routine with an independent time-series of bedload transport obtained with a calibrated acoustic system. Then, we apply the procedure to the other seismic sensors across the watershed. Propagation velocities derived from cross-correlation analysis between spatially consecutive bedload transport time-series were too high with respect to typical bedload transport velocity suggesting that a faster-moving water wave (re-)mobilizes local coarse material. Spatially distributed estimates of bedload transport reveal a relative inefficiency of Alpine watersheds in evacuating coarse material, even during a relatively infrequent high-magnitude bedload transport event. Significant inputs estimated for some tributaries were rapidly attenuated as the main river crossed less hydraulically efficient reaches. Only a small proportion of the total amount of material mobilized in the watershed was exported at the outlet. Multiple periods of competent flows are likely necessary to evacuate coarse material mobilized throughout the watershed during individual bedload transport events

Solving the explainable AI conundrum by bridging clinicians’ needs and developers’ goals

Explainable artificial intelligence (XAI) has emerged as a promising solution for addressing the implementation challenges of AI/ML in healthcare. However, little is known about how developers and clinicians interpret XAI and what conflicting goals and requirements they may have. This paper presents the findings of a longitudinal multi-method study involving 112 developers and clinicians co-designing an XAI solution for a clinical decision support system. Our study identifies three key differences between developer and clinician mental models of XAI, including opposing goals (model interpretability vs. clinical plausibility), different sources of truth (data vs. patient), and the role of exploring new vs. exploiting old knowledge. Based on our findings, we propose design solutions that can help address the XAI conundrum in healthcare, including the use of causal inference models, personalized explanations, and ambidexterity between exploration and exploitation mindsets. Our study highlights the importance of considering the perspectives of both developers and clinicians in the design of XAI systems and provides practical recommendations for improving the effectiveness and usability of XAI in healthcare.ISSN:2398-635

ICU Cockpit: a platform for collecting multimodal waveform data, AI-based computational disease modeling and real-time decision support in the intensive care unit

ICU Cockpit: a secure, fast, and scalable platform for collecting multimodal waveform data, online and historical data visualization, and online validation of algorithms in the intensive care unit. We present a network of software services that continuously stream waveforms from ICU beds to databases and a web-based user interface. Machine learning algorithms process the data streams and send outputs to the user interface. The architecture and capabilities of the platform are described. Since 2016, the platform has processed over 89 billion data points (N = 979 patients) from 200 signals (0.5–500 Hz) and laboratory analyses (once a day). We present an infrastructure-based framework for deploying and validating algorithms for critical care. The ICU Cockpit is a Big Data platform for critical care medicine, especially for multimodal waveform data. Uniquely, it allows algorithms to seamlessly integrate into the live data stream to produce clinical decision support and predictions in clinical practice

The North Atlantic Aerosol and Marine Ecosystem Study (NAAMES): Science Motive and Mission Overview

The North Atlantic Aerosols and Marine Ecosystems Study (NAAMES) is an interdisciplinary investigation to improve understanding of Earth\u27s ocean ecosystem-aerosol-cloud system. Specific overarching science objectives for NAAMES are to (1) characterize plankton ecosystem properties during primary phases of the annual cycle and their dependence on environmental forcings, (2) determine how these phases interact to recreate each year the conditions for an annual plankton bloom, and (3) resolve how remote marine aerosols and boundary layer clouds are influenced by plankton ecosystems. Four NAAMES field campaigns were conducted in the western subarctic Atlantic between November 2015 and April 2018, with each campaign targeting specific seasonal events in the annual plankton cycle. A broad diversity of measurements were collected during each campaign, including ship, aircraft, autonomous float and drifter, and satellite observations. Here, we present an overview of NAAMES science motives, experimental design, and measurements. We then briefly describe conditions and accomplishments during each of the four field campaigns and provide information on how to access NAAMES data. The intent of this manuscript is to familiarize the broad scientific community with NAAMES and to provide a common reference overview of the project for upcoming publications

The North Atlantic Aerosol and Marine Ecosystem Study (NAAMES): Science Motive and Mission Overview

The North Atlantic Aerosols and Marine Ecosystems Study (NAAMES) is an interdisciplinary investigation to improve understanding of Earth\u27s ocean ecosystem-aerosol-cloud system. Specific overarching science objectives for NAAMES are to (1) characterize plankton ecosystem properties during primary phases of the annual cycle and their dependence on environmental forcings, (2) determine how these phases interact to recreate each year the conditions for an annual plankton bloom, and (3) resolve how remote marine aerosols and boundary layer clouds are influenced by plankton ecosystems. Four NAAMES field campaigns were conducted in the western subarctic Atlantic between November 2015 and April 2018, with each campaign targeting specific seasonal events in the annual plankton cycle. A broad diversity of measurements were collected during each campaign, including ship, aircraft, autonomous float and drifter, and satellite observations. Here, we present an overview of NAAMES science motives, experimental design, and measurements. We then briefly describe conditions and accomplishments during each of the four field campaigns and provide information on how to access NAAMES data. The intent of this manuscript is to familiarize the broad scientific community with NAAMES and to provide a common reference overview of the project for upcoming publications

Structure and function of the global ocean microbiome

International audienceMicrobes are dominant drivers of biogeochemical processes, yet drawing a global picture of functional diversity, microbial community structure, and their ecological determinants remains a grand challenge. We analyzed 7.2 terabases of metagenomic data from 243 Tara Oceans samples from 68 locations in epipelagic and mesopelagic waters across the globe to generate an ocean microbial reference gene catalog with >40 million nonredundant, mostly novel sequences from viruses, prokaryotes, and picoeukaryotes. Using 139 prokaryote-enriched samples, containing >35,000 species, we show vertical stratification with epipelagic community composition mostly driven by temperature rather than other environmental factors or geography. We identify ocean microbial core functionality and reveal that >73% of its abundance is shared with the human gut microbiome despite the physicochemical differences between these two ecosystems