Machine learning in intensive care medicine: ready for take-off?

In 1986 the world was shaken by the Challenger space shuttle disaster. In the years that followed, the American National Aeronautics and Space Administration (NASA) called for a strategy change in space technology development [1]. Allowing technology to be developed without a specific space program in mind was central to the new strategy [2]. In order to evaluate resulting projects with no direct contribution to a space mission, NASA introduced the general concept of technology readiness levels (TRLs) [3]. These nine levels, adopted by many EU institutions, assess the maturity level of technology and estimate its readiness to fly

Predicting readmission or death after discharge from the ICU: external validation and retraining of a machine learning model

OBJECTIVES: Many machine learning (ML) models have been developed for application in the ICU, but few models have been subjected to external validation. The performance of these models in new settings therefore remains unknown. The objective of this study was to assess the performance of an existing decision support tool based on a ML model predicting readmission or death within 7 days after ICU discharge before, during, and after retraining and recalibration.DESIGN: A gradient boosted ML model was developed and validated on electronic health record data from 2004 to 2021. We performed an independent validation of this model on electronic health record data from 2011 to 2019 from a different tertiary care center.SETTING: Two ICUs in tertiary care centers in The Netherlands.PATIENTS: Adult patients who were admitted to the ICU and stayed for longer than 12 hours.INTERVENTIONS: None.MEASUREMENTS AND MAIN RESULTS: We assessed discrimination by area under the receiver operating characteristic curve (AUC) and calibration (slope and intercept). We retrained and recalibrated the original model and assessed performance via a temporal validation design. The final retrained model was cross-validated on all data from the new site. Readmission or death within 7 days after ICU discharge occurred in 577 of 10,052 ICU admissions (5.7%) at the new site. External validation revealed moderate discrimination with an AUC of 0.72 (95% CI 0.67–0.76). Retrained models showed improved discrimination with AUC 0.79 (95% CI 0.75–0.82) for the final validation model. Calibration was poor initially and good after recalibration via isotonic regression.CONCLUSIONS: In this era of expanding availability of ML models, external validation and retraining are key steps to consider before applying ML models to new settings. Clinicians and decision-makers should take this into account when considering applying new ML models to their local settings.Analysis and support of clinical decision makingDevelopment and application of statistical models for medical scientific researc

Sharing ICU Patient Data Responsibly Under the Society of Critical Care Medicine/European Society of Intensive Care Medicine Joint Data Science Collaboration: The Amsterdam University Medical Centers Database (AmsterdamUMCdb) Example.

OBJECTIVES: Critical care medicine is a natural environment for machine learning approaches to improve outcomes for critically ill patients as admissions to ICUs generate vast amounts of data. However, technical, legal, ethical, and privacy concerns have so far limited the critical care medicine community from making these data readily available. The Society of Critical Care Medicine and the European Society of Intensive Care Medicine have identified ICU patient data sharing as one of the priorities under their Joint Data Science Collaboration. To encourage ICUs worldwide to share their patient data responsibly, we now describe the development and release of Amsterdam University Medical Centers Database (AmsterdamUMCdb), the first freely available critical care database in full compliance with privacy laws from both the United States and Europe, as an example of the feasibility of sharing complex critical care data. SETTING: University hospital ICU. SUBJECTS: Data from ICU patients admitted between 2003 and 2016. INTERVENTIONS: We used a risk-based deidentification strategy to maintain data utility while preserving privacy. In addition, we implemented contractual and governance processes, and a communication strategy. Patient organizations, supporting hospitals, and experts on ethics and privacy audited these processes and the database. MEASUREMENTS AND MAIN RESULTS: AmsterdamUMCdb contains approximately 1 billion clinical data points from 23,106 admissions of 20,109 patients. The privacy audit concluded that reidentification is not reasonably likely, and AmsterdamUMCdb can therefore be considered as anonymous information, both in the context of the U.S. Health Insurance Portability and Accountability Act and the European General Data Protection Regulation. The ethics audit concluded that responsible data sharing imposes minimal burden, whereas the potential benefit is tremendous. CONCLUSIONS: Technical, legal, ethical, and privacy challenges related to responsible data sharing can be addressed using a multidisciplinary approach. A risk-based deidentification strategy, that complies with both U.S. and European privacy regulations, should be the preferred approach to releasing ICU patient data. This supports the shared Society of Critical Care Medicine and European Society of Intensive Care Medicine vision to improve critical care outcomes through scientific inquiry of vast and combined ICU datasets

Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracy

Abstract: Purpose: Early clinical recognition of sepsis can be challenging. With the advancement of machine learning, promising real-time models to predict sepsis have emerged. We assessed their performance by carrying out a systematic review and meta-analysis. Methods: A systematic search was performed in PubMed, Embase.com and Scopus. Studies targeting sepsis, severe sepsis or septic shock in any hospital setting were eligible for inclusion. The index test was any supervised machine learning model for real-time prediction of these conditions. Quality of evidence was assessed using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) methodology, with a tailored Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) checklist to evaluate risk of bias. Models with a reported area under the curve of the receiver operating characteristic (AUROC) metric were meta-analyzed to identify strongest contributors to model performance. Results: After screening, a total of 28 papers were eligible for synthesis, from which 130 models were extracted. The majority of papers were developed in the intensive care unit (ICU, n = 15; 54%), followed by hospital wards (n = 7; 25%), the emergency department (ED, n = 4; 14%) and all of these settings (n = 2; 7%). For the prediction of sepsis, diagnostic test accuracy assessed by the AUROC ranged from 0.68–0.99 in the ICU, to 0.96–0.98 in-hospital and 0.87 to 0.97 in the ED. Varying sepsis definitions limit pooling of the performance across studies. Only three papers clinically implemented models with mixed results. In the multivariate analysis, temperature, lab values, and model type contributed most to model performance. Conclusion: This systematic review and meta-analysis show that on retrospective data, individual machine learning models can accurately predict sepsis onset ahead of time. Although they present alternatives to traditional scoring systems, between-study heterogeneity limits the assessment of pooled results. Systematic reporting and clinical implementation studies are needed to bridge the gap between bytes and bedside

Clinical and organizational factors associated with mortality during the peak of first COVID-19 wave: the global UNITE-COVID study

Purpose: To accommodate the unprecedented number of critically ill patients with pneumonia caused by coronavirus disease 2019 (COVID-19) expansion of the capacity of intensive care unit (ICU) to clinical areas not previously used for critical care was necessary. We describe the global burden of COVID-19 admissions and the clinical and organizational characteristics associated with outcomes in critically ill COVID-19 patients. Methods: Multicenter, international, point prevalence study, including adult patients with SARS-CoV-2 infection confirmed by polymerase chain reaction (PCR) and a diagnosis of COVID-19 admitted to ICU between February 15th and May 15th, 2020. Results: 4994 patients from 280 ICUs in 46 countries were included. Included ICUs increased their total capacity from 4931 to 7630 beds, deploying personnel from other areas. Overall, 1986 (39.8%) patients were admitted to surge capacity beds. Invasive ventilation at admission was present in 2325 (46.5%) patients and was required during ICU stay in 85.8% of patients. 60-day mortality was 33.9% (IQR across units: 20%–50%) and ICU mortality 32.7%. Older age, invasive mechanical ventilation, and acute kidney injury (AKI) were associated with increased mortality. These associations were also confirmed specifically in mechanically ventilated patients. Admission to surge capacity beds was not associated with mortality, even after controlling for other factors. Conclusions: ICUs responded to the increase in COVID-19 patients by increasing bed availability and staff, admitting up to 40% of patients in surge capacity beds. Although mortality in this population was high, admission to a surge capacity bed was not associated with increased mortality. Older age, invasive mechanical ventilation, and AKI were identified as the strongest predictors of mortality

The impact of the Fungus-Host-Microbiota interplay upon Candida albicans infections: current knowledge and new perspectives

This is the final version. Available on open access from Oxford University Press via the DOI in this recordCandida albicans is a major fungal pathogen of humans. It exists as a commensal in the oral cavity, gut or genital tract of most individuals, constrained by the local microbiota, epithelial barriers and immune defences. Their perturbation can lead to fungal outgrowth and the development of mucosal infections such as oropharyngeal or vulvovaginal candidiasis, and patients with compromised immunity are susceptible to life-threatening systemic infections. The importance of the interplay between fungus, host and microbiota in driving the transition from C. albicans commensalism to pathogenicity is widely appreciated. However, the complexity of these interactions, and the significant impact of fungal, host and microbiota variability upon disease severity and outcome, are less well understood. Therefore, we summarise the features of the fungus that promote infection, and how genetic variation between clinical isolates influences pathogenicity. We discuss antifungal immunity, how this differs between mucosae, and how individual variation influences a person's susceptibility to infection. Also, we describe factors that influence the composition of gut, oral and vaginal microbiotas, and how these affect fungal colonisation and antifungal immunity. We argue that a detailed understanding of these variables, which underlie fungal-host-microbiota interactions, will present opportunities for directed antifungal therapies that benefit vulnerable patients

Co-infection and ICU-acquired infection in COIVD-19 ICU patients: a secondary analysis of the UNITE-COVID data set

Background: The COVID-19 pandemic presented major challenges for critical care facilities worldwide. Infections which develop alongside or subsequent to viral pneumonitis are a challenge under sporadic and pandemic conditions; however, data have suggested that patterns of these differ between COVID-19 and other viral pneumonitides. This secondary analysis aimed to explore patterns of co-infection and intensive care unit-acquired infections (ICU-AI) and the relationship to use of corticosteroids in a large, international cohort of critically ill COVID-19 patients.Methods: This is a multicenter, international, observational study, including adult patients with PCR-confirmed COVID-19 diagnosis admitted to ICUs at the peak of wave one of COVID-19 (February 15th to May 15th, 2020). Data collected included investigator-assessed co-infection at ICU admission, infection acquired in ICU, infection with multi-drug resistant organisms (MDRO) and antibiotic use. Frequencies were compared by Pearson's Chi-squared and continuous variables by Mann-Whitney U test. Propensity score matching for variables associated with ICU-acquired infection was undertaken using R library MatchIT using the "full" matching method.Results: Data were available from 4994 patients. Bacterial co-infection at admission was detected in 716 patients (14%), whilst 85% of patients received antibiotics at that stage. ICU-AI developed in 2715 (54%). The most common ICU-AI was bacterial pneumonia (44% of infections), whilst 9% of patients developed fungal pneumonia; 25% of infections involved MDRO. Patients developing infections in ICU had greater antimicrobial exposure than those without such infections. Incident density (ICU-AI per 1000 ICU days) was in considerable excess of reports from pre-pandemic surveillance. Corticosteroid use was heterogenous between ICUs. In univariate analysis, 58% of patients receiving corticosteroids and 43% of those not receiving steroids developed ICU-AI. Adjusting for potential confounders in the propensity-matched cohort, 71% of patients receiving corticosteroids developed ICU-AI vs 52% of those not receiving corticosteroids. Duration of corticosteroid therapy was also associated with development of ICU-AI and infection with an MDRO.Conclusions: In patients with severe COVID-19 in the first wave, co-infection at admission to ICU was relatively rare but antibiotic use was in substantial excess to that indication. ICU-AI were common and were significantly associated with use of corticosteroids

Rare predicted loss-of-function variants of type I IFN immunity genes are associated with life-threatening COVID-19

Background: We previously reported that impaired type I IFN activity, due to inborn errors of TLR3- and TLR7-dependent type I interferon (IFN) immunity or to autoantibodies against type I IFN, account for 15–20% of cases of life-threatening COVID-19 in unvaccinated patients. Therefore, the determinants of life-threatening COVID-19 remain to be identified in ~ 80% of cases. Methods: We report here a genome-wide rare variant burden association analysis in 3269 unvaccinated patients with life-threatening COVID-19, and 1373 unvaccinated SARS-CoV-2-infected individuals without pneumonia. Among the 928 patients tested for autoantibodies against type I IFN, a quarter (234) were positive and were excluded. Results: No gene reached genome-wide significance. Under a recessive model, the most significant gene with at-risk variants was TLR7, with an OR of 27.68 (95%CI 1.5–528.7, P = 1.1 × 10−4) for biochemically loss-of-function (bLOF) variants. We replicated the enrichment in rare predicted LOF (pLOF) variants at 13 influenza susceptibility loci involved in TLR3-dependent type I IFN immunity (OR = 3.70[95%CI 1.3–8.2], P = 2.1 × 10−4). This enrichment was further strengthened by (1) adding the recently reported TYK2 and TLR7 COVID-19 loci, particularly under a recessive model (OR = 19.65[95%CI 2.1–2635.4], P = 3.4 × 10−3), and (2) considering as pLOF branchpoint variants with potentially strong impacts on splicing among the 15 loci (OR = 4.40[9%CI 2.3–8.4], P = 7.7 × 10−8). Finally, the patients with pLOF/bLOF variants at these 15 loci were significantly younger (mean age [SD] = 43.3 [20.3] years) than the other patients (56.0 [17.3] years; P = 1.68 × 10−5). Conclusions: Rare variants of TLR3- and TLR7-dependent type I IFN immunity genes can underlie life-threatening COVID-19, particularly with recessive inheritance, in patients under 60 years old

The Origin and Initial Rise of Pelagic Cephalopods in the Ordovician

BACKGROUND: During the Ordovician the global diversity increased dramatically at family, genus and species levels. Partially the diversification is explained by an increased nutrient, and phytoplankton availability in the open water. Cephalopods are among the top predators of today's open oceans. Their Ordovician occurrences, diversity evolution and abundance pattern potentially provides information on the evolution of the pelagic food chain. METHODOLOGY/PRINCIPAL FINDINGS: We reconstructed the cephalopod departure from originally exclusively neritic habitats into the pelagic zone by the compilation of occurrence data in offshore paleoenvironments from the Paleobiology Database, and from own data, by evidence of the functional morphology, and the taphonomy of selected cephalopod faunas. The occurrence data show, that cephalopod associations in offshore depositional settings and black shales are characterized by a specific composition, often dominated by orthocerids and lituitids. The siphuncle and conch form of these cephalopods indicate a dominant lifestyle as pelagic, vertical migrants. The frequency distribution of conch sizes and the pattern of epibionts indicate an autochthonous origin of the majority of orthocerid and lituitid shells. The consistent concentration of these cephalopods in deep subtidal sediments, starting from the middle Tremadocian indicates the occupation of the pelagic zone early in the Early Ordovician and a subsequent diversification which peaked during the Darriwilian. CONCLUSIONS/SIGNIFICANCE: The exploitation of the pelagic realm started synchronously in several independent invertebrate clades during the latest Cambrian to Middle Ordovician. The initial rise and diversification of pelagic cephalopods during the Early and Middle Ordovician indicates the establishment of a pelagic food chain sustainable enough for the development of a diverse fauna of large predators. The earliest pelagic cephalopods were slowly swimming vertical migrants. The appearance and early diversification of pelagic cephalopods is interpreted as a consequence of the increased food availability in the open water since the latest Cambrian

Autoantibodies against type I IFNs in patients with life-threatening COVID-19

Interindividual clinical variability in the course of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection is vast. We report that at least 101 of 987 patients with life-threatening coronavirus disease 2019 (COVID-19) pneumonia had neutralizing immunoglobulin G (IgG) autoantibodies (auto-Abs) against interferon-w (IFN-w) (13 patients), against the 13 types of IFN-a (36), or against both (52) at the onset of critical disease; a few also had auto-Abs against the other three type I IFNs. The auto-Abs neutralize the ability of the corresponding type I IFNs to block SARS-CoV-2 infection in vitro. These auto-Abs were not found in 663 individuals with asymptomatic or mild SARS-CoV-2 infection and were present in only 4 of 1227 healthy individuals. Patients with auto-Abs were aged 25 to 87 years and 95 of the 101 were men. A B cell autoimmune phenocopy of inborn errors of type I IFN immunity accounts for life-threatening COVID-19 pneumonia in at least 2.6% of women and 12.5% of men