Development and evaluation of uncertainty quantifying machine learning models to predict piperacillin plasma concentrations in critically ill patients

Background: Beta-lactam antimicrobial concentrations are frequently suboptimal in critically ill patients. Population pharmacokinetic (PopPK) modeling is the golden standard to predict drug concentrations. However, currently available PopPK models often lack predictive accuracy, making them less suited to guide dosing regimen adaptations. Furthermore, many currently developed models for clinical applications often lack uncertainty quantification. We, therefore, aimed to develop machine learning (ML) models for the prediction of piperacillin plasma concentrations while also providing uncertainty quantification with the aim of clinical practice. Methods: Blood samples for piperacillin analysis were prospectively collected from critically ill patients receiving continuous infusion of piperacillin/tazobactam. Interpretable ML models for the prediction of piperacillin concentrations were designed using CatBoost and Gaussian processes. Distribution-based Uncertainty Quantification was added to the CatBoost model using a proposed Quantile Ensemble method, useable for any model optimizing a quantile function. These models are subsequently evaluated using the distribution coverage error, a proposed interpretable uncertainty quantification calibration metric. Development and internal evaluation of the ML models were performed on the Ghent University Hospital database (752 piperacillin concentrations from 282 patients). Ensuing, ML models were compared with a published PopPK model on a database from the University Medical Centre of Groningen where a different dosing regimen is used (46 piperacillin concentrations from 15 patients.). Results: The best performing model was the Catboost model with an RMSE and R-2 of 31.94-0.64 and 33.53-0.60 for internal evaluation with and without previous concentration. Furthermore, the results prove the added value of the proposed Quantile Ensemble model in providing clinically useful individualized uncertainty predictions and show the limits of homoscedastic methods like Gaussian Processes in clinical applications. Conclusions: Our results show that ML models can consistently estimate piperacillin concentrations with acceptable and high predictive accuracy when identical dosing regimens as in the training data are used while providing highly relevant uncertainty predictions. However, generalization capabilities to other dosing schemes are limited. Notwithstanding, incorporating ML models in therapeutic drug monitoring programs seems definitely promising and the current work provides a basis for validating the model in clinical practice

Antimicrobial de-escalation in the critically ill patient and assessment of clinical cure: the DIANA study

Purpose: The DIANA study aimed to evaluate how often antimicrobial de-escalation (ADE) of empirical treatment is performed in the intensive care unit (ICU) and to estimate the effect of ADE on clinical cure on day 7 following treatment initiation. Methods: Adult ICU patients receiving empirical antimicrobial therapy for bacterial infection were studied in a prospective observational study from October 2016 until May 2018. ADE was defined as (1) discontinuation of an antimicrobial in case of empirical combination therapy or (2) replacement of an antimicrobial with the intention to narrow the antimicrobial spectrum, within the first 3 days of therapy. Inverse probability (IP) weighting was used to account for time-varying confounding when estimating the effect of ADE on clinical cure. Results: Overall, 1495 patients from 152 ICUs in 28 countries were studied. Combination therapy was prescribed in 50%, and carbapenems were prescribed in 26% of patients. Empirical therapy underwent ADE, no change and change other than ADE within the first 3 days in 16%, 63% and 22%, respectively. Unadjusted mortality at day 28 was 15.8% in the ADE cohort and 19.4% in patients with no change [p = 0.27; RR 0.83 (95% CI 0.60-1.14)]. The IP-weighted relative risk estimate for clinical cure comparing ADE with no-ADE patients (no change or change other than ADE) was 1.37 (95% CI 1.14-1.64). Conclusion: ADE was infrequently applied in critically ill-infected patients. The observational effect estimate on clinical cure suggested no deleterious impact of ADE compared to no-ADE. However, residual confounding is likely