Performance of federated learning-based models in the Dutch TAVI population was comparable to central strategies and outperformed local strategies

BackgroundFederated learning (FL) is a technique for learning prediction models without sharing records between hospitals. Compared to centralized training approaches, the adoption of FL could negatively impact model performance.AimThis study aimed to evaluate four types of multicenter model development strategies for predicting 30-day mortality for patients undergoing transcatheter aortic valve implantation (TAVI): (1) central, learning one model from a centralized dataset of all hospitals; (2) local, learning one model per hospital; (3) federated averaging (FedAvg), averaging of local model coefficients; and (4) ensemble, aggregating local model predictions.MethodsData from all 16 Dutch TAVI hospitals from 2013 to 2021 in the Netherlands Heart Registration (NHR) were used. All approaches were internally validated. For the central and federated approaches, external geographic validation was also performed. Predictive performance in terms of discrimination [the area under the ROC curve (AUC-ROC, hereafter referred to as AUC)] and calibration (intercept and slope, and calibration graph) was measured.ResultsThe dataset comprised 16,661 TAVI records with a 30-day mortality rate of 3.4%. In internal validation the AUCs of central, local, FedAvg, and ensemble models were 0.68, 0.65, 0.67, and 0.67, respectively. The central and local models were miscalibrated by slope, while the FedAvg and ensemble models were miscalibrated by intercept. During external geographic validation, central, FedAvg, and ensemble all achieved a mean AUC of 0.68. Miscalibration was observed for the central, FedAvg, and ensemble models in 44%, 44%, and 38% of the hospitals, respectively.ConclusionCompared to centralized training approaches, FL techniques such as FedAvg and ensemble demonstrated comparable AUC and calibration. The use of FL techniques should be considered a viable option for clinical prediction model development

MRI-Based Assessment of Brain Tumor Hypoxia:Correlation with Histology

Cerebral hypoxia significantly impacts the progression of brain tumors and their resistance to radiotherapy. This study employed streamlined quantitative blood-oxygen-level-dependent (sqBOLD) MRI to assess the oxygen extraction fraction (OEF)—a measure of how much oxygen is being extracted from vessels, with higher OEF values indicating hypoxia. Simultaneously, we utilized vessel size imaging (VSI) to evaluate microvascular dimensions and blood volume. A cohort of ten patients, divided between those with glioma and those with brain metastases, underwent a 3 Tesla MRI scan. We generated OEF, cerebral blood volume (CBV), and vessel size maps, which guided 3–4 targeted biopsies per patient. Subsequent histological analyses of these biopsies used hypoxia-inducible factor 1-alpha (HIF-1α) for hypoxia and CD31 for microvasculature assessment, followed by a correlation analysis between MRI and histological data. The results showed that while the sqBOLD model was generally applicable to brain tumors, it demonstrated discrepancies in some metastatic tumors, highlighting the need for model adjustments in these cases. The OEF, CBV, and vessel size maps provided insights into the tumor’s hypoxic condition, showing intertumoral and intratumoral heterogeneity. A significant relationship between MRI-derived measurements and histological data was only evident in the vessel size measurements (r = 0.68, p &lt; 0.001).</p

MRI-Based Assessment of Brain Tumor Hypoxia:Correlation with Histology

Cerebral hypoxia significantly impacts the progression of brain tumors and their resistance to radiotherapy. This study employed streamlined quantitative blood-oxygen-level-dependent (sqBOLD) MRI to assess the oxygen extraction fraction (OEF)-a measure of how much oxygen is being extracted from vessels, with higher OEF values indicating hypoxia. Simultaneously, we utilized vessel size imaging (VSI) to evaluate microvascular dimensions and blood volume. A cohort of ten patients, divided between those with glioma and those with brain metastases, underwent a 3 Tesla MRI scan. We generated OEF, cerebral blood volume (CBV), and vessel size maps, which guided 3-4 targeted biopsies per patient. Subsequent histological analyses of these biopsies used hypoxia-inducible factor 1-alpha (HIF-1α) for hypoxia and CD31 for microvasculature assessment, followed by a correlation analysis between MRI and histological data. The results showed that while the sqBOLD model was generally applicable to brain tumors, it demonstrated discrepancies in some metastatic tumors, highlighting the need for model adjustments in these cases. The OEF, CBV, and vessel size maps provided insights into the tumor's hypoxic condition, showing intertumoral and intratumoral heterogeneity. A significant relationship between MRI-derived measurements and histological data was only evident in the vessel size measurements (r = 0.68, p &lt; 0.001).</p

Evaluating glioma growth predictions as a forward ranking problem

The problem of tumor growth prediction is challenging, but promising results have been achieved with both model-driven and statistical methods. In this work, we present a framework for the evaluation of growth predictions that focuses on the spatial infiltration patterns, and specifically evaluating a prediction of future growth. We propose to frame the problem as a ranking problem rather than a segmentation problem. Using the average precision as a metric, we can evaluate the results with segmentations while using the full spatiotemporal prediction. Furthermore, by separating the model goodness-of-fit from future predictive performance, we show that in some cases, a better fit of model parameters does not guarantee a better the predictive power

Evaluating the predictive value of glioma growth models for low-grade glioma after tumor resection

Tumor growth models have the potential to model and predict the spatiotemporal evolution of glioma in individual patients. Infiltration of glioma cells is known to be faster along the white matter tracts, and therefore structural magnetic resonance imaging (MRI) and diffusion tensor imaging (DTI) can be used to inform the model. However, applying and evaluating growth models in real patient data is challenging. In this work, we propose to formulate the problem of tumor growth as a ranking problem, as opposed to a segmentation problem, and use the average precision (AP) as a performance metric. This enables an evaluation of the spatial pattern that does not require a volume cut-off value. Using the AP metric, we evaluate diffusion-proliferation models informed by structural MRI and DTI, after tumor resection. We applied the models to a unique longitudinal dataset of 14 patients with low-grade glioma (LGG), who received no treatment after surgical resection, to predict the recurrent tumor shape after tumor resection. The diffusion models informed by structural MRI and DTI showed a small but significant increase in predictive performance with respect to homogeneous isotropic diffusion, and the DTI-informed model reached the best predictive performance. We conclude there is a significant improvement in the prediction of the recurrent tumor shape when using a DTI-informed anisotropic diffusion model with respect to istropic diffusion, and that the AP is a suitable metric to evaluate these models. All code and data used in this publication are made publicly available.</p

Topographical Mapping of 436 Newly Diagnosed IDH Wildtype Glioblastoma With vs. Without MGMT Promoter Methylation

Introduction: O6-methylguanine-methyltransferase (MGMT) promoter methylation and isocitrate dehydrogenase (IDH) mutation status are important prognostic factors for patients with glioblastoma. There are conflicting reports about a differential topographical distribution of glioblastoma with vs. without MGMT promoter methylation, possibly caused by molecular heterogeneity in glioblastoma populations. We initiated this study to re-evaluate the topographical distribution of glioblastoma with vs. without MGMT promoter methylation in light of the updated WHO 2016 classification. Methods: Preoperative T2-weighted/FLAIR and postcontrast T1-weighted MRI scans of patients aged 18 year or older with IDH wildtype glioblastoma were collected. Tumors were semi-automatically segmented, and the topographical distribution between glioblastoma with vs. without MGMT promoter methylation was visualized using frequency heatmaps. Then, voxel-wise differences were analyzed using permutation testing with Threshold Free Cluster Enhancement. Results: Four hundred thirty-six IDH wildtype glioblastoma patients were included; 211 with and 225 without MGMT promoter methylation. Visual examination suggested that when compared with MGMT unmethylated glioblastoma, MGMT methylated glioblastoma were more frequently located near bifrontal and left occipital periventricular area and less frequently near the right occipital periventricular area. Statistical analyses, however, showed no significant difference in topographical distribution between MGMT methylated vs. MGMT unmethylated glioblastoma. Conclusions: This study re-evaluated the

Reproducible radiomics through automated machine learning validated on twelve clinical applications

Radiomics uses quantitative medical imaging features to predict clinical outcomes. Currently, in a new clinical application, findingthe optimal radiomics method out of the wide range of available options has to be done manually through a heuristic trial-anderror process. In this study we propose a framework for automatically optimizing the construction of radiomics workflows perapplication. To this end, we formulate radiomics as a modular workflow and include a large collection of common algorithms foreach component. To optimize the workflow per application, we employ automated machine learning using a random search andensembling. We evaluate our method in twelve different clinical applications, resulting in the following area under the curves: 1)liposarcoma (0.83); 2) desmoid-type fibromatosis (0.82); 3) primary liver tumors (0.80); 4) gastrointestinal stromal tumors (0.77);5) colorectal liver metastases (0.61); 6) melanoma metastases (0.45); 7) hepatocellular carcinoma (0.75); 8) mesenteric fibrosis(0.80); 9) prostate cancer (0.72); 10) glioma (0.71); 11) Alzheimer’s disease (0.87); and 12) head and neck cancer (0.84). Weshow that our framework has a competitive performance compared human experts, outperforms a radiomics baseline, and performssimilar or superior to Bayesian optimization and more advanced ensemble approaches. Concluding, our method fully automaticallyoptimizes the construction of radiomics workflows, thereby streamlining the search for radiomics biomarkers in new applications.To facilitate reproducibility and future research, we publicly release six datasets, the software implementation of our framework,and the code to reproduce this study

Federated learning enables big data for rare cancer boundary detection.

Although machine learning (ML) has shown promise across disciplines, out-of-sample generalizability is concerning. This is currently addressed by sharing multi-site data, but such centralization is challenging/infeasible to scale due to various limitations. Federated ML (FL) provides an alternative paradigm for accurate and generalizable ML, by only sharing numerical model updates. Here we present the largest FL study to-date, involving data from 71 sites across 6 continents, to generate an automatic tumor boundary detector for the rare disease of glioblastoma, reporting the largest such dataset in the literature (n = 6, 314). We demonstrate a 33% delineation improvement for the surgically targetable tumor, and 23% for the complete tumor extent, over a publicly trained model. We anticipate our study to: 1) enable more healthcare studies informed by large diverse data, ensuring meaningful results for rare diseases and underrepresented populations, 2) facilitate further analyses for glioblastoma by releasing our consensus model, and 3) demonstrate the FL effectiveness at such scale and task-complexity as a paradigm shift for multi-site collaborations, alleviating the need for data-sharing

Author Correction: Federated learning enables big data for rare cancer boundary detection.

10.1038/s41467-023-36188-7NATURE COMMUNICATIONS14

Robust estimation of bacterial cell count from optical density

Optical density (OD) is widely used to estimate the density of cells in liquid culture, but cannot be compared between instruments without a standardized calibration protocol and is challenging to relate to actual cell count. We address this with an interlaboratory study comparing three simple, low-cost, and highly accessible OD calibration protocols across 244 laboratories, applied to eight strains of constitutive GFP-expressing E. coli. Based on our results, we recommend calibrating OD to estimated cell count using serial dilution of silica microspheres, which produces highly precise calibration (95.5% of residuals &lt;1.2-fold), is easily assessed for quality control, also assesses instrument effective linear range, and can be combined with fluorescence calibration to obtain units of Molecules of Equivalent Fluorescein (MEFL) per cell, allowing direct comparison and data fusion with flow cytometry measurements: in our study, fluorescence per cell measurements showed only a 1.07-fold mean difference between plate reader and flow cytometry data