Segmentation of glioblastomas in early post-operative multi-modal MRI with deep neural networks

Extent of resection after surgery is one of the main prognostic factors for patients diagnosed with glioblastoma. To achieve this, accurate segmentation and classification of residual tumor from post-operative MR images is essential. The current standard method for estimating it is subject to high inter- and intra-rater variability, and an automated method for segmentation of residual tumor in early post-operative MRI could lead to a more accurate estimation of extent of resection. In this study, two state-of-the-art neural network architectures for pre-operative segmentation were trained for the task. The models were extensively validated on a multicenter dataset with nearly 1000 patients, from 12 hospitals in Europe and the United States. The best performance achieved was a 61\% Dice score, and the best classification performance was about 80\% balanced accuracy, with a demonstrated ability to generalize across hospitals. In addition, the segmentation performance of the best models was on par with human expert raters. The predicted segmentations can be used to accurately classify the patients into those with residual tumor, and those with gross total resection.Comment: 13 pages, 4 figures, 4 table

Preoperative Brain Tumor Imaging: Models and Software for Segmentation and Standardized Reporting

For patients suffering from brain tumor, prognosis estimation and treatment decisions are made by a multidisciplinary team based on a set of preoperative MR scans. Currently, the lack of standardized and automatic methods for tumor detection and generation of clinical reports, incorporating a wide range of tumor characteristics, represents a major hurdle. In this study, we investigate the most occurring brain tumor types: glioblastomas, lower grade gliomas, meningiomas, and metastases, through four cohorts of up to 4,000 patients. Tumor segmentation models were trained using the AGU-Net architecture with different preprocessing steps and protocols. Segmentation performances were assessed in-depth using a wide-range of voxel and patient-wise metrics covering volume, distance, and probabilistic aspects. Finally, two software solutions have been developed, enabling an easy use of the trained models and standardized generation of clinical reports: Raidionics and Raidionics-Slicer. Segmentation performances were quite homogeneous across the four different brain tumor types, with an average true positive Dice ranging between 80 and 90%, patient-wise recall between 88 and 98%, and patient-wise precision around 95%. In conjunction to Dice, the identified most relevant other metrics were the relative absolute volume difference, the variation of information, and the Hausdorff, Mahalanobis, and object average symmetric surface distances. With our Raidionics software, running on a desktop computer with CPU support, tumor segmentation can be performed in 16–54 s depending on the dimensions of the MRI volume. For the generation of a standardized clinical report, including the tumor segmentation and features computation, 5–15 min are necessary. All trained models have been made open-access together with the source code for both software solutions and validation metrics computation. In the future, a method to convert results from a set of metrics into a final single score would be highly desirable for easier ranking across trained models. In addition, an automatic classification of the brain tumor type would be necessary to replace manual user input. Finally, the inclusion of post-operative segmentation in both software solutions will be key for generating complete post-operative standardized clinical reports.publishedVersio

Preoperative Brain Tumor Imaging: Models and Software for Segmentation and Standardized Reporting

For patients suffering from brain tumor, prognosis estimation and treatment decisions are made by a multidisciplinary team based on a set of preoperative MR scans. Currently, the lack of standardized and automatic methods for tumor detection and generation of clinical reports, incorporating a wide range of tumor characteristics, represents a major hurdle. In this study, we investigate the most occurring brain tumor types: glioblastomas, lower grade gliomas, meningiomas, and metastases, through four cohorts of up to 4,000 patients. Tumor segmentation models were trained using the AGU-Net architecture with different preprocessing steps and protocols. Segmentation performances were assessed in-depth using a wide-range of voxel and patient-wise metrics covering volume, distance, and probabilistic aspects. Finally, two software solutions have been developed, enabling an easy use of the trained models and standardized generation of clinical reports: Raidionics and Raidionics-Slicer. Segmentation performances were quite homogeneous across the four different brain tumor types, with an average true positive Dice ranging between 80 and 90%, patient-wise recall between 88 and 98%, and patient-wise precision around 95%. In conjunction to Dice, the identified most relevant other metrics were the relative absolute volume difference, the variation of information, and the Hausdorff, Mahalanobis, and object average symmetric surface distances. With our Raidionics software, running on a desktop computer with CPU support, tumor segmentation can be performed in 16–54 s depending on the dimensions of the MRI volume. For the generation of a standardized clinical report, including the tumor segmentation and features computation, 5–15 min are necessary. All trained models have been made open-access together with the source code for both software solutions and validation metrics computation. In the future, a method to convert results from a set of metrics into a final single score would be highly desirable for easier ranking across trained models. In addition, an automatic classification of the brain tumor type would be necessary to replace manual user input. Finally, the inclusion of post-operative segmentation in both software solutions will be key for generating complete post-operative standardized clinical reports

Accurate MR Image Registration to Anatomical Reference Space for Diffuse Glioma

To summarize the distribution of glioma location within a patient population, registration of individual MR images to anatomical reference space is required. In this study, we quantified the accuracy of MR image registration to anatomical reference space with linear and non-linear transformations using estimated tumor targets of glioblastoma and lower-grade glioma, and anatomical landmarks at pre- and post-operative time-points using six commonly used registration packages (FSL, SPM5, DARTEL, ANTs, Elastix, and NiftyReg). Routine clinical pre- and post-operative, post-contrast T1-weighted images of 20 patients with glioblastoma and 20 with lower-grade glioma were collected. The 2009a Montreal Neurological Institute brain template was used as anatomical reference space. Tumors were manually segmented in the patient space and corresponding healthy tissue was delineated as a target volume in the anatomical reference space. Accuracy of the tumor alignment was quantified using the Dice score and the Hausdorff distance. To measure the accuracy of general brain alignment, anatomical landmarks were placed in patient and in anatomical reference space, and the landmark distance after registration was quantified. Lower-grade gliomas were registered more accurately than glioblastoma. Registration accuracy for pre- and post-operative MR images did not differ. SPM5 and DARTEL registered tumors most accurate, and FSL least accurate. Non-linear transformations resulted in more accurate general brain alignment than linear transformations, but tumor alignment was similar between linear and non-linear transformation. We conclude that linear transformation suffices to summarize glioma locations in anatomical reference space

Comparing Glioblastoma Surgery Decisions Between Teams Using Brain Maps of Tumor Locations, Biopsies, and Resections

PURPOSE: The aim of glioblastoma surgery is to maximize the extent of resection while preserving functional integrity, which depends on the location within the brain. A standard to compare these decisions is lacking. We present a volumetric voxel-wise method for direct comparison between two multidisciplinary teams of glioblastoma surgery decisions throughout the brain. METHODS: Adults undergoing first-time glioblastoma surgery from 2012 to 2013 performed by two neuro-oncologic teams were included. Patients had had a diagnostic biopsy or resection. Preoperative tumors and postoperative residues were segmented on magnetic resonance imaging in three dimensions and registered to standard brain space. Voxel-wise probability maps of tumor location, biopsy, and resection were constructed for each team to compare patient referral bias, indication variation, and treatment variation. To evaluate the quality of care, subgroups of differentially resected brain regions were analyzed for survival and functional outcome. RESULTS: One team included 101 patients, and the other included 174; 91 tumors were biopsied, and 181 were resected. Patient characteristics were largely comparable between teams. Distributions of tumor locations were dissimilar, suggesting referral bias. Distributions of biopsies were similar, suggesting absence of indication variation. Differentially resected regions were identified in the anterior limb of the right internal capsule and the right caudate nucleus, indicating treatment variation. Patients with (n = 12) and without (n = 6) surgical removal in these regions had similar overall survival and similar permanent neurologic deficits. CONCLUSION: Probability maps of tumor location, biopsy, and resection provide additional information that can inform surgical decision making across multidisciplinary teams for patients with glioblastoma

Robust Deep Learning-based Segmentation of Glioblastoma on Routine Clinical MRI Scans Using Sparsified Training

Purpose: To improve the robustness of deep learning-based glioblastoma segmentation in a clinical setting with sparsified datasets. Materials and Methods: In this retrospective study, preoperative T1-weighted, T2-weighted, T2-weighted fluid-attenuated inversion recovery, and postcontrast T1-weighted MRI from 117 patients (median age, 64 years; interquartile range [IQR], 55-73 years; 76 men) included within the Multimodal Brain Tumor Image Segmentation (BraTS) dataset plus a clinical dataset (2012-2013) with similar imaging modalities of 634 patients (median age, 59 years; IQR, 49-69 years; 382 men) with glioblastoma from six hospitals were used. Expert tumor delineations on the postcontrast images were available, but for various clinical datasets, one or more sequences were missing. The convolutional neural network, DeepMedic, was trained on combinations of complete and incomplete data with and without site-specific data. Sparsified training was introduced, which randomly simulated missing sequences during training. The effects of sparsified training and center-specific training were tested using Wilcoxon signed rank tests for paired measurements. Results: A model trained exclusively on BraTS data reached a median Dice score of 0.81 for segmentation on BraTS test data but only 0.49 on the clinical data. Sparsified training improved performance (adjusted P < .05), even when excluding test data with missing sequences, to median Dice score of 0.67. Inclusion of site-specific data during sparsified training led to higher model performance Dice scores greater than 0.8, on par with a model based on all complete and incomplete data. For the model using BraTS and clinical training data, inclusion of site-specific data or sparsified training was of no consequence. Conclusion: Accurate and automatic segmentation of glioblastoma on clinical scans is feasible using a model based on large, heterogeneous, and partially incomplete datasets. Sparsified training may boost the performance of a smaller model based on public and site-specific data.Supplemental material is available for this article.Published under a CC BY 4.0 license

Robust deep learning–based segmentation of glioblastoma on routine clinical MRI scans using sparsified training

Purpose: To improve the robustness of deep learning–based glioblastoma segmentation in a clinical setting with sparsified datasets. Materials and Methods: In this retrospective study, preoperative T1-weighted, T2-weighted, T2-weighted fluid-attenuated inversion re-covery, and postcontrast T1-weighted MRI from 117 patients (median age, 64 years; interquartile range [IQR], 55–73 years; 76 men) included within the Multimodal Brain Tumor Image Segmentation (BraTS) dataset plus a clinical dataset (2012–2013) with similar imaging modalities of 634 patients (median age, 59 years; IQR, 49–69 years; 382 men) with glioblastoma from six hospitals were used. Expert tumor delineations on the postcontrast images were available, but for various clinical datasets, one or more sequences were miss-ing. The convolutional neural network, DeepMedic, was trained on combinations of complete and incomplete data with and without site-specific data. Sparsified training was introduced, which randomly simulated missing sequences during training. The effects of spar-sified training and center-specific training were tested using Wilcoxon signed rank tests for paired measurements. Results: A model trained exclusively on BraTS data reached a median Dice score of 0.81 for segmentation on BraTS test data but only 0.49 on the clinical data. Sparsified training improved performance (adjusted P, .05), even when excluding test data with missing sequences, to median Dice score of 0.67. Inclusion of site-specific data during sparsified training led to higher model performance Dice scores greater than 0.8, on par with a model based on all complete and incomplete data. For the model using BraTS and clinical training data, inclusion of site-specific data or sparsified training was of no consequence. Conclusion: Accurate and automatic segmentation of glioblastoma on clinical scans is feasible using a model based on large, heteroge-neous, and partially incomplete datasets. Sparsified training may boost the performance of a smaller model based on public and site-specific data

Timing of glioblastoma surgery and patient outcomes: a multicenter cohort study

Background: The impact of time-to-surgery on clinical outcome for patients with glioblastoma has not been determined. Any delay in treatment is perceived as detrimental, but guidelines do not specify acceptable timings. In this study, we relate the time to glioblastoma surgery with the extent of resection and residual tumor volume, performance change, and survival, and we explore the identification of patients for urgent surgery. Methods: Adults with first-time surgery in 2012-2013 treated by 12 neuro-oncological teams were included in this study. We defined time-to-surgery as the number of days between the diagnostic MR scan and surgery. The relation between time-to-surgery and patient and tumor characteristics was explored in time-to-event analysis and proportional hazard models. Outcome according to time-to-surgery was analyzed by volumetric measurements, changes in performance status, and survival analysis with patient and tumor characteristics as modifiers. Results: Included were 1033 patients of whom 729 had a resection and 304 a biopsy. The overall median time-to-surgery was 13 days. Surgery was within 3 days for 235 (23%) patients, and within a month for 889 (86%). The median volumetric doubling time was 22 days. Lower performance status (hazard ratio [HR] 0.942, 95% confidence interval [CI] 0.893-0.994) and larger tumor volume (HR 1.012, 95% CI 1.010-1.014) were independently associated with a shorter time-to-surgery. Extent of resection, residual tumor volume, postoperative performance change, and overall survival were not associated with time-to-surgery. Conclusions: With current decision-making for urgent surgery in selected patients with glioblastoma and surgery typically within 1 month, we found equal extent of resection, residual tumor volume, performance status, and survival after longer times-to-surgery

Between-hospital variation in time to glioblastoma surgery: a report from the Quality Registry Neuro Surgery in the Netherlands

OBJECTIVE Patients with glioblastoma are often scheduled for urgent elective surgery. Currently, the impact of the waiting period until glioblastoma surgery is undetermined. In this national quality registry study, the authors determined the wait times until surgery for patients with glioblastoma, the risk factors associated with wait times, and the risk-standardized variation in time to surgery between Dutch hospitals. The associations between time to surgery and patient outcomes were also explored. METHODS Data from all 4589 patients who underwent first-time glioblastoma surgery between 2014 and 2019 in the Netherlands were collected by 13 hospitals in the Quality Registry Neuro Surgery. Time to surgery comprised 1) the time from first MR scan to surgery (MTS), and 2) the time from first neurosurgical consultation to surgery (CTS). Long MTS was defined as more than 21 days and long CTS as more than 14 days. Potential risk factors were analyzed in multivariable logistic regression models. The standardized rate of long time to surgery was analyzed using funnel plots. Patient outcomes including Karnofsky Performance Scale (KPS) score change, complications, and survival were analyzed by multivariable logistic regression and proportional hazards models. RESULTS The median overall MTS and CTS were 18 and 9 days, respectively. Overall, 2576 patients (56%) had an MTS within 3 weeks and 3069 (67%) had a CTS within 2 weeks. Long MTS was significantly associated with older age, higher preoperative KPS score, higher American Society of Anesthesiologists comorbidity class, season, lower hospital case volume, university affiliation, and resection. Long CTS was significantly associated with higher baseline KPS score, university affiliation, resection, more recent year of treatment, and season. In funnel plots, considerable practice variation was observed between hospitals in patients with long times to surgery. Fewer patients with KPS score improvement were observed after a long time until resection. Long CTS was associated with longer survival. Complications and KPS score decline were not associated with time to surgery. CONCLUSIONS Considerable between-hospital variation among Dutch hospitals was observed in the time to glioblastoma surgery. A long time to resection impeded KPS score improvement, and therefore, patients who may improve should be identified for more urgent resection. Longer survival was observed in patients selected for longer time until surgery after neurosurgical consultation (CTS)

Quantifying eloquent locations for glioblastoma surgery using resection probability maps

OBJECTIVE Decisions in glioblastoma surgery are often guided by presumed eloquence of the tumor location. The authors introduce the "expected residual tumor volume" (eRV) and the "expected resectability index" (eRI) based on previous decisions aggregated in resection probability maps. The diagnostic accuracy of eRV and eRI to predict biopsy decisions, resectability, functional outcome, and survival was determined. METHODS Consecutive patients with first-time glioblastoma surgery in 2012-2013 were included from 12 hospitals. The eRV was calculated from the preoperative MR images of each patient using a resection probability map, and the eRI was derived from the tumor volume. As reference, Sawaya's tumor location eloquence grades (EGs) were classified. Resectability was measured as observed extent of resection (EOR) and residual volume, and functional outcome as change in Karnofsky Performance Scale score. Receiver operating characteristic curves and multivariable logistic regression were applied. RESULTS Of 915 patients, 674 (74%) underwent a resection with a median EOR of 97%, functional improvement in 71 (8%), functional decline in 78 (9%), and median survival of 12.8 months. The eRI and eRV identified biopsies and EORs of at least 80%, 90%, or 98% better than EG. The eRV and eRI predicted observed residual volumes under 10, 5, and 1 ml better than EG. The eRV, eRI, and EG had low diagnostic accuracy for functional outcome changes. Higher eRV and lower eRI were strongly associated with shorter survival, independent of known prognostic factors. CONCLUSIONS The eRV and eRI predict biopsy decisions, resectability, and survival better than eloquence grading and may be useful preoperative indices to support surgical decisions