21 research outputs found
Are we using appropriate segmentation metrics? Identifying correlates of human expert perception for CNN training beyond rolling the DICE coefficient
In this study, we explore quantitative correlates of qualitative human expert
perception. We discover that current quality metrics and loss functions,
considered for biomedical image segmentation tasks, correlate moderately with
segmentation quality assessment by experts, especially for small yet clinically
relevant structures, such as the enhancing tumor in brain glioma. We propose a
method employing classical statistics and experimental psychology to create
complementary compound loss functions for modern deep learning methods, towards
achieving a better fit with human quality assessment. When training a CNN for
delineating adult brain tumor in MR images, all four proposed loss candidates
outperform the established baselines on the clinically important and hardest to
segment enhancing tumor label, while maintaining performance for other label
channels
M2Net: Multi-modal Multi-channel Network for Overall Survival Time Prediction of Brain Tumor Patients
Early and accurate prediction of overall survival (OS) time can help to
obtain better treatment planning for brain tumor patients. Although many OS
time prediction methods have been developed and obtain promising results, there
are still several issues. First, conventional prediction methods rely on
radiomic features at the local lesion area of a magnetic resonance (MR) volume,
which may not represent the full image or model complex tumor patterns. Second,
different types of scanners (i.e., multi-modal data) are sensitive to different
brain regions, which makes it challenging to effectively exploit the
complementary information across multiple modalities and also preserve the
modality-specific properties. Third, existing methods focus on prediction
models, ignoring complex data-to-label relationships. To address the above
issues, we propose an end-to-end OS time prediction model; namely, Multi-modal
Multi-channel Network (M2Net). Specifically, we first project the 3D MR volume
onto 2D images in different directions, which reduces computational costs,
while preserving important information and enabling pre-trained models to be
transferred from other tasks. Then, we use a modality-specific network to
extract implicit and high-level features from different MR scans. A multi-modal
shared network is built to fuse these features using a bilinear pooling model,
exploiting their correlations to provide complementary information. Finally, we
integrate the outputs from each modality-specific network and the multi-modal
shared network to generate the final prediction result. Experimental results
demonstrate the superiority of our M2Net model over other methods.Comment: Accepted by MICCAI'2
Prediction of Molecular Mutations in Diffuse Low-Grade Gliomas Using MR Imaging Features
Diffuse low-grade gliomas (LGG) have been reclassified based on molecular mutations, which require invasive tumor tissue sampling. Tissue sampling by biopsy may be limited by sampling error, whereas non-invasive imaging can evaluate the entirety of a tumor. This study presents a non-invasive analysis of low-grade gliomas using imaging features based on the updated classification. We introduce molecular (MGMT methylation, IDH mutation, 1p/19q co-deletion, ATRX mutation, and TERT mutations) prediction methods of low-grade gliomas with imaging. Imaging features are extracted from magnetic resonance imaging data and include texture features, fractal and multi-resolution fractal texture features, and volumetric features. Training models include nested leave-one-out cross-validation to select features, train the model, and estimate model performance. The prediction models of MGMT methylation, IDH mutations, 1p/19q co-deletion, ATRX mutation, and TERT mutations achieve a test performance AUC of 0.83 ± 0.04, 0.84 ± 0.03, 0.80 ± 0.04, 0.70 ± 0.09, and 0.82 ±0.04, respectively. Furthermore, our analysis shows that the fractal features have a significant effect on the predictive performance of MGMT methylation IDH mutations, 1p/19q co-deletion, and ATRX mutations. The performance of our prediction methods indicates the potential of correlating computed imaging features with LGG molecular mutations types and identifies candidates that may be considered potential predictive biomarkers of LGG molecular classification
Meningioma segmentation in T1-weighted MRI leveraging global context and attention mechanisms
Meningiomas are the most common type of primary brain tumor, accounting for
approximately 30% of all brain tumors. A substantial number of these tumors are
never surgically removed but rather monitored over time. Automatic and precise
meningioma segmentation is therefore beneficial to enable reliable growth
estimation and patient-specific treatment planning. In this study, we propose
the inclusion of attention mechanisms over a U-Net architecture: (i)
Attention-gated U-Net (AGUNet) and (ii) Dual Attention U-Net (DAUNet), using a
3D MRI volume as input. Attention has the potential to leverage the global
context and identify features' relationships across the entire volume. To limit
spatial resolution degradation and loss of detail inherent to encoder-decoder
architectures, we studied the impact of multi-scale input and deep supervision
components. The proposed architectures are trainable end-to-end and each
concept can be seamlessly disabled for ablation studies. The validation studies
were performed using a 5-fold cross validation over 600 T1-weighted MRI volumes
from St. Olavs University Hospital, Trondheim, Norway. For the best performing
architecture, an average Dice score of 81.6% was reached for an F1-score of
95.6%. With an almost perfect precision of 98%, meningiomas smaller than 3ml
were occasionally missed hence reaching an overall recall of 93%. Leveraging
global context from a 3D MRI volume provided the best performances, even if the
native volume resolution could not be processed directly. Overall, near-perfect
detection was achieved for meningiomas larger than 3ml which is relevant for
clinical use. In the future, the use of multi-scale designs and refinement
networks should be further investigated to improve the performance. A larger
number of cases with meningiomas below 3ml might also be needed to improve the
performance for the smallest tumors.Comment: 16 pages, 5 figures, 3 tables. Submitted to Artificial Intelligence
in Medicin