Hierarchical multi-class segmentation of glioma images using networks with multi-level activation function

For many segmentation tasks, especially for the biomedical image, the topological prior is vital information which is useful to exploit. The containment/nesting is a typical inter-class geometric relationship. In the MICCAI Brain tumor segmentation challenge, with its three hierarchically nested classes 'whole tumor', 'tumor core', 'active tumor', the nested classes relationship is introduced into the 3D-residual-Unet architecture. The network comprises a context aggregation pathway and a localization pathway, which encodes increasingly abstract representation of the input as going deeper into the network, and then recombines these representations with shallower features to precisely localize the interest domain via a localization path. The nested-class-prior is combined by proposing the multi-class activation function and its corresponding loss function. The model is trained on the training dataset of Brats2018, and 20% of the dataset is regarded as the validation dataset to determine parameters. When the parameters are fixed, we retrain the model on the whole training dataset. The performance achieved on the validation leaderboard is 86%, 77% and 72% Dice scores for the whole tumor, enhancing tumor and tumor core classes without relying on ensembles or complicated post-processing steps. Based on the same start-of-the-art network architecture, the accuracy of nested-class (enhancing tumor) is reasonably improved from 69% to 72% compared with the traditional Softmax-based method which blind to topological prior.Comment: 12pages first versio

Computational Modeling for Abnormal Brain Tissue Segmentation, Brain Tumor Tracking, and Grading

This dissertation proposes novel texture feature-based computational models for quantitative analysis of abnormal tissues in two neurological disorders: brain tumor and stroke. Brain tumors are the cells with uncontrolled growth in the brain tissues and one of the major causes of death due to cancer. On the other hand, brain strokes occur due to the sudden interruption of the blood supply which damages the normal brain tissues and frequently causes death or persistent disability. Clinical management of these brain tumors and stroke lesions critically depends on robust quantitative analysis using different imaging modalities including Magnetic Resonance (MR) and Digital Pathology (DP) images. Due to uncontrolled growth and infiltration into the surrounding tissues, the tumor regions appear with a significant texture variation in the static MRI volume and also in the longitudinal imaging study. Consequently, this study developed computational models using novel texture features to segment abnormal brain tissues (tumor, and stroke lesions), tracking the change of tumor volume in longitudinal images, and tumor grading in MR images. Manual delineation and analysis of these abnormal tissues in large scale is tedious, error-prone, and often suffers from inter-observer variability. Therefore, efficient computational models for robust segmentation of different abnormal tissues is required to support the diagnosis and analysis processes. In this study, brain tissues are characterized with novel computational modeling of multi-fractal texture features for multi-class brain tumor tissue segmentation (BTS) and extend the method for ischemic stroke lesions in MRI. The robustness of the proposed segmentation methods is evaluated using a huge amount of private and public domain clinical data that offers competitive performance when compared with that of the state-of-the-art methods. Further, I analyze the dynamic texture behavior of tumor volume in longitudinal imaging and develop post-processing frame-work using three-dimensional (3D) texture features. These post-processing methods are shown to reduce the false positives in the BTS results and improve the overall segmentation result in longitudinal imaging. Furthermore, using this improved segmentation results the change of tumor volume has been quantified in three types such as stable, progress, and shrinkage as observed by the volumetric changes of different tumor tissues in longitudinal images. This study also investigates a novel non-invasive glioma grading, for the first time in literature, that uses structural MRI only. Such non-invasive glioma grading may be useful before an invasive biopsy is recommended. This study further developed an automatic glioma grading scheme using the invasive cell nuclei morphology in DP images for cross-validation with the same patients. In summary, the texture-based computational models proposed in this study are expected to facilitate the clinical management of patients with the brain tumors and strokes by automating large scale imaging data analysis, reducing human error, inter-observer variability, and producing repeatable brain tumor quantitation and grading

Slantlet transform-based segmentation and α -shape theory-based 3D visualization and volume calculation methods for MRI brain tumour

Magnetic Resonance Imaging (MRI) being the foremost significant component of medical diagnosis which requires careful, efficient, precise and reliable image analyses for brain tumour detection, segmentation, visualisation and volume calculation. The inherently varying nature of tumour shapes, locations and image intensities make brain tumour detection greatly intricate. Certainly, having a perfect result of brain tumour detection and segmentation is advantageous. Despite several available methods, tumour detection and segmentation are far from being resolved. Meanwhile, the progress of 3D visualisation and volume calculation of brain tumour is very limited due to absence of ground truth. Thus, this study proposes four new methods, namely abnormal MRI slice detection, brain tumour segmentation based on Slantlet Transform (SLT), 3D visualization and volume calculation of brain tumour based on Alpha (α) shape theory. In addition, two new datasets along with ground truth are created to validate the shape and volume of the brain tumour. The methodology involves three main phases. In the first phase, it begins with the cerebral tissue extraction, followed by abnormal block detection and its fine-tuning mechanism, and ends with abnormal slice detection based on the detected abnormal blocks. The second phase involves brain tumour segmentation that covers three processes. The abnormal slice is first decomposed using the SLT, then its significant coefficients are selected using Donoho universal threshold. The resultant image is composed using inverse SLT to obtain the tumour region. Finally, in the third phase, four original ideas are proposed to visualise and calculate the volume of the tumour. The first idea involves the determination of an optimal α value using a new formula. The second idea is to merge all tumour points for all abnormal slices using the α value to form a set of tetrahedrons. The third idea is to select the most relevant tetrahedrons using the α value as the threshold. The fourth idea is to calculate the volume of the tumour based on the selected tetrahedrons. In order to evaluate the performance of the proposed methods, a series of experiments are conducted using three standard datasets which comprise of 4567 MRI slices of 35 patients. The methods are evaluated using standard practices and benchmarked against the best and up-to-date techniques. Based on the experiments, the proposed methods have produced very encouraging results with an accuracy rate of 96% for the abnormality slice detection along with sensitivity and specificity of 99% for brain tumour segmentation. A perfect result for the 3D visualisation and volume calculation of brain tumour is also attained. The admirable features of the results suggest that the proposed methods may constitute a basis for reliable MRI brain tumour diagnosis and treatments

The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)

In this paper we report the set-up and results of the Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) organized in conjunction with the MICCAI 2012 and 2013 conferences. Twenty state-of-the-art tumor segmentation algorithms were applied to a set of 65 multi-contrast MR scans of low-and high-grade glioma patients-manually annotated by up to four raters-and to 65 comparable scans generated using tumor image simulation software. Quantitative evaluations revealed considerable disagreement between the human raters in segmenting various tumor sub-regions (Dice scores in the range 74%-85%), illustrating the difficulty of this task. We found that different algorithms worked best for different sub-regions (reaching performance comparable to human inter-rater variability), but that no single algorithm ranked in the top for all sub-regions simultaneously. Fusing several good algorithms using a hierarchical majority vote yielded segmentations that consistently ranked above all individual algorithms, indicating remaining opportunities for further methodological improvements. The BRATS image data and manual annotations continue to be publicly available through an online evaluation system as an ongoing benchmarking resource