Longitudinal Brain Tumor Tracking, Tumor Grading, and Patient Survival Prediction Using MRI

This work aims to develop novel methods for brain tumor classification, longitudinal brain tumor tracking, and patient survival prediction. Consequently, this dissertation proposes three tasks. First, we develop a framework for brain tumor segmentation prediction in longitudinal multimodal magnetic resonance imaging (mMRI) scans, comprising two methods: feature fusion and joint label fusion (JLF). The first method fuses stochastic multi-resolution texture features with tumor cell density features, in order to obtain tumor segmentation predictions in follow-up scans from a baseline pre-operative timepoint. The second method utilizes JLF to combine segmentation labels obtained from (i) the stochastic texture feature-based and Random Forest (RF)-based tumor segmentation method; and (ii) another state-of-the-art tumor growth and segmentation method known as boosted Glioma Image Segmentation and Registration (GLISTRboost, or GB). With the advantages of feature fusion and label fusion, we achieve state-of-the-art brain tumor segmentation prediction. Second, we propose a deep neural network (DNN) learning-based method for brain tumor type and subtype grading using phenotypic and genotypic data, following the World Health Organization (WHO) criteria. In addition, the classification method integrates a cellularity feature which is derived from the morphology of a pathology image to improve classification performance. The proposed method achieves state-of-the-art performance for tumor grading following the new CNS tumor grading criteria. Finally, we investigate brain tumor volume segmentation, tumor subtype classification, and overall patient survival prediction, and then we propose a new context- aware deep learning method, known as the Context Aware Convolutional Neural Network (CANet). Using the proposed method, we participated in the Multimodal Brain Tumor Segmentation Challenge 2019 (BraTS 2019) for brain tumor volume segmentation and overall survival prediction tasks. In addition, we also participated in the Radiology-Pathology Challenge 2019 (CPM-RadPath 2019) for Brain Tumor Subtype Classification, organized by the Medical Image Computing & Computer Assisted Intervention (MICCAI) Society. The online evaluation results show that the proposed methods offer competitive performance from their use of state-of-the-art methods in tumor volume segmentation, promising performance on overall survival prediction, and state-of-the-art performance on tumor subtype classification. Moreover, our result was ranked second place in the testing phase of the CPM-RadPath 2019

Hybrid Intelligent System for Diagnosing Breast Pre-Cancerous and Cancerous Conditions Based on Image Analysis

Modern diagnostic technologies are automated microscopy systems (AMSs). In this research study, the authors analyzed the modern AMS methods and algorithms. Criteria-based comparative analysis of AMS has been made, and their advantages and disadvantages have been identified at the three main levels of image processing. This allowed determining the main direction of such systems development, that is, designing the hybrid intelligent AMS. The work of an expert physician implies visual image interpretation, selection of qualitative features of micro-objects, the formation of diagnostic rules based on expert knowledge, and making diagnoses. Knowledge introduction model contains a productive model, in which knowledge is presented in the form of rules expressed in productive pseudo code if-then. Logic inference machine is a module designed to logically derive the facts and rules from the base according to the laws of formal logic. A set of modern methods and algorithms for low-, mid-, and high-level image processing have been used in the AMS structure

Novel approaches to MRI of glioma

Gliomas are extremely heterogeneous, both morphologically and biologically, which contributes to a very poor prognosis. Current imaging of glioma is insufficient for a thorough diagnosis, therapy assessment and prognosis prediction. Moreover, refined and more sophisticated imaging technique could help in furthering our knowledge of gliomas. In order to facilitate proliferation, cancer cells undergo a change in structure and an increase in metabolism that results in distortion and disruption of tissue architecture. Gliomas are characterised by an increase in cells of variable sizes, as well as changes in the tissue microstructure. Diffusion-Weighted Imaging (DWI) and the apparent diffusion coefficient (ADC), have been extensively studied as potential imaging biomarkers for cellularity and tissue architecture. However, several studies have shown partial overlap in the measured values between tumour subtypes. Moreover, ADC is influenced by several factors and does not provide detailed information on the tissue microstructure. The Vascular, Extracellular and Restricted Diffusion for Cytometry in Tumours (VERDICT) is a novel diffusion model that infers tissue microstructure compartment from conventional DWI measurements. This model derives metrics for the intracellular, intravascular and extracellular– extravascular spaces providing a more detailed interpretation of the tissue microstructure. To date, VERDICT has been applied to xenograft models of colorectal cancer, patient studies of prostate cancer and recently its feasibility in glioma has been shown. In this PhD I have applied a shortened version of the VERDICT method to image intratumoral and intertumoral heterogeneity in glioma. The results have also been validated with histology as part of a prospective study. Gliomas also exhibit a significant increase in mitotic activity within the tumour. The increased number of mitosis alters cell density which, in turn, affects the total concentration of tissue sodium as the concentration of tissue sodium is approximately ten-fold higher in the extracellular compared to the intracellular space. In addition, there is a decrease in Na+/K+-ATPase activity in tumours due to ATP depletion, which contributes to disturb sodium homeostasis. Non-invasive detection of 23Na with MRI has the potential to quantify sodium concentration and therefore could be an imaging probe of cell morphology and membrane function within the tumour microenvironment, as well as a method of probing tissue heterogeneity. During my PhD, a novel 23Na-MRI technique has been used to evaluate sodium distribution within glioma and in the surrounding tissue. Metabolic reprogramming is one of the major driving forces for determining glioma growth and invasion. Therefore, the non-invasive characterization of metabolic intratumoral, peritumoral and intertumoral heterogeneity in vivo could help to better stratify patients and to develop novel therapeutic strategies targeting cancer-specific metabolic pathways. 13C magnetic resonance imaging (MRI) using dynamic nuclear polarization (DNP) is a novel technique that allows non-invasive assessment of the metabolism of hyperpolarized (HP) 13C-labelled molecules in vivo, such as the exchange of [1-13C]pyruvate to [1-13C]lactate in tumours (Warburg effect). Part of my PhD has focused on developing and translating HP [1-13C]pyruvate MRI to explore metabolic reprogramming in glioma and the surrounding microenvironment. The overall aim of my PhD has been to develop novel approaches to imaging glioma with MRI to probe both the architectural and metabolic changes of Glioma. The preliminary evidence suggests that these tools can more deeply phenotype tumours than conventional imaging approaches. Although the main focus of this work has been gliomas, the techniques developed and presented here may be applied to study other pathological conditions within the brain, which raises the possibility of other potential clinical applications for this work

Machine Learning Decision Tree Models for Differentiation of Posterior Fossa Tumors Using Diffusion Histogram Analysis and Structural MRI Findings.

We applied machine learning algorithms for differentiation of posterior fossa tumors using apparent diffusion coefficient (ADC) histogram analysis and structural MRI findings. A total of 256 patients with intra-axial posterior fossa tumors were identified, of whom 248 were included in machine learning analysis, with at least 6 representative subjects per each tumor pathology. The ADC histograms of solid components of tumors, structural MRI findings, and patients' age were applied to construct decision models using Classification and Regression Tree analysis. We also compared different machine learning classification algorithms (i.e., naïve Bayes, random forest, neural networks, support vector machine with linear and polynomial kernel) for dichotomized differentiation of the 5 most common tumors in our cohort: metastasis (n = 65), hemangioblastoma (n = 44), pilocytic astrocytoma (n = 43), ependymoma (n = 27), and medulloblastoma (n = 26). The decision tree model could differentiate seven tumor histopathologies with terminal nodes yielding up to 90% accurate classification rates. In receiver operating characteristics (ROC) analysis, the decision tree model achieved greater area under the curve (AUC) for differentiation of pilocytic astrocytoma (p = 0.020); and atypical teratoid/rhabdoid tumor ATRT (p = 0.001) from other types of neoplasms compared to the official clinical report. However, neuroradiologists' interpretations had greater accuracy in differentiating metastases (p = 0.001). Among different machine learning algorithms, random forest models yielded the highest accuracy in dichotomized classification of the 5 most common tumor types; and in multiclass differentiation of all tumor types random forest yielded an averaged AUC of 0.961 in training datasets, and 0.873 in validation samples. Our study demonstrates the potential application of machine learning algorithms and decision trees for accurate differentiation of brain tumors based on pretreatment MRI. Using easy to apply and understandable imaging metrics, the proposed decision tree model can help radiologists with differentiation of posterior fossa tumors, especially in tumors with similar qualitative imaging characteristics. In particular, our decision tree model provided more accurate differentiation of pilocytic astrocytomas from ATRT than by neuroradiologists in clinical reads

Deep Learning in Medical Image Analysis

The accelerating power of deep learning in diagnosing diseases will empower physicians and speed up decision making in clinical environments. Applications of modern medical instruments and digitalization of medical care have generated enormous amounts of medical images in recent years. In this big data arena, new deep learning methods and computational models for efficient data processing, analysis, and modeling of the generated data are crucially important for clinical applications and understanding the underlying biological process. This book presents and highlights novel algorithms, architectures, techniques, and applications of deep learning for medical image analysis

Multimodality and multi-parametric imaging in abdominal oncology:current and future strategies to harnessing the complementary value of PET/CT and MRI

Medical imaging is essential for the diagnosis, treatment and follow-up of patients with cancer. Combinations of different, complementary imaging modalities are increasingly being used: multimodal imaging. This thesis describes recent developments and expected innovations in research (and application of) combined PET/CT and MRI in patients with abdominal cancer. To this end, the effect of integrated assessment of PET/CT and MRI scans was investigated. This resulted in a different result in 1 in 9 patients, as well as a positive effect on the confidence in the results. As a next step, the value of quantitative parameters from PET/CT and MRI was assessed, to predict the treatment outcome of patients with cancer of the rectum, uterine cervix or anus. This value appears to be limited, but the findings from conventional, visual image assessment, does contribute to the prediction

Can Archival Tissue Reveal Answers to Modern Research Questions?: Computer-Aided Histological Assessment of Neuroblastoma Tumours Collected over 60 Years.

Despite neuroblastoma being the most common extracranial solid cancer in childhood, it is still a rare disease. Consequently, the unavailability of tissue for research limits the statistical power of studies. Pathology archives are possible sources of rare tissue, which, if proven to remain consistent over time, could prove useful to research of rare disease types. We applied immunohistochemistry to investigate whether long term storage caused any changes to antigens used diagnostically for neuroblastoma. We constructed and quantitatively assessed a tissue microarray containing neuroblastoma archival material dating between 1950 and 2007. A total of 119 neuroblastoma tissue cores were included spanning 6 decades. Fourteen antibodies were screened across the tissue microarray (TMA). These included seven positive neuroblastoma diagnosis markers (NB84, Chromogranin A, NSE, Ki-67, INI1, Neurofilament Protein, Synaptophysin), two anticipated to be negative (S100A, CD99), and five research antibodies (IL-7, IL-7R, JAK1, JAK3, STAT5). The staining of these antibodies was evaluated using Aperio ImageScope software along with novel pattern recognition and quantification algorithms. This analysis demonstrated that marker signal intensity did not decrease over time and that storage for 60 years had little effect on antigenicity. The construction and assessment of this neuroblastoma TMA has demonstrated the feasibility of using archival samples for research

Feasibility of [F-18]fluoropivalate hybrid PET/MRI for imaging lower and higher grade glioma: a prospective first-in-patient pilot study

Purpose: MRI and PET are used in neuro-oncology for the detection and characterisation of lesions for malignancy to target surgical biopsy and to plan surgical resections or stereotactic radiosurgery. The critical role of short-chain fatty acids (SCFAs) in brain tumour biology has come to the forefront. The non-metabolised SCFA radiotracer, [18F]fluoropivalate (FPIA), shows low background signal in most tissues except eliminating organs and has appropriate human dosimetry. Tumour uptake of the radiotracer is, however, unknown. We investigated the uptake characteristics of FPIA in this pilot PET/MRI study. Methods: Ten adult glioma subjects were identified based on radiological features using standard-of-care MRI prior to any surgical intervention, with subsequent histopathological confirmation of glioma subtype and grade (lower-grade – LGG – and higher-grade – HGG – patients). FPIA was injected as an intravenous bolus injection (range 342–368 MBq), and dynamic PET and MRI data were acquired simultaneously over 66 min. Results: All patients tolerated the PET/MRI protocol. Three patients were reclassified following resection and histology. Tumour maximum standardised uptake value (SUVmax,60) increased in the order LGG (WHO grade 2) < HGG (WHO grade 3) < HGG (WHO grade 4). The net irreversible solute transfer, Ki, and influx rate constant, K1, were significantly higher in HGG (p < 0.05). Of the MRI variables studied, DCE-MRI-derived extravascular-and-extracellular volume fraction (ve) was high in tumours of WHO grade 4 compared with other grades (p < 0.05). SLC25A20 protein expression was higher in HGG compared with LGG. Conclusion: Tumoural FPIA PET uptake is higher in HGG compared to LGG. This study supports further investigation of FPIA PET/MRI for brain tumour imaging in a larger patient population. Clinical trial registration: Clinicaltrials.gov, NCT04097535

Heterogeneity of glycan biomarker clusters as an indicator of recurrence in pancreatic cancer

IntroductionOutcomes following tumor resection vary dramatically among patients with pancreatic ductal adenocarcinoma (PDAC). A challenge in defining predictive biomarkers is to discern within the complex tumor tissue the specific subpopulations and relationships that drive recurrence. Multiplexed immunofluorescence is valuable for such studies when supplied with markers of relevant subpopulations and analysis methods to sort out the intra-tumor relationships that are informative of tumor behavior. We hypothesized that the glycan biomarkers CA19-9 and STRA, which detect separate subpopulations of cancer cells, define intra-tumoral features associated with recurrence.MethodsWe probed this question using automated signal thresholding and spatial cluster analysis applied to the immunofluorescence images of the STRA and CA19-9 glycan biomarkers in whole-block sections of PDAC tumors collected from curative resections.ResultsThe tumors (N = 22) displayed extreme diversity between them in the amounts of the glycans and in the levels of spatial clustering, but neither the amounts nor the clusters of the individual and combined glycans associated with recurrence. The combined glycans, however, marked divergent types of spatial clusters, alternatively only STRA, only CA19-9, or both. The co-occurrence of more than one cluster type within a tumor associated significantly with disease recurrence, in contrast to the independent occurrence of each type of cluster. In addition, intra-tumoral regions with heterogeneity in biomarker clusters spatially aligned with pathology-confirmed cancer cells, whereas regions with homogeneous biomarker clusters aligned with various non-cancer cells.ConclusionThus, the STRA and CA19-9 glycans are markers of distinct and co-occurring subpopulations of cancer cells that in combination are associated with recurrence. Furthermore, automated signal thresholding and spatial clustering provides a tool for quantifying intra-tumoral subpopulations that are informative of outcome