Dynamic contrast enhanced (DCE) MRI estimation of vascular parameters using knowledge-based adaptive models

We introduce and validate four adaptive models (AMs) to perform a physiologically based Nested-Model-Selection (NMS) estimation of such microvascular parameters as forward volumetric transfer constant, K(trans), plasma volume fraction, v(p), and extravascular, extracellular space, v(e), directly from Dynamic Contrast-Enhanced (DCE) MRI raw information without the need for an Arterial-Input Function (AIF). In sixty-six immune-compromised-RNU rats implanted with human U-251 cancer cells, DCE-MRI studies estimated pharmacokinetic (PK) parameters using a group-averaged radiological AIF and an extended Patlak-based NMS paradigm. One-hundred-ninety features extracted from raw DCE-MRI information were used to construct and validate (nested-cross-validation, NCV) four AMs for estimation of model-based regions and their three PK parameters. An NMS-based a priori knowledge was used to fine-tune the AMs to improve their performance. Compared to the conventional analysis, AMs produced stable maps of vascular parameters and nested-model regions less impacted by AIF-dispersion. The performance (Correlation coefficient and Adjusted R-squared for NCV test cohorts) of the AMs were: 0.914/0.834, 0.825/0.720, 0.938/0.880, and 0.890/0.792 for predictions of nested model regions, v(p), K(trans), and v(e), respectively. This study demonstrates an application of AMs that quickens and improves DCE-MRI based quantification of microvasculature properties of tumors and normal tissues relative to conventional approaches

Direct inference of Patlak parametric images in whole-body PET/CT imaging using convolutional neural networks

Purpose: This study proposed and investigated the feasibility of estimating Patlak-derived influx rate constant (Ki) from standardized uptake value (SUV) and/or dynamic PET image series. Methods: Whole-body 18F-FDG dynamic PET images of 19 subjects consisting of 13 frames or passes were employed for training a residual deep learning model with SUV and/or dynamic series as input and Ki-Patlak (slope) images as output. The training and evaluation were performed using a nine-fold cross-validation scheme. Owing to the availability of SUV images acquired 60 min post-injection (20 min total acquisition time), the data sets used for the training of the models were split into two groups: “With SUV” and “Without SUV.” For “With SUV” group, the model was first trained using only SUV images and then the passes (starting from pass 13, the last pass, to pass 9) were added to the training of the model (one pass each time). For this group, 6 models were developed with input data consisting of SUV, SUV plus pass 13, SUV plus passes 13 and 12, SUV plus passes 13 to 11, SUV plus passes 13 to 10, and SUV plus passes 13 to 9. For the “Without SUV” group, the same trend was followed, but without using the SUV images (5 models were developed with input data of passes 13 to 9). For model performance evaluation, the mean absolute error (MAE), mean error (ME), mean relative absolute error (MRAE%), relative error (RE%), mean squared error (MSE), root mean squared error (RMSE), peak signal-to-noise ratio (PSNR), and structural similarity index (SSIM) were calculated between the predicted Ki-Patlak images by the two groups and the reference Ki-Patlak images generated through Patlak analysis using the whole acquired data sets. For specific evaluation of the method, regions of interest (ROIs) were drawn on representative organs, including the lung, liver, brain, and heart and around the identified malignant lesions. Results: The MRAE%, RE%, PSNR, and SSIM indices across all patients were estimated as 7.45 ± 0.94%, 4.54 ± 2.93%, 46.89 ± 2.93, and 1.00 ± 6.7 × 10−7, respectively, for models predicted using SUV plus passes 13 to 9 as input. The predicted parameters using passes 13 to 11 as input exhibited almost similar results compared to the predicted models using SUV plus passes 13 to 9 as input. Yet, the bias was continuously reduced by adding passes until pass 11, after which the magnitude of error reduction was negligible. Hence, the predicted model with SUV plus passes 13 to 9 had the lowest quantification bias. Lesions invisible in one or both of SUV and Ki-Patlak images appeared similarly through visual inspection in the predicted images with tolerable bias. Conclusion: This study concluded the feasibility of direct deep learning-based approach to estimate Ki-Patlak parametric maps without requiring the input function and with a fewer number of passes. This would lead to shorter acquisition times for WB dynamic imaging with acceptable bias and comparable lesion detectability performance.</p

Computerized Analysis of Magnetic Resonance Images to Study Cerebral Anatomy in Developing Neonates

The study of cerebral anatomy in developing neonates is of great importance for the understanding of brain development during the early period of life. This dissertation therefore focuses on three challenges in the modelling of cerebral anatomy in neonates during brain development. The methods that have been developed all use Magnetic Resonance Images (MRI) as source data. To facilitate study of vascular development in the neonatal period, a set of image analysis algorithms are developed to automatically extract and model cerebral vessel trees. The whole process consists of cerebral vessel tracking from automatically placed seed points, vessel tree generation, and vasculature registration and matching. These algorithms have been tested on clinical Time-of- Flight (TOF) MR angiographic datasets. To facilitate study of the neonatal cortex a complete cerebral cortex segmentation and reconstruction pipeline has been developed. Segmentation of the neonatal cortex is not effectively done by existing algorithms designed for the adult brain because the contrast between grey and white matter is reversed. This causes pixels containing tissue mixtures to be incorrectly labelled by conventional methods. The neonatal cortical segmentation method that has been developed is based on a novel expectation-maximization (EM) method with explicit correction for mislabelled partial volume voxels. Based on the resulting cortical segmentation, an implicit surface evolution technique is adopted for the reconstruction of the cortex in neonates. The performance of the method is investigated by performing a detailed landmark study. To facilitate study of cortical development, a cortical surface registration algorithm for aligning the cortical surface is developed. The method first inflates extracted cortical surfaces and then performs a non-rigid surface registration using free-form deformations (FFDs) to remove residual alignment. Validation experiments using data labelled by an expert observer demonstrate that the method can capture local changes and follow the growth of specific sulcus

An extended vascular model for less biased estimation of permeability parameters in DCEâ T1 images

Peer Reviewedhttps://deepblue.lib.umich.edu/bitstream/2027.42/137317/1/nbm3698_am.pdfhttps://deepblue.lib.umich.edu/bitstream/2027.42/137317/2/nbm3698.pd

Quantification Of Vascular Parametric Indices Using Dynamic Contrast-Enhanced Magnetic Resonance Imaging

Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) is a non-invasive method used to evaluate the biological activity in early clinical trials of novel drugs targeting the tumor vasculature using gadolinium-DTPA (Gd) as a contrast agent. However, it has some limitations, such as reproducibility, data acquisition times, the presence of noise, extracting contrast concentration, estimating T1 relaxation and estimating pharmacokinetic parameters. In this work, a new approach to used fixed T1(0) which provides more reproducible DCE results has been introduced. Using this new algorithm to quantify the vascular changes in DCE-MRI, a pre-clinical renal cell carcinoma (RCC) tumor model was used to demonstrate the ability of DCE-MRI to quantify the vascular changes induced by various doses of sunitinib in tumor-bearing kidneys and normal contralateral kidneys. Usually, only the first minute of data are used for processing to calculate the initial area under the curve (IAUC) and/or the median value of cumulative initial area under the curve (CIAUC) in order to monitor changes between pre and post drug treatment. However, in this work, the first two minutes was used to include the effect of the washout process of the kidneys. Moreover, DCE-MRI was used to investigate the vascular changes induced by pre-treatment with sunitinib in KCL-18 kidney tumors to schedule the initiation of chemotherapy. DCE results were confirmed with the histologic studies. In this thesis, several new measures of vascular properties have been introduced, including: the fraction of active pixels (FAP); contrast agent uptake to the peak (AUCtp); time to peak concentration (TTP); washout slope (Nslope); as well as full width half maximum (FWHM) of IAUC. The results from the pre-clinical RCC tumor model demonstrate that DCE parametric maps have the potential to assess the effect of antiangiogenic drugs on blood flow and physiological vascular changes in tumors as well as normal tissues. These new parametric maps provided further guidance as to what could be considered normal versus abnormal tissue response to antiangiogenic therapy. The results of this research should lead to a clear improvement in the ability of DCE-MRI as a quantitative method to evaluate tumor vasculature and other hemodynamic properties

Quantitative analysis with machine learning models for multi-parametric brain imaging data

Gliomas are considered to be the most common primary adult malignant brain tumor. With the dramatic increases in computational power and improvements in image analysis algorithms, computer-aided medical image analysis has been introduced into clinical applications. Precision tumor grading and genotyping play an indispensable role in clinical diagnosis, treatment and prognosis. Gliomas diagnostic procedures include histopathological imaging tests, molecular imaging scans and tumor grading. Pathologic review of tumor morphology in histologic sections is the traditional method for cancer classification and grading, yet human study has limitations that can result in low reproducibility and inter-observer agreement. Compared with histopathological images, Magnetic resonance (MR) imaging present the different structure and functional features, which might serve as noninvasive surrogates for tumor genotypes. Therefore, computer-aided image analysis has been adopted in clinical application, which might partially overcome these shortcomings due to its capacity to quantitatively and reproducibly measure multilevel features on multi-parametric medical information. Imaging features obtained from a single modal image do not fully represent the disease, so quantitative imaging features, including morphological, structural, cellular and molecular level features, derived from multi-modality medical images should be integrated into computer-aided medical image analysis. The image quality differentiation between multi-modality images is a challenge in the field of computer-aided medical image analysis. In this thesis, we aim to integrate the quantitative imaging data obtained from multiple modalities into mathematical models of tumor prediction response to achieve additional insights into practical predictive value. Our major contributions in this thesis are: 1. Firstly, to resolve the imaging quality difference and observer-dependent in histological image diagnosis, we proposed an automated machine-learning brain tumor-grading platform to investigate contributions of multi-parameters from multimodal data including imaging parameters or features from Whole Slide Images (WSI) and the proliferation marker KI-67. For each WSI, we extract both visual parameters such as morphology parameters and sub-visual parameters including first-order and second-order features. A quantitative interpretable machine learning approach (Local Interpretable Model-Agnostic Explanations) was followed to measure the contribution of features for single case. Most grading systems based on machine learning models are considered “black boxes,” whereas with this system the clinically trusted reasoning could be revealed. The quantitative analysis and explanation may assist clinicians to better understand the disease and accordingly to choose optimal treatments for improving clinical outcomes. 2. Based on the automated brain tumor-grading platform we propose, multimodal Magnetic Resonance Images (MRIs) have been introduced in our research. A new imaging–tissue correlation based approach called RA-PA-Thomics was proposed to predict the IDH genotype. Inspired by the concept of image fusion, we integrate multimodal MRIs and the scans of histopathological images for indirect, fast, and cost saving IDH genotyping. The proposed model has been verified by multiple evaluation criteria for the integrated data set and compared to the results in the prior art. The experimental data set includes public data sets and image information from two hospitals. Experimental results indicate that the model provided improves the accuracy of glioma grading and genotyping

Development and application of quantitative image analysis for preclinical MRI research

The aim of this thesis is to develop quantitative analysis methods to validate MRI and improve the detection of tumour infiltration. The major components include a description of the development the quantitative methods to better validate imaging biomarkers and detect of infiltration of tumour cells into normal tissue, which were then applied to a mouse model of glioblastoma invasion. To do this, a new histology model, called Stacked In-plane Histology (SIH), was developed to allow a quantitative analysis of MRI. Validating imaging biomarkers for glioblastoma infiltration Cancer can be defined as a disease in which a group of abnormal cells grow uncontrollably, often with fatal outcomes. According to (Cancer research UK, 2019), there are more than 363,000 new cancer cases in the UK every year, an increase from the 990 cases reported daily in 2014-2016, with only half of all patients recovering. Glioblastoma (GB) is the most frequent and malignant form of primary brain tumours with a very poor prognosis. Even with the development of modern diagnostic strategies and new therapies, the five-year survival rate is just 5%, with the median survival time only 14 months. Unfortunately, glioblastoma can affect patients at any age, including young children, but has a peak occurrence between the ages of 65 and 75 years. The standard treatment for GB consists of surgical resection, followed by radiotherapy and chemotherapy. However, the infiltration of GB cells into healthy adjacent brain tissue is a major obstacle for successful treatment, making complete removal of a tumour by surgery a difficult task, with the potential for tumour recurrence. Magnetic Resonance Imaging (MRI) is a non-invasive, multipurpose imaging tool used for the diagnosis and monitoring of cancerous tumours. It can provide morphological, physiological, and metabolic information about the tumour. Currently, MRI is the standard diagnostic tool for GB before the pathological examination of tissue from surgical resection or biopsy specimens. The standard MRI sequences used for diagnosis of GB include T2-Weighted (T2W), T1-Weighted (T1W), Fluid-Attenuated Inversion Recovery (FLAIR), and Contrast Enhance T1 gadolinium (CE-T1) scans. These conventional scans are used to localize the tumour, in addition to associated oedema and necrosis. Although these scans can identify the bulk of the tumour, it is known that they do not detect regions infiltrated by GB cells. The MRI signal depends upon many physical parameters including water content, local structure, tumbling rates, diffusion, and hypoxia (Dominietto, 2014). There has been considerable interest in identifying whether such biologically indirect image contrasts can be used as non-invasive imaging biomarkers, either for normal biological functions, pathogenic processes or pharmacological responses to therapeutic interventions (Atkinson et al., 2001). In fact, when new MRI methods are proposed as imaging biomarkers of particular diseases, it is crucial that they are validated against histopathology. In humans, such validation is limited to a biopsy, which is the gold standard of diagnosis for most types of cancer. Some types of biopsies can take an image-guided approach using MRI, Computed Tomography (CT) or Ultrasound (US). However, a biopsy may miss the most malignant region of the tumour and is difficult to repeat. Biomarker validation can be performed in preclinical disease models, where the animal can be terminated immediately after imaging for histological analysis. Here, in principle, co-registration of the biomarker images with the histopathology would allow for direct validation. However, in practice, most preclinical validation studies have been limited to using simple visual comparisons to assess the correlation between the imaging biomarker and underlying histopathology. First objective (Chapter 5): Histopathology is the gold standard for assessing non-invasive imaging biomarkers, with most validation approaches involving a qualitative visual inspection. To allow a more quantitative analysis, previous studies have attempted to co-register MRI with histology. However, these studies have focused on developing better algorithms to deal with the distortions common in histology sections. By contrast, we have taken an approach to improve the quality of the histological processing and analysis, for example, by taking into account the imaging slice orientation and thickness. Multiple histology sections were cut in the MR imaging plane to produce a Stacked In-plane Histology (SIH) map. This approach, which is applied to the next two objectives, creates a histopathology map which can be used as the gold standard to quantitatively validate imaging biomarkers. Second objective (Chapter 6): Glioblastoma is the most malignant form of primary brain tumour and recurrence following treatment is common. Non-invasive MR imaging is an important component of brain tumour diagnosis and treatment planning. Unfortunately, clinic MRI (T1W, T2W, CE-T1, and FLAIR) fails to detect regions of glioblastoma cell infiltration beyond the solid tumour region identified by contrast enhanced T1 scans. However, advanced MRI techniques such as Arterial Spin Labelling (ASL) could provide us with extra information (perfusion) which may allow better detection of infiltration. In order to assess whether local perfusion perturbation could provide a useful biomarker for glioblastoma cell infiltration, we quantitatively analysed the correlation between perfusion MRI (ASL) and stacked in-plane histology. This work used a mouse model of glioblastoma that mimics the infiltrative behaviour found in human patients. The results demonstrate the ability of perfusion imaging to probe regions of low tumour cell infiltration, while confirming the sensitivity limitations of clinic imaging modalities. Third objective (Chapter 7): It is widely hypothesised that Multiparametric MRI (mpMRI), can extract more information than is obtained from the constituent individual MR images, by reconstructing a single map that contains complementary information. Using the MRI and histology dataset from objective 2, we used a multi-regression algorithm to reconstruct a single map which was highly correlated (r>0.6) with histology. The results are promising, showing that mpMRI can better predict the whole tumour region, including the region of tumour cell infiltration

Analysis of contrast-enhanced medical images.

Early detection of human organ diseases is of great importance for the accurate diagnosis and institution of appropriate therapies. This can potentially prevent progression to end-stage disease by detecting precursors that evaluate organ functionality. In addition, it also assists the clinicians for therapy evaluation, tracking diseases progression, and surgery operations. Advances in functional and contrast-enhanced (CE) medical images enabled accurate noninvasive evaluation of organ functionality due to their ability to provide superior anatomical and functional information about the tissue-of-interest. The main objective of this dissertation is to develop a computer-aided diagnostic (CAD) system for analyzing complex data from CE magnetic resonance imaging (MRI). The developed CAD system has been tested in three case studies: (i) early detection of acute renal transplant rejection, (ii) evaluation of myocardial perfusion in patients with ischemic heart disease after heart attack; and (iii), early detection of prostate cancer. However, developing a noninvasive CAD system for the analysis of CE medical images is subject to multiple challenges, including, but are not limited to, image noise and inhomogeneity, nonlinear signal intensity changes of the images over the time course of data acquisition, appearances and shape changes (deformations) of the organ-of-interest during data acquisition, determination of the best features (indexes) that describe the perfusion of a contrast agent (CA) into the tissue. To address these challenges, this dissertation focuses on building new mathematical models and learning techniques that facilitate accurate analysis of CAs perfusion in living organs and include: (i) accurate mathematical models for the segmentation of the object-of-interest, which integrate object shape and appearance features in terms of pixel/voxel-wise image intensities and their spatial interactions; (ii) motion correction techniques that combine both global and local models, which exploit geometric features, rather than image intensities to avoid problems associated with nonlinear intensity variations of the CE images; (iii) fusion of multiple features using the genetic algorithm. The proposed techniques have been integrated into CAD systems that have been tested in, but not limited to, three clinical studies. First, a noninvasive CAD system is proposed for the early and accurate diagnosis of acute renal transplant rejection using dynamic contrast-enhanced MRI (DCE-MRI). Acute rejection–the immunological response of the human immune system to a foreign kidney–is the most sever cause of renal dysfunction among other diagnostic possibilities, including acute tubular necrosis and immune drug toxicity. In the U.S., approximately 17,736 renal transplants are performed annually, and given the limited number of donors, transplanted kidney salvage is an important medical concern. Thus far, biopsy remains the gold standard for the assessment of renal transplant dysfunction, but only as the last resort because of its invasive nature, high cost, and potential morbidity rates. The diagnostic results of the proposed CAD system, based on the analysis of 50 independent in-vivo cases were 96% with a 95% confidence interval. These results clearly demonstrate the promise of the proposed image-based diagnostic CAD system as a supplement to the current technologies, such as nuclear imaging and ultrasonography, to determine the type of kidney dysfunction. Second, a comprehensive CAD system is developed for the characterization of myocardial perfusion and clinical status in heart failure and novel myoregeneration therapy using cardiac first-pass MRI (FP-MRI). Heart failure is considered the most important cause of morbidity and mortality in cardiovascular disease, which affects approximately 6 million U.S. patients annually. Ischemic heart disease is considered the most common underlying cause of heart failure. Therefore, the detection of the heart failure in its earliest forms is essential to prevent its relentless progression to premature death. While current medical studies focus on detecting pathological tissue and assessing contractile function of the diseased heart, this dissertation address the key issue of the effects of the myoregeneration therapy on the associated blood nutrient supply. Quantitative and qualitative assessment in a cohort of 24 perfusion data sets demonstrated the ability of the proposed framework to reveal regional perfusion improvements with therapy, and transmural perfusion differences across the myocardial wall; thus, it can aid in follow-up on treatment for patients undergoing the myoregeneration therapy. Finally, an image-based CAD system for early detection of prostate cancer using DCE-MRI is introduced. Prostate cancer is the most frequently diagnosed malignancy among men and remains the second leading cause of cancer-related death in the USA with more than 238,000 new cases and a mortality rate of about 30,000 in 2013. Therefore, early diagnosis of prostate cancer can improve the effectiveness of treatment and increase the patient’s chance of survival. Currently, needle biopsy is the gold standard for the diagnosis of prostate cancer. However, it is an invasive procedure with high costs and potential morbidity rates. Additionally, it has a higher possibility of producing false positive diagnosis due to relatively small needle biopsy samples. Application of the proposed CAD yield promising results in a cohort of 30 patients that would, in the near future, represent a supplement of the current technologies to determine prostate cancer type. The developed techniques have been compared to the state-of-the-art methods and demonstrated higher accuracy as shown in this dissertation. The proposed models (higher-order spatial interaction models, shape models, motion correction models, and perfusion analysis models) can be used in many of today’s CAD applications for early detection of a variety of diseases and medical conditions, and are expected to notably amplify the accuracy of CAD decisions based on the automated analysis of CE images

The University of Pennsylvania Glioblastoma (UPenn-GBM) cohort: Advanced MRI, clinical, genomics, & radiomics

Glioblastoma is the most common aggressive adult brain tumor. Numerous studies have reported results from either private institutional data or publicly available datasets. However, current public datasets are limited in terms of: a) number of subjects, b) lack of consistent acquisition protocol, c) data quality, or d) accompanying clinical, demographic, and molecular information. Toward alleviating these limitations, we contribute the University of Pennsylvania Glioblastoma Imaging, Genomics, and Radiomics (UPenn-GBM) dataset, which describes the currently largest publicly available comprehensive collection of 630 patients diagnosed with de novo glioblastoma. The UPenn-GBM dataset includes (a) advanced multi-parametric magnetic resonance imaging scans acquired during routine clinical practice, at the University of Pennsylvania Health System, (b) accompanying clinical, demographic, and molecular information, (d) perfusion and diffusion derivative volumes, (e) computationally-derived and manually-revised expert annotations of tumor sub-regions, as well as (f) quantitative imaging (also known as radiomic) features corresponding to each of these regions. This collection describes our contribution towards repeatable, reproducible, and comparative quantitative studies leading to new predictive, prognostic, and diagnostic assessments