DEVELOPING NOVEL COMPUTER-AIDED DETECTION AND DIAGNOSIS SYSTEMS OF MEDICAL IMAGES

Reading medical images to detect and diagnose diseases is often difficult and has large inter-reader variability. To address this issue, developing computer-aided detection and diagnosis (CAD) schemes or systems of medical images has attracted broad research interest in the last several decades. Despite great effort and significant progress in previous studies, only limited CAD schemes have been used in clinical practice. Thus, developing new CAD schemes is still a hot research topic in medical imaging informatics field. In this dissertation, I investigate the feasibility of developing several new innovative CAD schemes for different application purposes. First, to predict breast tumor response to neoadjuvant chemotherapy and reduce unnecessary aggressive surgery, I developed two CAD schemes of breast magnetic resonance imaging (MRI) to generate quantitative image markers based on quantitative analysis of global kinetic features. Using the image marker computed from breast MRI acquired pre-chemotherapy, CAD scheme enables to predict radiographic complete response (CR) of breast tumors to neoadjuvant chemotherapy, while using the imaging marker based on the fusion of kinetic and texture features extracted from breast MRI performed after neoadjuvant chemotherapy, CAD scheme can better predict the pathologic complete response (pCR) of the patients. Second, to more accurately predict prognosis of stroke patients, quantifying brain hemorrhage and ventricular cerebrospinal fluid depicting on brain CT images can play an important role. For this purpose, I developed a new interactive CAD tool to segment hemorrhage regions and extract radiological imaging marker to quantitatively determine the severity of aneurysmal subarachnoid hemorrhage at presentation and correlate the estimation with various homeostatic/metabolic derangements and predict clinical outcome. Third, to improve the efficiency of primary antibody screening processes in new cancer drug development, I developed a CAD scheme to automatically identify the non-negative tissue slides, which indicate reactive antibodies in digital pathology images. Last, to improve operation efficiency and reliability of storing digital pathology image data, I developed a CAD scheme using optical character recognition algorithm to automatically extract metadata from tissue slide label images and reduce manual entry for slide tracking and archiving in the tissue pathology laboratories. In summary, in these studies, we developed and tested several innovative approaches to identify quantitative imaging markers with high discriminatory power. In all CAD schemes, the graphic user interface-based visual aid tools were also developed and implemented. Study results demonstrated feasibility of applying CAD technology to several new application fields, which has potential to assist radiologists, oncologists and pathologists improving accuracy and consistency in disease diagnosis and prognosis assessment of using medical image

PET-MR Imaging of Hypoxia and Vascularity in Breast Cancer

Breast cancer is the most common cancer in the UK and in women globally. Imaging methods like mammography, ultrasound (US) and magnetic resonance imaging (MRI) play an important role in the diagnosis and management of breast cancer; they are generally utilised to provide anatomical or structural description of tumours in the clinical setting. It is widely accepted that the tumour microenvironment influences the phenotype, progression and treatment of breast cancer. This gave the impetus to move beyond tumour visualization in images to radiomics in order to provide additional disease characterisation and early biomarkers of tumour response. Due to their ability to assess physiological processes in vivo, positron emission tomography (PET) and MRI can provide non-invasive characterisation of the tumour microenvironment, including perfusion, vascular permeability, cellularity and hypoxia, which is associated with poor clinical outcome and metastasis. Clinical imaging studies in breast tumours have hitherto assessed tumour physiological parameters separately, with only few directly comparing data from these modalities. To this end, hybrid PET-MRI represents an attractive option as it can allow examination of functional processes and features of tumours simultaneously, while also conferring methodological advantages to the way imaging information is combined. The main aim of this thesis is to provide a better understanding of breast cancer pathophysiology using simultaneous PET and multi-parametric MRI. In particular, this work aims to explore relationships between imaging biomarkers of tumour vascularity measured by dynamic contrast-enhanced (DCE) MRI, cellularity using diffusion-weighted imaging (DWI) and hypoxic status using 18F-fluoromisonidazole (18F-FMISO) PET. Correlations between functional PET-MRI parameters and immunohistochemical (IHC) biomarkers of hypoxia and vascularity as well as MRI morphological tumour descriptors are also presented. The thesis concludes with an investigation of the utility of MRI markers of perfusion and surrogate markers of hypoxia to quantitatively monitor and predict pathological response in patients undergoing neoadjuvant chemotherapy (NACT) and provides projections for future work

Radiomic analysis reveals DCE-MRI features for prediction of molecular subtypes of breast cancer

This work was supported in part by financial support from the National Natural Science Foundation of China (61271063 and 61401131), the National Basic Research Program of China (973 Program) (2013CB329502), and the Natural Science Foundation of Zhejiang Province of China (LZ15F010001 and LQ14F010011).The purpose of this study was to investigate the role of features derived from breast dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) and to incorporated clinical information to predict the molecular subtypes of breast cancer. In particular, 60 breast cancers with the following four molecular subtypes were analyzed: luminal A, luminal B, human epidermal growth factor receptor-2 (HER2)-over-expressing and basal-like. The breast region was segmented and the suspicious tumor was depicted on sequentially scanned MR images from each case. In total, 90 features were obtained, including 88 imaging features related to morphology and texture as well as dynamic features from tumor and background parenchymal enhancement (BPE) and 2 clinical information-based parameters, namely, age and menopausal status. An evolutionary algorithm was used to select an optimal subset of features for classification. Using these features, we trained a multi-class logistic regression classifier that calculated the area under the receiver operating characteristic curve (AUC). The results of a prediction model using 24 selected features showed high overall classification performance, with an AUC value of 0.869. The predictive model discriminated among the luminal A, luminal B, HER2 and basal-like subtypes, with AUC values of 0.867, 0.786, 0.888 and 0.923, respectively. An additional independent dataset with 36 patients was utilized to validate the results. A similar classification analysis of the validation dataset showed an AUC of 0.872 using 15 image features, 10 of which were identical to those from the first cohort. We identified clinical information and 3D imaging features from DCE-MRI as candidate biomarkers for discriminating among four molecular subtypes of breast cancer.Yeshttp://www.plosone.org/static/editorial#pee

Computer-aided detection and diagnosis of breast cancer in 2D and 3D medical imaging through multifractal analysis

This Thesis describes the research work performed in the scope of a doctoral research program and presents its conclusions and contributions. The research activities were carried on in the industry with Siemens S.A. Healthcare Sector, in integration with a research team. Siemens S.A. Healthcare Sector is one of the world biggest suppliers of products, services and complete solutions in the medical sector. The company offers a wide selection of diagnostic and therapeutic equipment and information systems. Siemens products for medical imaging and in vivo diagnostics include: ultrasound, computer tomography, mammography, digital breast tomosynthesis, magnetic resonance, equipment to angiography and coronary angiography, nuclear imaging, and many others. Siemens has a vast experience in Healthcare and at the beginning of this project it was strategically interested in solutions to improve the detection of Breast Cancer, to increase its competitiveness in the sector. The company owns several patents related with self-similarity analysis, which formed the background of this Thesis. Furthermore, Siemens intended to explore commercially the computer- aided automatic detection and diagnosis eld for portfolio integration. Therefore, with the high knowledge acquired by University of Beira Interior in this area together with this Thesis, will allow Siemens to apply the most recent scienti c progress in the detection of the breast cancer, and it is foreseeable that together we can develop a new technology with high potential. The project resulted in the submission of two invention disclosures for evaluation in Siemens A.G., two articles published in peer-reviewed journals indexed in ISI Science Citation Index, two other articles submitted in peer-reviewed journals, and several international conference papers. This work on computer-aided-diagnosis in breast led to innovative software and novel processes of research and development, for which the project received the Siemens Innovation Award in 2012. It was very rewarding to carry on such technological and innovative project in a socially sensitive area as Breast Cancer.No cancro da mama a deteção precoce e o diagnóstico correto são de extrema importância na prescrição terapêutica e caz e e ciente, que potencie o aumento da taxa de sobrevivência à doença. A teoria multifractal foi inicialmente introduzida no contexto da análise de sinal e a sua utilidade foi demonstrada na descrição de comportamentos siológicos de bio-sinais e até na deteção e predição de patologias. Nesta Tese, três métodos multifractais foram estendidos para imagens bi-dimensionais (2D) e comparados na deteção de microcalci cações em mamogramas. Um destes métodos foi também adaptado para a classi cação de massas da mama, em cortes transversais 2D obtidos por ressonância magnética (RM) de mama, em grupos de massas provavelmente benignas e com suspeição de malignidade. Um novo método de análise multifractal usando a lacunaridade tri-dimensional (3D) foi proposto para classi cação de massas da mama em imagens volumétricas 3D de RM de mama. A análise multifractal revelou diferenças na complexidade subjacente às localizações das microcalci cações em relação aos tecidos normais, permitindo uma boa exatidão da sua deteção em mamogramas. Adicionalmente, foram extraídas por análise multifractal características dos tecidos que permitiram identi car os casos tipicamente recomendados para biópsia em imagens 2D de RM de mama. A análise multifractal 3D foi e caz na classi cação de lesões mamárias benignas e malignas em imagens 3D de RM de mama. Este método foi mais exato para esta classi cação do que o método 2D ou o método padrão de análise de contraste cinético tumoral. Em conclusão, a análise multifractal fornece informação útil para deteção auxiliada por computador em mamogra a e diagnóstico auxiliado por computador em imagens 2D e 3D de RM de mama, tendo o potencial de complementar a interpretação dos radiologistas

Complexity Reduction in Image-Based Breast Cancer Care

The diversity of malignancies of the breast requires personalized diagnostic and therapeutic decision making in a complex situation. This thesis contributes in three clinical areas: (1) For clinical diagnostic image evaluation, computer-aided detection and diagnosis of mass and non-mass lesions in breast MRI is developed. 4D texture features characterize mass lesions. For non-mass lesions, a combined detection/characterisation method utilizes the bilateral symmetry of the breast s contrast agent uptake. (2) To improve clinical workflows, a breast MRI reading paradigm is proposed, exemplified by a breast MRI reading workstation prototype. Instead of mouse and keyboard, it is operated using multi-touch gestures. The concept is extended to mammography screening, introducing efficient navigation aids. (3) Contributions to finite element modeling of breast tissue deformations tackle two clinical problems: surgery planning and the prediction of the breast deformation in a MRI biopsy device

Pattern classification approaches for breast cancer identification via MRI: state‐of‐the‐art and vision for the future

Mining algorithms for Dynamic Contrast Enhanced Magnetic Resonance Imaging (DCEMRI) of breast tissue are discussed. The algorithms are based on recent advances in multidimensional signal processing and aim to advance current state‐of‐the‐art computer‐aided detection and analysis of breast tumours when these are observed at various states of development. The topics discussed include image feature extraction, information fusion using radiomics, multi‐parametric computer‐aided classification and diagnosis using information fusion of tensorial datasets as well as Clifford algebra based classification approaches and convolutional neural network deep learning methodologies. The discussion also extends to semi‐supervised deep learning and self‐supervised strategies as well as generative adversarial networks and algorithms using generated confrontational learning approaches. In order to address the problem of weakly labelled tumour images, generative adversarial deep learning strategies are considered for the classification of different tumour types. The proposed data fusion approaches provide a novel Artificial Intelligence (AI) based framework for more robust image registration that can potentially advance the early identification of heterogeneous tumour types, even when the associated imaged organs are registered as separate entities embedded in more complex geometric spaces. Finally, the general structure of a high‐dimensional medical imaging analysis platform that is based on multi‐task detection and learning is proposed as a way forward. The proposed algorithm makes use of novel loss functions that form the building blocks for a generated confrontation learning methodology that can be used for tensorial DCE‐MRI. Since some of the approaches discussed are also based on time‐lapse imaging, conclusions on the rate of proliferation of the disease can be made possible. The proposed framework can potentially reduce the costs associated with the interpretation of medical images by providing automated, faster and more consistent diagnosis

The Era of Radiogenomics in Precision Medicine: An Emerging Approach to Support Diagnosis, Treatment Decisions, and Prognostication in Oncology

With the rapid development of new technologies, including artificial intelligence and genome sequencing, radiogenomics has emerged as a state-of-the-art science in the field of individualized medicine. Radiogenomics combines a large volume of quantitative data extracted from medical images with individual genomic phenotypes and constructs a prediction model through deep learning to stratify patients, guide therapeutic strategies, and evaluate clinical outcomes. Recent studies of various types of tumors demonstrate the predictive value of radiogenomics. And some of the issues in the radiogenomic analysis and the solutions from prior works are presented. Although the workflow criteria and international agreed guidelines for statistical methods need to be confirmed, radiogenomics represents a repeatable and cost-effective approach for the detection of continuous changes and is a promising surrogate for invasive interventions. Therefore, radiogenomics could facilitate computer-aided diagnosis, treatment, and prediction of the prognosis in patients with tumors in the routine clinical setting. Here, we summarize the integrated process of radiogenomics and introduce the crucial strategies and statistical algorithms involved in current studies

INTEGRATION OF BIOMEDICAL IMAGING AND TRANSLATIONAL APPROACHES FOR MANAGEMENT OF HEAD AND NECK CANCER

The aim of the clinical component of this work was to determine whether the currently available clinical imaging tools can be integrated with radiotherapy (RT) platforms for monitoring and adaptation of radiation dose, prediction of tumor response and disease outcomes, and characterization of patterns of failure and normal tissue toxicity in head and neck cancer (HNC) patients with potentially curable tumors. In Aim 1, we showed that the currently available clinical imaging modalities can be successfully used to adapt RT dose based-on dynamic tumor response, predict oncologic disease outcomes, characterize RT-induced toxicity, and identify the patterns of disease failure. We used anatomical MRIs for the RT dose adaptation purpose. Our findings showed that after proper standardization of the immobilization and image acquisition techniques, we can achieve high geometric accuracy. These images can then be used to monitor the shrinkage of tumors during RT and optimize the clinical target volumes accordingly. Our results also showed that this MR-guided dose adaptation technique has a dosimetric advantage over the standard of care and was associated with a reduction in normal tissue doses that translated into a reduction of the odds of long-term RT-induced toxicity. In the second aim, we used quantitative MRIs to determine its benefit for prediction of oncologic outcomes and characterization of RT-induced normal tissue toxicity. Our findings showed that delta changes of apparent diffusion coefficient parameters derived from diffusion-weighted images at mid-RT can be used to predict local recurrence and recurrence free-survival. We also showed that Ktrans and Ve vascular parameters derived from dynamic contrast-enhanced MRIs can characterize the mandibular areas of osteoradionecrosis. In the final clinical aim, we used CT images of recurrence and baseline CT planning images to develop a methodology and workflow that involves the application of deformable image registration software as a tool to standardize image co-registration in addition to granular combined geometric- and dosimetric-based failure characterization to correctly attribute sites and causes of locoregional failure. We then successfully applied this methodology to identify the patterns of failure following postoperative and definitive IMRT in HNC patients. Using this methodology, we showed that most recurrences occurred in the central high dose regions for patients treated with definitive IMRT compared with mainly non-central high dose recurrences after postoperative IMRT. We also correlated recurrences with pretreatment FDG-PET and identified that most of the central high dose recurrences originated in an area that would be covered by a 10-mm margin on the volume of 50% of the maximum FDG uptake. In the translational component of this work, we integrated radiomic features derived from pre-RT CT images with whole-genome measurements using TCGA and TCIA data. Our results demonstrated a statistically significant associations between radiomic features characterizing different tumor phenotypes and different genomic features. These findings represent a promising potential towards non-invasively tract genomic changes in the tumor during treatment and use this information to adapt treatment accordingly. In the final project of this dissertation, we developed a high-throughput approach to identify effective systemic agents against aggressive head and neck tumors with poor prognosis like anaplastic thyroid cancer. We successfully identified three candidate drugs and performed extensive in vitro and in vivo validation using orthotopic and PDX models. Among these drugs, HDAC inhibitor and LBH-589 showed the most effective tumor growth inhibition that can be used in future clinical trials

Dynamic Contrast-Enhanced MR Microscopy: Functional Imaging in Preclinical Models of Cancer

<p>Dynamic contrast-enhanced (DCE) MRI has been widely used as a quantitative imaging method for monitoring tumor response to therapy. The pharmacokinetic parameters derived from this technique have been used in more than 100 phase I trials and investigator led studies. The simultaneous challenges of increasing the temporal and spatial resolution, in a setting where the signal from the much smaller voxel is weaker, have made this MR technique difficult to implement in small-animal imaging. Existing preclinical DCE-MRI protocols acquire a limited number of slices resulting in potentially lost information in the third dimension. Furthermore, drug efficacy studies measuring the effect of an anti-angiogenic treatment, often compare the derived biomarkers on manually selected tumor regions or over the entire volume. These measurements include domains where the interpretation of the biomarkers may be unclear (such as in necrotic areas).</p><p>This dissertation describes and compares a family of four-dimensional (3D spatial + time), projection acquisition, keyhole-sampling strategies that support high spatial and temporal resolution. An interleaved 3D radial trajectory with a quasi-uniform distribution of points in k-space was used for sampling temporally resolved datasets. These volumes were reconstructed with three different k-space filters encompassing a range of possible keyhole strategies. The effect of k-space filtering on spatial and temporal resolution was studied in phantoms and in vivo. The statistical variation of the DCE-MRI measurement is analyzed by considering the fundamental sources of error in the MR signal intensity acquired with the spoiled gradient-echo (SPGR) pulse sequence. Finally, the technique was applied for measuring the extent of the opening of the blood-brain barrier in a mouse model of pediatric glioma and for identifying regions of therapeutic effect in a model of colorectal adenocarcinoma. </p><p>It is shown that 4D radial keyhole imaging does not degrade the system spatial and temporal resolution at a cost of 20-40% decrease in SNR. The time-dependent concentration of the contrast agent measured in vivo is within the theoretically predicted limits. The uncertainty in measuring the pharmacokinetic parameters with the sequences is of the same order, but always higher than, the uncertainty in measuring the pre-injection longitudinal relaxation time. The histogram of the time-to-peak provides useful knowledge about the spatial distribution of K^trans and microvascular density. Two regions with distinct kinetic parameters were identified when the TTP map from DCE-MRM was thresholded at 1000 sec. The effect of bevacizumab, as measured by a decrease in K^trans, was confined to one of these regions. DCE-MRI studies may contribute unique insights into the response of the tumor microenvironment to therapy.</p>Dissertatio