DEVELOPING NOVEL COMPUTER-AIDED DETECTION AND DIAGNOSIS SYSTEMS OF MEDICAL IMAGES

Reading medical images to detect and diagnose diseases is often difficult and has large inter-reader variability. To address this issue, developing computer-aided detection and diagnosis (CAD) schemes or systems of medical images has attracted broad research interest in the last several decades. Despite great effort and significant progress in previous studies, only limited CAD schemes have been used in clinical practice. Thus, developing new CAD schemes is still a hot research topic in medical imaging informatics field. In this dissertation, I investigate the feasibility of developing several new innovative CAD schemes for different application purposes. First, to predict breast tumor response to neoadjuvant chemotherapy and reduce unnecessary aggressive surgery, I developed two CAD schemes of breast magnetic resonance imaging (MRI) to generate quantitative image markers based on quantitative analysis of global kinetic features. Using the image marker computed from breast MRI acquired pre-chemotherapy, CAD scheme enables to predict radiographic complete response (CR) of breast tumors to neoadjuvant chemotherapy, while using the imaging marker based on the fusion of kinetic and texture features extracted from breast MRI performed after neoadjuvant chemotherapy, CAD scheme can better predict the pathologic complete response (pCR) of the patients. Second, to more accurately predict prognosis of stroke patients, quantifying brain hemorrhage and ventricular cerebrospinal fluid depicting on brain CT images can play an important role. For this purpose, I developed a new interactive CAD tool to segment hemorrhage regions and extract radiological imaging marker to quantitatively determine the severity of aneurysmal subarachnoid hemorrhage at presentation and correlate the estimation with various homeostatic/metabolic derangements and predict clinical outcome. Third, to improve the efficiency of primary antibody screening processes in new cancer drug development, I developed a CAD scheme to automatically identify the non-negative tissue slides, which indicate reactive antibodies in digital pathology images. Last, to improve operation efficiency and reliability of storing digital pathology image data, I developed a CAD scheme using optical character recognition algorithm to automatically extract metadata from tissue slide label images and reduce manual entry for slide tracking and archiving in the tissue pathology laboratories. In summary, in these studies, we developed and tested several innovative approaches to identify quantitative imaging markers with high discriminatory power. In all CAD schemes, the graphic user interface-based visual aid tools were also developed and implemented. Study results demonstrated feasibility of applying CAD technology to several new application fields, which has potential to assist radiologists, oncologists and pathologists improving accuracy and consistency in disease diagnosis and prognosis assessment of using medical image

AI-enhanced diagnosis of challenging lesions in breast MRI: a methodology and application primer

Computer-aided diagnosis (CAD) systems have become an important tool in the assessment of breast tumors with magnetic resonance imaging (MRI). CAD systems can be used for the detection and diagnosis of breast tumors as a “second opinion” review complementing the radiologist’s review. CAD systems have many common parts such as image pre-processing, tumor feature extraction and data classification that are mostly based on machine learning (ML) techniques. In this review paper, we describe the application of ML-based CAD systems in MRI of the breast covering the detection of diagnostically challenging lesions such as non-mass enhancing (NME) lesions, multiparametric MRI, neo-adjuvant chemotherapy (NAC) and radiomics all applied to NME. Since ML has been widely used in the medical imaging community, we provide an overview about the state-ofthe-art and novel techniques applied as classifiers to CAD systems. The differences in the CAD systems in MRI of the breast for several standard and novel applications for NME are explained in detail to provide important examples illustrating: (i) CAD for the detection and diagnosis, (ii) CAD in multi-parametric imaging (iii) CAD in NAC and (iv) breast cancer radiomics. We aim to provide a comparison between these CAD applications and to illustrate a global view on intelligent CAD systems based on ANN in MRI of the breast

Emerging Techniques in Breast MRI

As indicated throughout this chapter, there is a constant effort to move to more sensitive, specific, and quantitative methods for characterizing breast tissue via magnetic resonance imaging (MRI). In the present chapter, we focus on six emerging techniques that seek to quantitatively interrogate the physiological and biochemical properties of the breast. At the physiological scale, we present an overview of ultrafast dynamic contrast-enhanced MRI and magnetic resonance elastography which provide remarkable insights into the vascular and mechanical properties of tissue, respectively. Moving to the biochemical scale, magnetization transfer, chemical exchange saturation transfer, and spectroscopy (both “conventional” and hyperpolarized) methods all provide unique, noninvasive, insights into tumor metabolism. Given the breadth and depth of information that can be obtained in a single MRI session, methods of data synthesis and interpretation must also be developed. Thus, we conclude the chapter with an introduction to two very different, though complementary, methods of data analysis: (1) radiomics and habitat imaging, and (2) mechanism-based mathematical modeling

Analysis of contrast-enhanced medical images.

Early detection of human organ diseases is of great importance for the accurate diagnosis and institution of appropriate therapies. This can potentially prevent progression to end-stage disease by detecting precursors that evaluate organ functionality. In addition, it also assists the clinicians for therapy evaluation, tracking diseases progression, and surgery operations. Advances in functional and contrast-enhanced (CE) medical images enabled accurate noninvasive evaluation of organ functionality due to their ability to provide superior anatomical and functional information about the tissue-of-interest. The main objective of this dissertation is to develop a computer-aided diagnostic (CAD) system for analyzing complex data from CE magnetic resonance imaging (MRI). The developed CAD system has been tested in three case studies: (i) early detection of acute renal transplant rejection, (ii) evaluation of myocardial perfusion in patients with ischemic heart disease after heart attack; and (iii), early detection of prostate cancer. However, developing a noninvasive CAD system for the analysis of CE medical images is subject to multiple challenges, including, but are not limited to, image noise and inhomogeneity, nonlinear signal intensity changes of the images over the time course of data acquisition, appearances and shape changes (deformations) of the organ-of-interest during data acquisition, determination of the best features (indexes) that describe the perfusion of a contrast agent (CA) into the tissue. To address these challenges, this dissertation focuses on building new mathematical models and learning techniques that facilitate accurate analysis of CAs perfusion in living organs and include: (i) accurate mathematical models for the segmentation of the object-of-interest, which integrate object shape and appearance features in terms of pixel/voxel-wise image intensities and their spatial interactions; (ii) motion correction techniques that combine both global and local models, which exploit geometric features, rather than image intensities to avoid problems associated with nonlinear intensity variations of the CE images; (iii) fusion of multiple features using the genetic algorithm. The proposed techniques have been integrated into CAD systems that have been tested in, but not limited to, three clinical studies. First, a noninvasive CAD system is proposed for the early and accurate diagnosis of acute renal transplant rejection using dynamic contrast-enhanced MRI (DCE-MRI). Acute rejection–the immunological response of the human immune system to a foreign kidney–is the most sever cause of renal dysfunction among other diagnostic possibilities, including acute tubular necrosis and immune drug toxicity. In the U.S., approximately 17,736 renal transplants are performed annually, and given the limited number of donors, transplanted kidney salvage is an important medical concern. Thus far, biopsy remains the gold standard for the assessment of renal transplant dysfunction, but only as the last resort because of its invasive nature, high cost, and potential morbidity rates. The diagnostic results of the proposed CAD system, based on the analysis of 50 independent in-vivo cases were 96% with a 95% confidence interval. These results clearly demonstrate the promise of the proposed image-based diagnostic CAD system as a supplement to the current technologies, such as nuclear imaging and ultrasonography, to determine the type of kidney dysfunction. Second, a comprehensive CAD system is developed for the characterization of myocardial perfusion and clinical status in heart failure and novel myoregeneration therapy using cardiac first-pass MRI (FP-MRI). Heart failure is considered the most important cause of morbidity and mortality in cardiovascular disease, which affects approximately 6 million U.S. patients annually. Ischemic heart disease is considered the most common underlying cause of heart failure. Therefore, the detection of the heart failure in its earliest forms is essential to prevent its relentless progression to premature death. While current medical studies focus on detecting pathological tissue and assessing contractile function of the diseased heart, this dissertation address the key issue of the effects of the myoregeneration therapy on the associated blood nutrient supply. Quantitative and qualitative assessment in a cohort of 24 perfusion data sets demonstrated the ability of the proposed framework to reveal regional perfusion improvements with therapy, and transmural perfusion differences across the myocardial wall; thus, it can aid in follow-up on treatment for patients undergoing the myoregeneration therapy. Finally, an image-based CAD system for early detection of prostate cancer using DCE-MRI is introduced. Prostate cancer is the most frequently diagnosed malignancy among men and remains the second leading cause of cancer-related death in the USA with more than 238,000 new cases and a mortality rate of about 30,000 in 2013. Therefore, early diagnosis of prostate cancer can improve the effectiveness of treatment and increase the patient’s chance of survival. Currently, needle biopsy is the gold standard for the diagnosis of prostate cancer. However, it is an invasive procedure with high costs and potential morbidity rates. Additionally, it has a higher possibility of producing false positive diagnosis due to relatively small needle biopsy samples. Application of the proposed CAD yield promising results in a cohort of 30 patients that would, in the near future, represent a supplement of the current technologies to determine prostate cancer type. The developed techniques have been compared to the state-of-the-art methods and demonstrated higher accuracy as shown in this dissertation. The proposed models (higher-order spatial interaction models, shape models, motion correction models, and perfusion analysis models) can be used in many of today’s CAD applications for early detection of a variety of diseases and medical conditions, and are expected to notably amplify the accuracy of CAD decisions based on the automated analysis of CE images

Clinical translation of [18F]ICMT-11 for measuring chemotherapy-induced caspase 3/7 activation in breast and lung cancer

Background: Effective anticancer therapy is thought to involve induction of tumour cell death through apoptosis and/or necrosis. [18F]ICMT-11, an isatin sulfonamide caspase-3/7-specific radiotracer, has been developed for PET imaging and shown to have favourable dosimetry, safety, and biodistribution. We report the translation of [18F]ICMT-11 PET to measure chemotherapy-induced caspase-3/7 activation in breast and lung cancer patients receiving first-line therapy. Results: Breast tumour SUVmax of [18F]ICMT-11 was low at baseline and unchanged following therapy. Measurement of M30/M60 cytokeratin-18 cleavage products showed that therapy was predominantly not apoptosis in nature. While increases in caspase-3 staining on breast histology were seen, post-treatment caspase-3 positivity values were only approximately 1%; this low level of caspase-3 could have limited sensitive detection by [18F]ICMT-11-PET. Fourteen out of 15 breast cancer patients responded to first–line chemotherapy (complete or partial response); one patient had stable disease. Four patients showed increases in regions of high tumour [18F]ICMT-11 intensity on voxel-wise analysis of tumour data (classed as PADS); response was not exclusive to patients with this phenotype. In patients with lung cancer, multi-parametric [18F]ICMT-11 PET and MRI (diffusion-weighted- and dynamic contrast enhanced-MRI) showed that PET changes were concordant with cell death in the absence of significant perfusion changes. Conclusion: This study highlights the potential use of [18F]ICMT-11 PET as a promising candidate for non-invasive imaging of caspase3/7 activation, and the difficulties encountered in assessing early-treatment responses. We summarize that tumour response could occur in the absence of predominant chemotherapy-induced caspase-3/7 activation measured non-invasively across entire tumour lesions in patients with breast and lung cancer

Breast MRI: State of the Art

Contains fulltext : 208973.pdf (publisher's version ) (Open Access)MRI of the breast has the highest sensitivity for breast cancer detection among current clinical imaging modalities and is indispensable for breast imaging practice. While the basis of breast MRI consists of T1-weighted contrast-enhanced imaging, T2-weighted, ultrafast, and diffusion-weighted imaging may be used to improve lesion characterization. Such multiparametric assessment of breast lesions allows for excellent discrimination between benign and malignant breast lesions. Indications for breast MRI are expanding. In preoperative staging, multiple studies confirm the superiority of MRI to other imaging modalities for tumor size estimation and detection of additional tumor foci in the ipsilateral and contralateral breast. Ongoing studies show that in experienced hands this can be used to improve breast cancer surgery, although there is no evidence of improved long-term outcomes. Screening indications are likewise growing as evidence is accumulating that OncologicRI depicts cancers at an earlier stage than mammography in all women. To manage the associated costs for screening, the use of abbreviated protocols may be beneficial. In patients treated with neoadjuvant chemotherapy, MRI is used to document response. It is essential to realize that oncologic and surgical response are different, and evaluation should be adapted to the underlying question

Computer-Aided Evaluation of Breast MRI for the Residual Tumor Extent and Response Monitoring in Breast Cancer Patients Receiving Neoadjuvant Chemotherapy

Objective: To evaluate the accuracy of a computer-aided evaluation program (CAE) of breast MRI for the assessment of residual tumor extent and response monitoring in breast cancer patients receiving neoadjuvant chemotherapy. Materials and Methods: Fifty-seven patients with breast cancers who underwent neoadjuvant chemotherapy before surgery and dynamic contrast enhanced MRI before and after chemotherapy were included as part of this study. For the assessment of residual tumor extent after completion of chemotherapy, the mean tumor diameters measured by radiologists and CAE were compared to those on histopathology using a paired student t-test. Moreover, the agreement between unidimensional (1D) measurement by radiologist and histopathological size or 1D measurement by CAE and histopathological size was assessed using the Bland-Altman method. For chemotherapy monitoring, we evaluated tumor response through the change in the 1D diameter by a radiologist and CAE and three-dimensional (3D) volumetric change by CAE based on Response Evaluation Criteria in Solid Tumors (RECIST). Agreement between the 1D response by the radiologist versus the 1D response by CAE as well as by the 3D response by CAE were evaluated using weighted kappa (k) statistics. Results: For the assessment of residual tumor extent after chemotherapy, the mean tumor diameter measured by radiologists (2.0 ± 1.7 cm) was significantly smaller than the mean histological diameter (2.6 ± 2.3 cm) (p = 0.01), whereas, no significant difference was found between the CAE measurements (mean = 2.2 ± 2.0 cm) and histological diameter (p = 0.19). The mean difference between the 1D measurement by the radiologist and histopathology was 0.6 cm (95% confidence interval: -3.0, 4.3), whereas the difference between CAE and histopathology was 0.4 cm (95% confidence interval: -3.9, 4.7). For the monitoring of response to chemotherapy, the 1D measurement by the radiologist and CAE showed a fair agreement (k = 0.358), while the 1D measurement by the radiologist and 3D measurement by CAE showed poor agreement (k = 0.106). Conclusion: CAE for breast MRI is sufficiently accurate for the assessment of residual tumor extent in breast cancer patients receiving neoadjuvant chemotherapy. However, for the assessment of response to chemotherapy, the assessment by the radiologist and CAE showed a fair to poor agreement