Alignment of contrast enhanced medical images

The re-alignment of series of medical images in which there are multiple contrast variations is difficult. The reason for this is that the popularmeasures of image similarity used to drive the alignment procedure do not separate the influence of intensity variation due to image feature motion and intensity variation due to feature enhancement. In particular, the appearance of new structure poses problems when it has no representation in the original image. The acquisition of many images over time, such as in dynamic contrast enhanced MRI, requires that many images with different contrast be registered to the same coordinate system, compounding the problem. This thesis addresses these issues, beginning by presenting conditions under which conventional registration fails and proposing a solution in the form of a ’progressive principal component registration’. The algorithm uses a statistical analysis of a series of contrast varying images in order to reduce the influence of contrast-enhancement that would otherwise distort the calculation of the image similarity measures used in image registration. The algorithm is shown to be versatile in that it may be applied to series of images in which contrast variation is due to either temporal contrast enhancement changes, as in dynamic contrast-enhanced MRI or intrinsically in the image selection procedure as in diffusion weighted MRI

Breast Cancer MRI Classification Based on Fractional Entropy Image Enhancement and Deep Feature Extraction

سرطان الثدي يعتبر واحد من الامراض القاتلة الشائعة بين النساء في جميع أنحاء العالم. والتشخيص المبكر لسرطان الثدي الكشف المبكر من أهم استراتيجيات الوقاية الثانوية. نظرًا لاستخدام التصوير الطبي على نطاق واسع في تشخيص العديد من الأمراض المزمنة ومراقبتها، فقد تم اقتراح العديد من خوارزميات معالجة الصور على مر السنين لزيادة مجال التصوير الطبي بحيث تصبح عملية التشخيص أكثر دقة وكفاءة. تقدم هذه الدراسة خوارزمية جديدة لاستخراج الخواص العميقة من نوعين من صور الرنين المغناطيسي T2W-TSE و STIR MRI كمدخلات للشبكات العصبية العميقة المقترحة والتي تُستخدم لاستخراج الخواص للتمييز بين فحوصات التصوير بالرنين المغناطيسي للثدي المرضية والصحية. في هذه الخوارزمية، تتم معالجة فحوصات التصوير بالرنين المغناطيسي للثدي مسبقًا قبل خطوة استخراج الخواص لتقليل تأثيرات الاختلافات بين شرائح التصوير بالرنين المغناطيسي، وفصل الثدي الايمن عن الايسر، بالإضافة الى عزل خلفية الصور. وقد كانت أقصى دقة تم تحقيقها لتصنيف مجموعة بيانات تضم 326 شريحة تصوير بالرنين المغناطيسي للثدي 98.77٪. يبدو أن النموذج يتسم بالكفاءة والأداء ويمكن بالتالي اعتباره مرشحًا للتطبيق في بيئة سريرية.Disease diagnosis with computer-aided methods has been extensively studied and applied in diagnosing and monitoring of several chronic diseases. Early detection and risk assessment of breast diseases based on clinical data is helpful for doctors to make early diagnosis and monitor the disease progression. The purpose of this study is to exploit the Convolutional Neural Network (CNN) in discriminating breast MRI scans into pathological and healthy. In this study, a fully automated and efficient deep features extraction algorithm that exploits the spatial information obtained from both T2W-TSE and STIR MRI sequences to discriminate between pathological and healthy breast MRI scans. The breast MRI scans are preprocessed prior to the feature extraction step to enhance and preserve the fine details of the breast MRI scans boundaries by using fractional integral entropy FIE algorithm, to reduce the effects of the intensity variations between MRI slices, and finally to separate the right and left breast regions by exploiting the symmetry information. The obtained features are classified using a long short-term memory (LSTM) neural network classifier. Subsequently, all extracted features significantly improves the performance of the LSTM network to precisely discriminate between pathological and healthy cases. The maximum achieved accuracy for classifying the collected dataset comprising 326 T2W-TSE images and 326 STIR images is 98.77%. The experimental results demonstrate that FIE enhancement method improve the performance of CNN in classifying breast MRI scans. The proposed model appears to be efficient and might represent a useful diagnostic tool in the evaluation of MRI breast scans

A Hybrid Approach of Using Particle Swarm Optimization and Volumetric Active Contour without Edge for Segmenting Brain Tumors in MRI Scan

Segmentation of brain tumors in magnetic resonance imaging is a one of the most complex processes in medical image analysis because it requires a combination of data knowledge with domain knowledge to achieve highly results. Such that, the data knowledge refers to homogeneity, continuity, and anatomical texture. While the domain knowledge refers to shapes, location, and size of the tumor to be delineated. Due to recent advances in medical imaging technologies which produce a massive number of cross-sectional slices, this makes a manual segmentation process is a very intensive, time-consuming and prone to inconsistences. In this study, an automated method for recognizing and segmenting the pathological area in MRI scans has been developed. First the dataset has been pre-processed and prepared by implementing a set of algorithms to standardize all collected samples. A particle swarm optimization is utilized to find the core of pathological area within each MRI slice. Finally, an active contour without edge method is utilized to extract the pathological area in MRI scan. Results reported on the collected dataset includes 50 MRI scans of pathological patients that was provided by Iraqi Center for Research and Magnetic Resonance of Al Imamain Al-Kadhimain Medical City in Iraq. The achieved accuracy of the proposed method was 92% compared with manual delineation

Targeted Anti-Angiogenic Therapy in Metastatic Renal Cell Carcinoma and Methodological Improvements in Assessment of Therapeutic Response with Imaging Biomarkers

Background: Drugs targeting angiogenic pathway remain the mainstay of treatment for metastatic renal cell carcinoma (mRCC). Tyrosine Kinase Inhibitors (TKI) as Sunitinib, Pazopanib as single agents and humanised monoclonal antibody bevacizumab (Bev) in combination with Interferon- α2a (IFN) have established as the first-line therapy for mRCC. Despite improvements in treatment, there are multiple questions which remain unanswered. In the combination of Bev and IFN, the respective role of each drug and whether any additional anti-angiogenic activity is gained by adding IFN to Bev remains unknown. As the clinical benefit obtained with these cytostatic agents does not always correlate with the conventional response assessment techniques as RECIST, it is necessary to reconsider the methods by which we assess benefit from these therapies. In this thesis, I report three studies aiming to answer these questions. Methods: With the clinical trial reported here, I explore whether Bev induced changes in vascular parameters measured by Dynamic Contrast Enhanced MRI (DCE-MRI) is significantly enhanced by the addition of IFN. In a phase II, randomised, open labelled, multicentre trial, treatment naïve mRCC patients were randomised to receive Bev on its own or in combination with a low dose (3MU) or standard dose (9MU) IFN. DCE-MRI was used to assess the changes in vascularity with the primary endpoint being, changes in transfer coefficient (Ktrans) after six weeks of treatment. I also report two retrospective imaging-based studies, using contrast-enhanced CT scans, performed to improve the methodology of response assessment for these antiangiogenic therapeutics. Here I explore the use of a) combining changes in size and arterial phase contrast enhancement measured using CT scan and b) changes in CT texture as methods of therapeutic response assessment in mRCC patients treated with TKI. Results: With the phase 2 clinical trial, we faced significant difficulty in recruitment as a result of restrictions in access to treatment in NHS, other competing studies and restrictions proposed by the DCE-MRI inclusion criteria. With slow recruitment, an unplanned analysis was performed after 21 patients were recruited. Analysis of primary endpoint showed no trend in the difference between arms with no correlation found between change in Ktrans and addition of IFN to bevacizumab. Effect size analysis performed due to the small numbers recruited failed to show any significance in the observed difference in Ktrans. Change in Ktrans and Kep may identify a group of patients likely to have PFS > 6 months, but this observation needs to evaluation in a larger sample size. Measuring size and change in arterial phase enhancement retrospectively using CT, a new criterion "modified" Choi, which prerequisite a combination of a decrease in arterial phase density by 15% and a decrease in size by 10% for response was proposed. Response assessment was measured with RECIST, Choi and modified Choi individually in 20 evaluable patients retrospectively and clinical benefit compared with Kaplan-Meier statistics and Log-Rank test. Response assessment as defined by the modified Choi criteria successfully identified patients who received clinical benefit from the treatment. Time to progression (TTP) was 448 days for the partial response and 89 days for stable disease as per the new criteria which were statistically significant with a p-value of 0.002. The second retrospective analysis explored the textural changes in enhanced CT scan. Performed in collaboration with researchers from Brighton University who developed the software algorithm used to assess changes in entropy and uniformity, 87 metastases from 39 patients with mRCC were analysed at baseline and after two cycles of TKI treatment. Textural parameters and response assessment criteria were correlated with TTP. After two cycles of TKI, the decrease in tumour entropy was 3%-45%, and increase in uniformity was 5%-21%. At a threshold change of -2% with uniformity, on a coarse scale of 2.5, the textural change was able to separate responders from non-responders. With Kaplan-Meier analysis comparing all four criteria, the percentage change in uniformity was statistically more significant than for RECIST, Choi, and Modified Choi criteria. Cox regression analysis showed that texture uniformity was an independent predictor of time to progression. Discussion: With the studies reported here, I was able to demonstrate the importance of improving the methodology in assessment of therapeutic response to targeted anti-angiogenic therapy in metastatic renal cell carcinoma. Even though the clinical trial, terminated early due to slow recruitment, did not reach its primary endpoint, changes in other vascular parameters as Kep combined with changes Ktrans showed tendency towards identifying a group of patients who derived clinical benefit of >6months with these therapies. This is particularly exciting as given the vascular stabilisation effect proposed for bevacizumab, the effusion parameter Kep may be a better tool in assessing response rather than Ktrans and warrants further assessment in a larger cohort. Modified choi criterion and textural analysis are two important methodological improvements in response assessment of cytostatic anti-angiogenic therapy. In the analyses reported here, both techniques have shown superiority over RECIST in response assessment and differentiating mRCC patients who is likely to gain clinical benefit by TKI therapy. Validation of these criteria on a larger patient cohort is important. As these criterions are assessed on standard enhanced CT scans, incorporating these criteria, especially modified choi criterion, as part of standard CT assessment could be performed and will provide a real world validation. Retrospective assessment using larger cohort of patients from previous phase 3 trials or inclusion of these parameters prospectively in phase 3 trials would also help us in evaluating these modalities further

Quantitative Magnetic Resonance Imaging of Tissue Microvasculature and Microstructure in Selected Clinical Applications

This thesis is based on four papers and aims to establish perfusion and diffusion measurements with magnetic resonance imaging (MRI) in selected clinical applications. While structural imaging provides invaluable geometric and anatomical information, new disease relevant information can be obtained from measures of physiological processes inferred from advanced modelling. This study is motivated by clinical questions pertaining to diagnosis and treatment effects in particular patient groups where inflammatory processes are involved in the disease. Paper 1 investigates acquisition parameters in dynamic contrast enhanced (DCE)-MRI of the temporomandibular joint (TMJ) with possible involvement of juvenile idiopathic arthritis. High level elastic motion correction should be applied to DCE data from the TMJ, and the DCE data should be acquired with a sample rate of at least 4 s. Paper 2 investigates choices of arterial input functions (AIFs) in dynamic susceptibility contrast (DSC)-MRI in brain metastases. AIF shapes differed across patients. Relative cerebral blood volume estimates differentiated better between perfusion in white matter and grey matter when scan-specific AIFs were used than when patient-specific AIFs and population-based AIFs were used. Paper 3 investigates DSC-MRI perfusion parameters in relation to outcome after stereotactic radiosurgery (SRS) in brain metastases. Low perfusion prior to SRS may be related to unfavourable outcome. Paper 4 applies free water (FW) corrected diffusion MRI to characterise glioma. Fractional anisotropy maps of the tumour region were significantly impacted by FW correction. The estimated FW maps may also contribute to a better description of the tumour. Although there are challenges related to post-processing of MRI data, it was shown that the advanced MRI methods applied can add to a more accurate description of the TMJ and of brain lesions.Doktorgradsavhandlin

Multiparametric Imaging and MR Image Texture Analysis in Brain Tumors

Discrimination of tumor from radiation injured (RI) tissues and differentiation of tumor types using noninvasive imaging is essential for guiding surgical and radiotherapy treatments are some of the challenges that clinicians face in the course of treatment of brain tumors. The first objective in this thesis was to develop a method to discriminate between glioblastoma tumor recurrences and radiation injury using multiparametric characterization of the tissue incorporating conventional magnetic resonance imaging signal intensities and diffusion tensor imaging parameters. Our results show significant correlations in the RI that was missing in the tumor regions. These correlations may aid in differentiating between tumor recurrence and RI. The second objective of was to investigate whether texture based image analysis of routine MR images would provide quantitative information that could be used to differentiate between glioblastoma and metastasis. Our results demonstrate that first-order texture feature of standard deviation and second-order texture features of entropy, inertia, homogeneity, and energy show significant differences between the two groups. The third objective was to investigate whether quantitative measurements of tumor size and appearance on MRI scans acquired prior to helical tomotherapy (HT) type whole brain radiotherapy with simultaneous infield boost treatment could be used to differentiate responder and non-responder patient groups. Our results demonstrated that smaller size lesions may respond better to this type of radiation therapy. Measures of appearance provided limited added value over measures of size for response prediction. Quantitative measurements of rim enhancement and core necrosis performed separately did not provide additional predictive value

Analysis of contrast-enhanced medical images.

Early detection of human organ diseases is of great importance for the accurate diagnosis and institution of appropriate therapies. This can potentially prevent progression to end-stage disease by detecting precursors that evaluate organ functionality. In addition, it also assists the clinicians for therapy evaluation, tracking diseases progression, and surgery operations. Advances in functional and contrast-enhanced (CE) medical images enabled accurate noninvasive evaluation of organ functionality due to their ability to provide superior anatomical and functional information about the tissue-of-interest. The main objective of this dissertation is to develop a computer-aided diagnostic (CAD) system for analyzing complex data from CE magnetic resonance imaging (MRI). The developed CAD system has been tested in three case studies: (i) early detection of acute renal transplant rejection, (ii) evaluation of myocardial perfusion in patients with ischemic heart disease after heart attack; and (iii), early detection of prostate cancer. However, developing a noninvasive CAD system for the analysis of CE medical images is subject to multiple challenges, including, but are not limited to, image noise and inhomogeneity, nonlinear signal intensity changes of the images over the time course of data acquisition, appearances and shape changes (deformations) of the organ-of-interest during data acquisition, determination of the best features (indexes) that describe the perfusion of a contrast agent (CA) into the tissue. To address these challenges, this dissertation focuses on building new mathematical models and learning techniques that facilitate accurate analysis of CAs perfusion in living organs and include: (i) accurate mathematical models for the segmentation of the object-of-interest, which integrate object shape and appearance features in terms of pixel/voxel-wise image intensities and their spatial interactions; (ii) motion correction techniques that combine both global and local models, which exploit geometric features, rather than image intensities to avoid problems associated with nonlinear intensity variations of the CE images; (iii) fusion of multiple features using the genetic algorithm. The proposed techniques have been integrated into CAD systems that have been tested in, but not limited to, three clinical studies. First, a noninvasive CAD system is proposed for the early and accurate diagnosis of acute renal transplant rejection using dynamic contrast-enhanced MRI (DCE-MRI). Acute rejection–the immunological response of the human immune system to a foreign kidney–is the most sever cause of renal dysfunction among other diagnostic possibilities, including acute tubular necrosis and immune drug toxicity. In the U.S., approximately 17,736 renal transplants are performed annually, and given the limited number of donors, transplanted kidney salvage is an important medical concern. Thus far, biopsy remains the gold standard for the assessment of renal transplant dysfunction, but only as the last resort because of its invasive nature, high cost, and potential morbidity rates. The diagnostic results of the proposed CAD system, based on the analysis of 50 independent in-vivo cases were 96% with a 95% confidence interval. These results clearly demonstrate the promise of the proposed image-based diagnostic CAD system as a supplement to the current technologies, such as nuclear imaging and ultrasonography, to determine the type of kidney dysfunction. Second, a comprehensive CAD system is developed for the characterization of myocardial perfusion and clinical status in heart failure and novel myoregeneration therapy using cardiac first-pass MRI (FP-MRI). Heart failure is considered the most important cause of morbidity and mortality in cardiovascular disease, which affects approximately 6 million U.S. patients annually. Ischemic heart disease is considered the most common underlying cause of heart failure. Therefore, the detection of the heart failure in its earliest forms is essential to prevent its relentless progression to premature death. While current medical studies focus on detecting pathological tissue and assessing contractile function of the diseased heart, this dissertation address the key issue of the effects of the myoregeneration therapy on the associated blood nutrient supply. Quantitative and qualitative assessment in a cohort of 24 perfusion data sets demonstrated the ability of the proposed framework to reveal regional perfusion improvements with therapy, and transmural perfusion differences across the myocardial wall; thus, it can aid in follow-up on treatment for patients undergoing the myoregeneration therapy. Finally, an image-based CAD system for early detection of prostate cancer using DCE-MRI is introduced. Prostate cancer is the most frequently diagnosed malignancy among men and remains the second leading cause of cancer-related death in the USA with more than 238,000 new cases and a mortality rate of about 30,000 in 2013. Therefore, early diagnosis of prostate cancer can improve the effectiveness of treatment and increase the patient’s chance of survival. Currently, needle biopsy is the gold standard for the diagnosis of prostate cancer. However, it is an invasive procedure with high costs and potential morbidity rates. Additionally, it has a higher possibility of producing false positive diagnosis due to relatively small needle biopsy samples. Application of the proposed CAD yield promising results in a cohort of 30 patients that would, in the near future, represent a supplement of the current technologies to determine prostate cancer type. The developed techniques have been compared to the state-of-the-art methods and demonstrated higher accuracy as shown in this dissertation. The proposed models (higher-order spatial interaction models, shape models, motion correction models, and perfusion analysis models) can be used in many of today’s CAD applications for early detection of a variety of diseases and medical conditions, and are expected to notably amplify the accuracy of CAD decisions based on the automated analysis of CE images

Image processing and machine learning techniques used in computer-aided detection system for mammogram screening - a review

This paper aims to review the previously developed Computer-aided detection (CAD) systems for mammogram screening because increasing death rate in women due to breast cancer is a global medical issue and it can be controlled only by early detection with regular screening. Till now mammography is the widely used breast imaging modality. CAD systems have been adopted by the radiologists to increase the accuracy of the breast cancer diagnosis by avoiding human errors and experience related issues. This study reveals that in spite of the higher accuracy obtained by the earlier proposed CAD systems for breast cancer diagnosis, they are not fully automated. Moreover, the false-positive mammogram screening cases are high in number and over-diagnosis of breast cancer exposes a patient towards harmful overtreatment for which a huge amount of money is being wasted. In addition, it is also reported that the mammogram screening result with and without CAD systems does not have noticeable difference, whereas the undetected cancer cases by CAD system are increasing. Thus, future research is required to improve the performance of CAD system for mammogram screening and make it completely automated

Role of deep learning techniques in non-invasive diagnosis of human diseases.

Machine learning, a sub-discipline in the domain of artificial intelligence, concentrates on algorithms able to learn and/or adapt their structure (e.g., parameters) based on a set of observed data. The adaptation is performed by optimizing over a cost function. Machine learning obtained a great attention in the biomedical community because it offers a promise for improving sensitivity and/or specificity of detection and diagnosis of diseases. It also can increase objectivity of the decision making, decrease the time and effort on health care professionals during the process of disease detection and diagnosis. The potential impact of machine learning is greater than ever due to the increase in medical data being acquired, the presence of novel modalities being developed and the complexity of medical data. In all of these scenarios, machine learning can come up with new tools for interpreting the complex datasets that confront clinicians. Much of the excitement for the application of machine learning to biomedical research comes from the development of deep learning which is modeled after computation in the brain. Deep learning can help in attaining insights that would be impossible to obtain through manual analysis. Deep learning algorithms and in particular convolutional neural networks are different from traditional machine learning approaches. Deep learning algorithms are known by their ability to learn complex representations to enhance pattern recognition from raw data. On the other hand, traditional machine learning requires human engineering and domain expertise to design feature extractors and structure data. With increasing demands upon current radiologists, there are growing needs for automating the diagnosis. This is a concern that deep learning is able to address. In this dissertation, we present four different successful applications of deep learning for diseases diagnosis. All the work presented in the dissertation utilizes medical images. In the first application, we introduce a deep-learning based computer-aided diagnostic system for the early detection of acute renal transplant rejection. The system is based on the fusion of both imaging markers (apparent diffusion coefficients derived from diffusion-weighted magnetic resonance imaging) and clinical biomarkers (creatinine clearance and serum plasma creatinine). The fused data is then used as an input to train and test a convolutional neural network based classifier. The proposed system is tested on scans collected from 56 subjects from geographically diverse populations and different scanner types/image collection protocols. The overall accuracy of the proposed system is 92.9% with 93.3% sensitivity and 92.3% specificity in distinguishing non-rejected kidney transplants from rejected ones. In the second application, we propose a novel deep learning approach for the automated segmentation and quantification of the LV from cardiac cine MR images. We aimed at achieving lower errors for the estimated heart parameters compared to the previous studies by proposing a novel deep learning segmentation method. Using fully convolutional neural networks, we proposed novel methods for the extraction of a region of interest that contains the left ventricle, and the segmentation of the left ventricle. Following myocardial segmentation, functional and mass parameters of the left ventricle are estimated. Automated Cardiac Diagnosis Challenge dataset was used to validate our framework, which gave better segmentation, accurate estimation of cardiac parameters, and produced less error compared to other methods applied on the same dataset. Furthermore, we showed that our segmentation approach generalizes well across different datasets by testing its performance on a locally acquired dataset. In the third application, we propose a novel deep learning approach for automated quantification of strain from cardiac cine MR images of mice. For strain analysis, we developed a Laplace-based approach to track the LV wall points by solving the Laplace equation between the LV contours of each two successive image frames over the cardiac cycle. Following tracking, the strain estimation is performed using the Lagrangian-based approach. This new automated system for strain analysis was validated by comparing the outcome of these analysis with the tagged MR images from the same mice. There were no significant differences between the strain data obtained from our algorithm using cine compared to tagged MR imaging. In the fourth application, we demonstrate how a deep learning approach can be utilized for the automated classification of kidney histopathological images. Our approach can classify four classes: the fat, the parenchyma, the clear cell renal cell carcinoma, and the unusual cancer which has been discovered recently, called clear cell papillary renal cell carcinoma. Our framework consists of three convolutional neural networks and the whole-slide kidney images were divided into patches with three different sizes to be inputted to the networks. Our approach can provide patch-wise and pixel-wise classification. Our approach classified the four classes accurately and surpassed other state-of-the-art methods such as ResNet (pixel accuracy: 0.89 Resnet18, 0.93 proposed). In conclusion, the results of our proposed systems demonstrate the potential of deep learning for the efficient, reproducible, fast, and affordable disease diagnosis