A Survey on Deep Learning in Medical Image Analysis

Deep learning algorithms, in particular convolutional networks, have rapidly become a methodology of choice for analyzing medical images. This paper reviews the major deep learning concepts pertinent to medical image analysis and summarizes over 300 contributions to the field, most of which appeared in the last year. We survey the use of deep learning for image classification, object detection, segmentation, registration, and other tasks and provide concise overviews of studies per application area. Open challenges and directions for future research are discussed.Comment: Revised survey includes expanded discussion section and reworked introductory section on common deep architectures. Added missed papers from before Feb 1st 201

Landmark Localization, Feature Matching and Biomarker Discovery from Magnetic Resonance Images

The work presented in this thesis proposes several methods that can be roughly divided into three different categories: I) landmark localization in medical images, II) feature matching for image registration, and III) biomarker discovery in neuroimaging. The first part deals with the identification of anatomical landmarks. The motivation stems from the fact that the manual identification and labeling of these landmarks is very time consuming and prone to observer errors, especially when large datasets must be analyzed. In this thesis we present three methods to tackle this challenge: A landmark descriptor based on local self-similarities (SS), a subspace building framework based on manifold learning and a sparse coding landmark descriptor based on data-specific learned dictionary basis. The second part of this thesis deals with finding matching features between a pair of images. These matches can be used to perform a registration between them. Registration is a powerful tool that allows mapping images in a common space in order to aid in their analysis. Accurate registration can be challenging to achieve using intensity based registration algorithms. Here, a framework is proposed for learning correspondences in pairs of images by matching SS features and random sample and consensus (RANSAC) is employed as a robust model estimator to learn a deformation model based on feature matches. Finally, the third part of the thesis deals with biomarker discovery using machine learning. In this section a framework for feature extraction from learned low-dimensional subspaces that represent inter-subject variability is proposed. The manifold subspace is built using data-driven regions of interest (ROI). These regions are learned via sparse regression, with stability selection. Also, probabilistic distribution models for different stages in the disease trajectory are estimated for different class populations in the low-dimensional manifold and used to construct a probabilistic scoring function.Open Acces

Artificial intelligence and automation in valvular heart diseases

Artificial intelligence (AI) is gradually changing every aspect of social life, and healthcare is no exception. The clinical procedures that were supposed to, and could previously only be handled by human experts can now be carried out by machines in a more accurate and efficient way. The coming era of big data and the advent of supercomputers provides great opportunities to the development of AI technology for the enhancement of diagnosis and clinical decision-making. This review provides an introduction to AI and highlights its applications in the clinical flow of diagnosing and treating valvular heart diseases (VHDs). More specifically, this review first introduces some key concepts and subareas in AI. Secondly, it discusses the application of AI in heart sound auscultation and medical image analysis for assistance in diagnosing VHDs. Thirdly, it introduces using AI algorithms to identify risk factors and predict mortality of cardiac surgery. This review also describes the state-of-the-art autonomous surgical robots and their roles in cardiac surgery and intervention

Automatic Assessment of Cardiac Left Ventricular Function Via Magnetic Resonance Images

Automating global and segmental (regional) assessments of cardiac Left Ventricle (LV) function in Magnetic Resonance Images (MRI) has recently sparked an impressive research effort, which has resulted a number of techniques delivering promising performances. However, despite such an effort, the problem is still acknowledged to be challenging, with substantial room for improvements in regard to accuracy. Furthermore, most of the existing techniques are labour intensive, requiring delineations of the endo- and/or epi-cardial boundaries in all frames of a cardiac sequence. On the one hand, global assessments of LV function focus on estimation of the Ejection Fraction (EF), which quantifies how much blood the heart is pumping within each beat. On the other hand, regional assessments focus on comprehensive analysis of the wall motions within each of the standardized segments of the myocardium, the muscle which contracts and sends the blood out of the LV. In clinical practice, the EF is often estimated via manual segmentations of several images in a cardiac sequence. This is prohibitively time consuming, or via automatic segmentations, which is a challenging and computationally expensive task that may result in high estimation errors. Additionally, the diagnosis of the segmental dysfunction is based on visual LV assessments, which are subject to high inter-observer variability. In this thesis, we propose accurate methods to estimate both global and regional LV function with minimal user inputs in real-time from statistics estimated in MRI. From a simple user input, we build image statistics for all the images in a subject dataset. We demonstrate that these statistics are correlated with regional as well as global LV function. Different machine learning techniques have been employed to find these correlations. The regional dysfunction is investigated in terms of a binary/multi-classification problem. A comprehensive evaluation over 20 subjects demonstrated that the estimated EFs correlated very well with those obtained from independent manual segmentations. Furthermore, comparisons with estimating EF with recent segmentation algorithms show that the proposed method yielded a very competitive performance. For regional binary classification, we report a comprehensive experimental evaluation of the proposed algorithm over 928 cardiac segments obtained from 58 subjects. Compared against ground-truth evaluations by experienced radiologists, the proposed algorithm performed competitively, with an overall classification accuracy of 86.09% and a kappa measure of 0.73. We also report a comprehensive experimental evaluation of the proposed multi-classification algorithm over the same dataset. Compared against ground-truth labels assessed by experienced radiologists, the proposed algorithm yielded an overall 4-class accuracy of 74.14%

Computer aided assessment of CT scans of traumatic brain injury patients

A thesis submitted in partial fulfilment for the degree of Doctor of PhilosophyOne of the serious public health problems is the Traumatic Brain Injury, also known as silent epidemic, affecting millions every year. Management of these patients essentially involves neuroimaging and noncontrast CT scans are the first choice amongst doctors. Significant anatomical changes identified on the neuroimages and volumetric assessment of haemorrhages and haematomas are of critical importance for assessing the patients’ condition for targeted therapeutic and/or surgical interventions. Manual demarcation and annotation by experts is still considered gold standard, however, the interpretation of neuroimages is fraught with inter-observer variability and is considered ’Achilles heel’ amongst radiologists. Errors and variability can be attributed to factors such as poor perception, inaccurate deduction, incomplete knowledge or the quality of the image and only a third of doctors confidently report the findings. The applicability of computer aided dianosis in segmenting the apposite regions and giving ’second opinion’ has been positively appraised to assist the radiologists, however, results of the approaches vary due to parameters of algorithms and manual intervention required from doctors and this presents a gap for automated segmentation and estimation of measurements of noncontrast brain CT scans. The Pattern Driven, Content Aware Active Contours (PDCAAC) Framework developed in this thesis provides robust and efficient segmentation of significant anatomical landmarks, estimations of their sizes and correlation to CT rating to assist the radiologists in establishing the diagnosis and prognosis more confidently. The integration of clinical profile of the patient into image segmentation algorithms has significantly improved their performance by highlighting characteristics of the region of interest. The modified active contour method in the PDCAAC framework achieves Jaccard Similarity Index (JI) of 0.87, which is a significant improvement over the existing methods of active contours achieving JI of 0.807 with Simple Linear Iterative Clustering and Distance Regularized Level Set Evolution. The Intraclass Correlation Coefficient of intracranial measurements is >0.97 compared with radiologists. Automatic seeding of the initial seed curve within the region of interest is incorporated into the method which is a novel approach and alleviates limitation of existing methods. The proposed PDCAAC framework can be construed as a contribution towards research to formulate correlations between image features and clinical variables encompassing normal development, ageing, pathological and traumatic cases propitious to improve management of such patients. Establishing prognosis usually entails survival but the focus can also be extended to functional outcomes, residual disability and quality of life issues