Deep learning for cardiac image segmentation: A review

Deep learning has become the most widely used approach for cardiac image segmentation in recent years. In this paper, we provide a review of over 100 cardiac image segmentation papers using deep learning, which covers common imaging modalities including magnetic resonance imaging (MRI), computed tomography (CT), and ultrasound (US) and major anatomical structures of interest (ventricles, atria and vessels). In addition, a summary of publicly available cardiac image datasets and code repositories are included to provide a base for encouraging reproducible research. Finally, we discuss the challenges and limitations with current deep learning-based approaches (scarcity of labels, model generalizability across different domains, interpretability) and suggest potential directions for future research

Automatic Segmentation of the Left Ventricle in Cardiac CT Angiography Using Convolutional Neural Network

Accurate delineation of the left ventricle (LV) is an important step in evaluation of cardiac function. In this paper, we present an automatic method for segmentation of the LV in cardiac CT angiography (CCTA) scans. Segmentation is performed in two stages. First, a bounding box around the LV is detected using a combination of three convolutional neural networks (CNNs). Subsequently, to obtain the segmentation of the LV, voxel classification is performed within the defined bounding box using a CNN. The study included CCTA scans of sixty patients, fifty scans were used to train the CNNs for the LV localization, five scans were used to train LV segmentation and the remaining five scans were used for testing the method. Automatic segmentation resulted in the average Dice coefficient of 0.85 and mean absolute surface distance of 1.1 mm. The results demonstrate that automatic segmentation of the LV in CCTA scans using voxel classification with convolutional neural networks is feasible.Comment: This work has been published as: Zreik, M., Leiner, T., de Vos, B. D., van Hamersvelt, R. W., Viergever, M. A., I\v{s}gum, I. (2016, April). Automatic segmentation of the left ventricle in cardiac CT angiography using convolutional neural networks. In Biomedical Imaging (ISBI), 2016 IEEE 13th International Symposium on (pp. 40-43). IEE

Deep learning analysis of the myocardium in coronary CT angiography for identification of patients with functionally significant coronary artery stenosis

In patients with coronary artery stenoses of intermediate severity, the functional significance needs to be determined. Fractional flow reserve (FFR) measurement, performed during invasive coronary angiography (ICA), is most often used in clinical practice. To reduce the number of ICA procedures, we present a method for automatic identification of patients with functionally significant coronary artery stenoses, employing deep learning analysis of the left ventricle (LV) myocardium in rest coronary CT angiography (CCTA). The study includes consecutively acquired CCTA scans of 166 patients with FFR measurements. To identify patients with a functionally significant coronary artery stenosis, analysis is performed in several stages. First, the LV myocardium is segmented using a multiscale convolutional neural network (CNN). To characterize the segmented LV myocardium, it is subsequently encoded using unsupervised convolutional autoencoder (CAE). Thereafter, patients are classified according to the presence of functionally significant stenosis using an SVM classifier based on the extracted and clustered encodings. Quantitative evaluation of LV myocardium segmentation in 20 images resulted in an average Dice coefficient of 0.91 and an average mean absolute distance between the segmented and reference LV boundaries of 0.7 mm. Classification of patients was evaluated in the remaining 126 CCTA scans in 50 10-fold cross-validation experiments and resulted in an area under the receiver operating characteristic curve of 0.74 +- 0.02. At sensitivity levels 0.60, 0.70 and 0.80, the corresponding specificity was 0.77, 0.71 and 0.59, respectively. The results demonstrate that automatic analysis of the LV myocardium in a single CCTA scan acquired at rest, without assessment of the anatomy of the coronary arteries, can be used to identify patients with functionally significant coronary artery stenosis.Comment: This paper was submitted in April 2017 and accepted in November 2017 for publication in Medical Image Analysis. Please cite as: Zreik et al., Medical Image Analysis, 2018, vol. 44, pp. 72-8

Exploring the applicability of machine learning based artificial intelligence in the analysis of cardiovascular imaging

Worldwide, the prevalence of cardiovascular diseases has doubled, demanding new diagnostic tools. Artificial intelligence, especially machine learning and deep learning, offers innovative possibilities for medical research. Despite historical challenges, such as a lack of data, these techniques have potential for cardiovascular research. This thesis explores the application of machine learning and deep learning in cardiology, focusing on automation and decision support in cardiovascular imaging.Part I of this thesis focuses on automating cardiovascular MRI analysis. A deep learning model was developed to analyze the ascending aorta in cardiovascular MRI images. The model's results were used to investigate connections between genetic material and aortic properties, and between aortic properties and cardiovascular diseases and mortality. A second model was developed to select MRI images suitable for analyzing the pulmonary artery.Part II focuses on decision support in nuclear cardiovascular imaging. A first machine learning model was developed to predict myocardial ischemia based on CTA variables. In addition, a deep neural network was used to identify reduced oxygen supply through the arteries supplying oxygen-rich blood to the heart and cardiovascular risk features using PET images.This thesis successfully explores the possibilities of machine learning and deep learning in cardiovascular research, with a focus on automated analysis and decision support

Exploring the applicability of machine learning based artificial intelligence in the analysis of cardiovascular imaging

Worldwide, the prevalence of cardiovascular diseases has doubled, demanding new diagnostic tools. Artificial intelligence, especially machine learning and deep learning, offers innovative possibilities for medical research. Despite historical challenges, such as a lack of data, these techniques have potential for cardiovascular research. This thesis explores the application of machine learning and deep learning in cardiology, focusing on automation and decision support in cardiovascular imaging.Part I of this thesis focuses on automating cardiovascular MRI analysis. A deep learning model was developed to analyze the ascending aorta in cardiovascular MRI images. The model's results were used to investigate connections between genetic material and aortic properties, and between aortic properties and cardiovascular diseases and mortality. A second model was developed to select MRI images suitable for analyzing the pulmonary artery.Part II focuses on decision support in nuclear cardiovascular imaging. A first machine learning model was developed to predict myocardial ischemia based on CTA variables. In addition, a deep neural network was used to identify reduced oxygen supply through the arteries supplying oxygen-rich blood to the heart and cardiovascular risk features using PET images.This thesis successfully explores the possibilities of machine learning and deep learning in cardiovascular research, with a focus on automated analysis and decision support

Automated Diagnosis of Cardiovascular Diseases from Cardiac Magnetic Resonance Imaging Using Deep Learning Models: A Review

In recent years, cardiovascular diseases (CVDs) have become one of the leading causes of mortality globally. CVDs appear with minor symptoms and progressively get worse. The majority of people experience symptoms such as exhaustion, shortness of breath, ankle swelling, fluid retention, and other symptoms when starting CVD. Coronary artery disease (CAD), arrhythmia, cardiomyopathy, congenital heart defect (CHD), mitral regurgitation, and angina are the most common CVDs. Clinical methods such as blood tests, electrocardiography (ECG) signals, and medical imaging are the most effective methods used for the detection of CVDs. Among the diagnostic methods, cardiac magnetic resonance imaging (CMR) is increasingly used to diagnose, monitor the disease, plan treatment and predict CVDs. Coupled with all the advantages of CMR data, CVDs diagnosis is challenging for physicians due to many slices of data, low contrast, etc. To address these issues, deep learning (DL) techniques have been employed to the diagnosis of CVDs using CMR data, and much research is currently being conducted in this field. This review provides an overview of the studies performed in CVDs detection using CMR images and DL techniques. The introduction section examined CVDs types, diagnostic methods, and the most important medical imaging techniques. In the following, investigations to detect CVDs using CMR images and the most significant DL methods are presented. Another section discussed the challenges in diagnosing CVDs from CMR data. Next, the discussion section discusses the results of this review, and future work in CVDs diagnosis from CMR images and DL techniques are outlined. The most important findings of this study are presented in the conclusion section

Application of AI in cardiovascular multimodality imaging

Technical advances in artificial intelligence (AI) in cardiac imaging are rapidly improving the reproducibility of this approach and the possibility to reduce time necessary to generate a report. In cardiac computed tomography angiography (CCTA) the main application of AI in clinical practice is focused on detection of stenosis, characterization of coronary plaques, and detection of myocardial ischemia. In cardiac magnetic resonance (CMR) the application of AI is focused on post-processing and particularly on the segmentation of cardiac chambers during late gadolinium enhancement. In echocardiography, the application of AI is focused on segmentation of cardiac chambers and is helpful for valvular function and wall motion abnormalities. The common thread represented by all of these techniques aims to shorten the time of interpretation without loss of information compared to the standard approach. In this review we provide an overview of AI applications in multimodality cardiac imaging

Automatic segmentation of the right ventricle from cardiac MRI using a learning-based approach

PurposeThis study aims to accurately segment the right ventricle (RV) from cardiac MRI using a fully automatic learning-based method.MethodsThe proposed method uses deep learning algorithms, i.e., convolutional neural networks and stacked autoencoders, for automatic detection and initial segmentation of the RV chamber. The initial segmentation is then combined with the deformable models to improve the accuracy and robustness of the process. We trained our algorithm using 16 cardiac MRI datasets of the MICCAI 2012 RV Segmentation Challenge database and validated our technique using the rest of the dataset (32 subjects).ResultsAn average Dice metric of 82.5% along with an average Hausdorff distance of 7.85 mm were achieved for all the studied subjects. Furthermore, a high correlation and level of agreement with the ground truth contours for end-diastolic volume (0.98), end-systolic volume (0.99), and ejection fraction (0.93) were observed.ConclusionOur results show that deep learning algorithms can be effectively used for automatic segmentation of the RV. Computed quantitative metrics of our method outperformed that of the existing techniques participated in the MICCAI 2012 challenge, as reported by the challenge organizers. Magn Reson Med 78:2439-2448, 2017. © 2017 International Society for Magnetic Resonance in Medicine