Deep learning applications in coronary anatomy imaging:a systematic review and meta-analysis

Background: The application of deep learning on medical imaging is growing in prevalence in the recent literature. One of the most studied areas is coronary artery disease (CAD). Imaging of coronary artery anatomy is fundamental, which has led to a high number of publications describing a variety of techniques. The aim of this systematic review is to review the evidence behind the accuracy of deep learning applications in coronary anatomy imaging. Methods: The search for the relevant studies, which applied deep learning on coronary anatomy imaging, was performed in a systematic approach on MEDLINE and EMBASE databases, followed by reviewing of abstracts and full texts. The data from the final studies was retrieved using data extraction forms. A meta-analysis was performed on a subgroup of studies, which looked at fractional flow reserve (FFR) prediction. Heterogeneity was tested using tau2, I2 and Q tests. Finally, a risk of bias was performed using Quality Assessment of Diagnostic Accuracy Studies (QUADAS) approach. Results: A total of 81 studies met the inclusion criteria. The most common imaging modality was coronary computed tomography angiography (CCTA) (58%) and the most common deep learning method was convolutional neural network (CNN) (52%). The majority of studies demonstrated good performance metrics. The most common outputs were focused on coronary artery segmentation, clinical outcome prediction, coronary calcium quantification and FFR prediction, and most studies reported area under the curve (AUC) of ≥80%. The pooled diagnostic odds ratio (DOR) derived from 8 studies looking at FFR prediction using CCTA was 12.5 using the Mantel-Haenszel (MH) method. There was no significant heterogeneity amongst studies according to Q test (P=0.2496). Conclusions: Deep learning has been used in many applications on coronary anatomy imaging, most of which are yet to be externally validated and prepared for clinical use. The performance of deep learning, especially CNN models, proved to be powerful and some applications have already translated into medical practice, such as computed tomography (CT)-FFR. These applications have the potential to translate technology into better care of CAD patients.</p

High-resolution quantification of stress perfusion defects by cardiac magnetic resonance

Aims Quantitative stress perfusion cardiac magnetic resonance (CMR) is becoming more widely available, but it is still unclear how to integrate this information into clinical decision-making. Typically, pixel-wise perfusion maps are generated, but diagnostic and prognostic studies have summarized perfusion as just one value per patient or in 16 myocardial segments. In this study, the reporting of quantitative perfusion maps is extended from the standard 16 segments to a high-resolution bullseye. Cut-off thresholds are established for the high-resolution bullseye, and the identified perfusion defects are compared with visual assessment. Methods and results Thirty-four patients with known or suspected coronary artery disease were retrospectively analysed. Visual perfusion defects were contoured on the CMR images and pixel-wise quantitative perfusion maps were generated. Cut-off values were established on the high-resolution bullseye consisting of 1800 points and compared with the per-segment, per-coronary, and per-patient resolution thresholds. Quantitative stress perfusion was significantly lower in visually abnormal pixels, 1.11 (0.75–1.57) vs. 2.35 (1.82–2.9) mL/min/g (Mann–Whitney U test P < 0.001), with an optimal cut-off of 1.72 mL/min/g. This was lower than the segment-wise optimal threshold of 1.92 mL/min/g. The Bland–Altman analysis showed that visual assessment underestimated large perfusion defects compared with the quantification with good agreement for smaller defect burdens. A Dice overlap of 0.68 (0.57–0.78) was found. Conclusion This study introduces a high-resolution bullseye consisting of 1800 points, rather than 16, per patient for reporting quantitative stress perfusion, which may improve sensitivity. Using this representation, the threshold required to identify areas of reduced perfusion is lower than for segmental analysis

Physics-informed neural networks for myocardial perfusion MRI quantification

Tracer-kinetic models allow for the quantification of kinetic parameters such as blood flow from dynamic contrast-enhanced magnetic resonance (MR) images. Fitting the observed data with multi-compartment exchange models is desirable, as they are physiologically plausible and resolve directly for blood flow and microvascular function. However, the reliability of model fitting is limited by the low signal-to-noise ratio, temporal resolution, and acquisition length. This may result in inaccurate parameter estimates. This study introduces physics-informed neural networks (PINNs) as a means to perform myocardial perfusion MR quantification, which provides a versatile scheme for the inference of kinetic parameters. These neural networks can be trained to fit the observed perfusion MR data while respecting the underlying physical conservation laws described by a multi-compartment exchange model. Here, we provide a framework for the implementation of PINNs in myocardial perfusion MR. The approach is validated both in silico and in vivo. In the in silico study, an overall decrease in mean-squared error with the ground-truth parameters was observed compared to a standard non-linear least squares fitting approach. The in vivo study demonstrates that the method produces parameter values comparable to those previously found in literature, as well as providing parameter maps which match the clinical diagnosis of patients.</p

High-resolution quantification of stress perfusion defects by cardiac magnetic resonance

AIMS: Quantitative stress perfusion cardiac magnetic resonance (CMR) is becoming more widely available, but it is still unclear how to integrate this information into clinical decision-making. Typically, pixel-wise perfusion maps are generated, but diagnostic and prognostic studies have summarized perfusion as just one value per patient or in 16 myocardial segments. In this study, the reporting of quantitative perfusion maps is extended from the standard 16 segments to a high-resolution bullseye. Cut-off thresholds are established for the high-resolution bullseye, and the identified perfusion defects are compared with visual assessment.METHODS AND RESULTS: Thirty-four patients with known or suspected coronary artery disease were retrospectively analysed. Visual perfusion defects were contoured on the CMR images and pixel-wise quantitative perfusion maps were generated. Cut-off values were established on the high-resolution bullseye consisting of 1800 points and compared with the per-segment, per-coronary, and per-patient resolution thresholds. Quantitative stress perfusion was significantly lower in visually abnormal pixels, 1.11 (0.75-1.57) vs. 2.35 (1.82-2.9) mL/min/g (Mann-Whitney U test P &lt; 0.001), with an optimal cut-off of 1.72 mL/min/g. This was lower than the segment-wise optimal threshold of 1.92 mL/min/g. The Bland-Altman analysis showed that visual assessment underestimated large perfusion defects compared with the quantification with good agreement for smaller defect burdens. A Dice overlap of 0.68 (0.57-0.78) was found. CONCLUSION: This study introduces a high-resolution bullseye consisting of 1800 points, rather than 16, per patient for reporting quantitative stress perfusion, which may improve sensitivity. Using this representation, the threshold required to identify areas of reduced perfusion is lower than for segmental analysis.</p

AI-AIF: artificial intelligence-based arterial input function for quantitative stress perfusion cardiac magnetic resonance

Aims:One of the major challenges in the quantification of myocardial blood flow (MBF) from stress perfusion cardiac magnetic resonance (CMR) is the estimation of the arterial input function (AIF). This is due to the non-linear relationship between the concentration of gadolinium and the MR signal, which leads to signal saturation. In this work, we show that a deep learning model can be trained to predict the unsaturated AIF from standard images, using the reference dual-sequence acquisition AIFs (DS-AIFs) for training.Methods and results:A 1D U-Net was trained, to take the saturated AIF from the standard images as input and predict the unsaturated AIF, using the data from 201 patients from centre 1 and a test set comprised of both an independent cohort of consecutive patients from centre 1 and an external cohort of patients from centre 2 (n = 44). Fully-automated MBF was compared between the DS-AIF and AI-AIF methods using the Mann–Whitney U test and Bland–Altman analysis. There was no statistical difference between the MBF quantified with the DS-AIF [2.77 mL/min/g (1.08)] and predicted with the AI-AIF (2.79 mL/min/g (1.08), P = 0.33. Bland–Altman analysis shows minimal bias between the DS-AIF and AI-AIF methods for quantitative MBF (bias of −0.11 mL/min/g). Additionally, the MBF diagnosis classification of the AI-AIF matched the DS-AIF in 669/704 (95%) of myocardial segments.Conclusion:Quantification of stress perfusion CMR is feasible with a single-sequence acquisition and a single contrast injection using an AI-based correction of the AIF

Multi-Centre, Multi-Vendor and Multi-Disease Cardiac Segmentation: The M&Ms Challenge

The emergence of deep learning has considerably advanced the state-of-the-art in cardiac magnetic resonance (CMR) segmentation. Many techniques have been proposed over the last few years, bringing the accuracy of automated segmentation close to human performance. However, these models have been all too often trained and validated using cardiac imaging samples from single clinical centres or homogeneous imaging protocols. This has prevented the development and validation of models that are generalizable across different clinical centres, imaging conditions or scanner vendors. To promote further research and scientific benchmarking in the field of generalizable deep learning for cardiac segmentation, this paper presents the results of the Multi-Centre, Multi-Vendor and Multi-Disease Cardiac Segmentation (M&Ms) Challenge, which was recently organized as part of the MICCAI 2020 Conference. A total of 14 teams submitted different solutions to the problem, combining various baseline models, data augmentation strategies, and domain adaptation techniques. The obtained results indicate the importance of intensity-driven data augmentation, as well as the need for further research to improve generalizability towards unseen scanner vendors or new imaging protocols. Furthermore, we present a new resource of 375 heterogeneous CMR datasets acquired by using four different scanner vendors in six hospitals and three different countries (Spain, Canada and Germany), which we provide as open-access for the community to enable future research in the field