Multi-task learning for joint weakly-supervised segmentation and aortic arch anomaly classification in fetal cardiac MRI

Congenital Heart Disease (CHD) is a group of cardiac malformations present already during fetal life, representing the prevailing category of birth defects globally. Our aim in this study is to aid 3D fetal vessel topology visualisation in aortic arch anomalies, a group which encompasses a range of conditions with significant anatomical heterogeneity. We present a multi-task framework for automated multi-class fetal vessel segmentation from 3D black blood T2w MRI and anomaly classification. Our training data consists of binary manual segmentation masks of the cardiac vessels' region in individual subjects and fully-labelled anomaly-specific population atlases. Our framework combines deep learning label propagation using VoxelMorph with 3D Attention U-Net segmentation and DenseNet121 anomaly classification. We target 11 cardiac vessels and three distinct aortic arch anomalies, including double aortic arch, right aortic arch, and suspected coarctation of the aorta. We incorporate an anomaly classifier into our segmentation pipeline, delivering a multi-task framework with the primary motivation of correcting topological inaccuracies of the segmentation. The hypothesis is that the multi-task approach will encourage the segmenter network to learn anomaly-specific features. As a secondary motivation, an automated diagnosis tool may have the potential to enhance diagnostic confidence in a decision support setting. Our results showcase that our proposed training strategy significantly outperforms label propagation and a network trained exclusively on propagated labels. Our classifier outperforms a classifier trained exclusively on T2w volume images, with an average balanced accuracy of 0.99 (0.01) after joint training. Adding a classifier improves the anatomical and topological accuracy of all correctly classified double aortic arch subjects.Comment: Accepted for publication at the Journal of Machine Learning for Biomedical Imaging (MELBA) https://melba-journal.org/2023:01

3D Approaches in Complex CHD: Where Are We? Funny Printing and Beautiful Images, or a Useful Tool?

Echocardiography, CT and MRI have a crucial role in the management of congenital heart disease (CHD) patients. All of these modalities can be presented in a 2D or a 3D rendered format. The aim of this paper is to review the key advantages and potential limitations, as well as the future challenges of a 3D approach in each imaging modality. The focus of this review is on anatomic rather than functional assessment. Conventional 2D echocardiography presents limitations when imaging complex lesions, whereas 3D imaging depicts the anatomy in all dimensions. CT and MRI can visualise extracardiac vasculature and guide complex biventricular repair. Three-dimensional printed models can be used in depicting complex intracardiac relationships and defining the surgical strategy in specific lesions. Extended reality imaging retained dynamic cardiac motion holds great potential for planning surgical and catheter procedures. Overall, the use of 3D imaging has resulted in a better understanding of anatomy, with a direct impact on the surgical and catheter approach, particularly in more complex cases

Three-dimensional visualisation of the fetal heart using prenatal MRI with motion-corrected slice-volume registration: a prospective, single-centre cohort study

Background Two-dimensional (2D) ultrasound echocardiography is the primary technique used to diagnose congenital heart disease before birth. There is, however, a longstanding need for a reliable form of secondary imaging, particularly in cases when more detailed three-dimensional (3D) vascular imaging is required, or when ultrasound windows are of poor diagnostic quality. Fetal MRI, which is well established for other organ systems, is highly susceptible to fetal movement, particularly for 3D imaging. The objective of this study was to investigate the combination of prenatal MRI with novel, motion-corrected 3D image registration software, as an adjunct to fetal echocardiography in the diagnosis of congenital heart disease. Methods Pregnant women carrying a fetus with known or suspected congenital heart disease were recruited via a tertiary fetal cardiology unit. After initial validation experiments to assess the general reliability of the approach, MRI data were acquired in 85 consecutive fetuses, as overlapping stacks of 2D images. These images were then processed with a bespoke open-source reconstruction algorithm to produce a super-resolution 3D volume of the fetal thorax. These datasets were assessed with measurement comparison with paired 2D ultrasound, structured anatomical assessment of the 2D and 3D data, and contemporaneous, archived clinical fetal MRI reports, which were compared with postnatal findings after delivery. Findings Between Oct 8, 2015, and June 30, 2017, 101 patients were referred for MRI, of whom 85 were eligible and had fetal MRI. The mean gestational age at the time of MRI was 32 weeks (range 24–36). High-resolution (0·50–0·75 mm isotropic) 3D datasets of the fetal thorax were generated in all 85 cases. Vascular measurements showed good overall agreement with 2D echocardiography in 51 cases with paired data (intra-class correlation coefficient 0·78, 95% CI 0·68–0·84), with fetal vascular structures more effectively visualised with 3D MRI than with uncorrected 2D MRI (657 [97%] of 680 anatomical areas identified vs 358 [53%] of 680 areas; p<0·0001). When a structure of interest was visualised in both 2D and 3D data (n=358), observers gave a higher diagnostic quality score for 3D data in 321 (90%) of cases, with 37 (10%) scores tied with 2D data, and no lower scores than for 2D data (Wilcoxon signed rank test p<0·0001). Additional anatomical features were described in ten cases, of which all were confirmed postnatally. Interpretation Standard fetal MRI with open-source image processing software is a reliable method of generating high-resolution 3D imaging of the fetal vasculature. The 3D volumes produced show good spatial agreement with ultrasound, and significantly improved visualisation and diagnostic quality compared with source 2D MRI data. This freely available combination requires minimal infrastructure, and provides safe, powerful, and highly complementary imaging of the fetal cardiovascular system. Funding Wellcome Trust/EPSRC Centre for Medical Engineering, National Institute for Health Research