PVR: Patch-to-Volume Reconstruction for Large Area Motion Correction of Fetal MRI

In this paper we present a novel method for the correction of motion artifacts that are present in fetal Magnetic Resonance Imaging (MRI) scans of the whole uterus. Contrary to current slice-to-volume registration (SVR) methods, requiring an inflexible anatomical enclosure of a single investigated organ, the proposed patch-to-volume reconstruction (PVR) approach is able to reconstruct a large field of view of non-rigidly deforming structures. It relaxes rigid motion assumptions by introducing a specific amount of redundant information that is exploited with parallelized patch-wise optimization, super-resolution, and automatic outlier rejection. We further describe and provide an efficient parallel implementation of PVR allowing its execution within reasonable time on commercially available graphics processing units (GPU), enabling its use in the clinical practice. We evaluate PVR's computational overhead compared to standard methods and observe improved reconstruction accuracy in presence of affine motion artifacts of approximately 30% compared to conventional SVR in synthetic experiments. Furthermore, we have evaluated our method qualitatively and quantitatively on real fetal MRI data subject to maternal breathing and sudden fetal movements. We evaluate peak-signal-to-noise ratio (PSNR), structural similarity index (SSIM), and cross correlation (CC) with respect to the originally acquired data and provide a method for visual inspection of reconstruction uncertainty. With these experiments we demonstrate successful application of PVR motion compensation to the whole uterus, the human fetus, and the human placenta.Comment: 10 pages, 13 figures, submitted to IEEE Transactions on Medical Imaging. v2: wadded funders acknowledgements to preprin

3D global and regional patterns of human fetal subplate growth determined in utero

The waiting period of subplate evolution is a critical phase for the proper formation of neural connections in the brain. During this time, which corresponds to 15 to 24 postconceptual weeks (PCW) in the human fetus, thalamocortical and cortico-cortical afferents wait in and are in part guided by molecules embedded in the extracellular matrix of the subplate. Recent advances in fetal MRI techniques now allow us to study the developing brain anatomy in 3D from in utero imaging. We describe a reliable segmentation protocol to delineate the boundaries of the subplate from T2-W MRI. The reliability of the protocol was evaluated in terms of intra-rater reproducibility on a subset of the subjects. We also present the first 3D quantitative analyses of temporal changes in subplate volume, thickness, and contrast from 18 to 24 PCW. Our analysis shows that firstly, global subplate volume increases in proportion with the supratentorial volume; the subplate remained approximately one-third of supratentorial volume. Secondly, we found both global and regional growth in subplate thickness and a linear increase in the median and maximum subplate thickness through the waiting period. Furthermore, we found that posterior regions—specifically the occipital pole, ventral occipito-temporal region, and planum temporale—of the developing brain underwent the most statistically significant increases in subplate thickness. During this period, the thickest region was the developing somatosensory/motor cortex. The subplate growth patterns reported here may be used as a baseline for comparison to abnormal fetal brain development

Fast volume reconstruction from motion corrupted stacks of 2D slices

Capturing an enclosing volume of moving subjects and organs using fast individual image slice acquisition has shown promise in dealing with motion artefacts. Motion between slice acquisitions results in spatial inconsistencies that can be resolved by slice-to-volume reconstruction (SVR) methods to provide high quality 3D image data. Existing algorithms are, however, typically very slow, specialised to specific applications and rely on approximations, which impedes their potential clinical use. In this paper, we present a fast multi-GPU accelerated framework for slice-to-volume reconstruction. It is based on optimised 2D/3D registration, super-resolution with automatic outlier rejection and an additional (optional) intensity bias correction. We introduce a novel and fully automatic procedure for selecting the image stack with least motion to serve as an initial registration target. We evaluate the proposed method using artificial motion corrupted phantom data as well as clinical data, including tracked freehand ultrasound of the liver and fetal Magnetic Resonance Imaging. We achieve speed-up factors greater than 30 compared to a single CPU system and greater than 10 compared to currently available state-of-the-art multi-core CPU methods. We ensure high reconstruction accuracy by exact computation of the point-spread function for every input data point, which has not previously been possible due to computational limitations. Our framework and its implementation is scalable for available computational infrastructures and tests show a speed-up factor of 1.70 for each additional GPU. This paves the way for the online application of image based reconstruction methods during clinical examinations. The source code for the proposed approach is publicly available

Predicting Slice-to-Volume Transformation in Presence of Arbitrary Subject Motion

This paper aims to solve a fundamental problem in intensity-based 2D/3D registration, which concerns the limited capture range and need for very good initialization of state-of-the-art image registration methods. We propose a regression approach that learns to predict rotation and translations of arbitrary 2D image slices from 3D volumes, with respect to a learned canonical atlas co-ordinate system. To this end, we utilize Convolutional Neural Networks (CNNs) to learn the highly complex regression function that maps 2D image slices into their correct position and orientation in 3D space. Our approach is attractive in challenging imaging scenarios, where significant subject motion complicates reconstruction performance of 3D volumes from 2D slice data. We extensively evaluate the effectiveness of our approach quantitatively on simulated MRI brain data with extreme random motion. We further demonstrate qualitative results on fetal MRI where our method is integrated into a full reconstruction and motion compensation pipeline. With our CNN regression approach we obtain an average prediction error of 7mm on simulated data, and convincing reconstruction quality of images of very young fetuses where previous methods fail. We further discuss applications to Computed Tomography and X-ray projections. Our approach is a general solution to the 2D/3D initialization problem. It is computationally efficient, with prediction times per slice of a few milliseconds, making it suitable for real-time scenarios.Comment: 8 pages, 4 figures, 6 pages supplemental material, currently under review for MICCAI 201

Automated template-based brain localization and extraction for fetal brain MRI reconstruction.

Most fetal brain MRI reconstruction algorithms rely only on brain tissue-relevant voxels of low-resolution (LR) images to enhance the quality of inter-slice motion correction and image reconstruction. Consequently the fetal brain needs to be localized and extracted as a first step, which is usually a laborious and time consuming manual or semi-automatic task. We have proposed in this work to use age-matched template images as prior knowledge to automatize brain localization and extraction. This has been achieved through a novel automatic brain localization and extraction method based on robust template-to-slice block matching and deformable slice-to-template registration. Our template-based approach has also enabled the reconstruction of fetal brain images in standard radiological anatomical planes in a common coordinate space. We have integrated this approach into our new reconstruction pipeline that involves intensity normalization, inter-slice motion correction, and super-resolution (SR) reconstruction. To this end we have adopted a novel approach based on projection of every slice of the LR brain masks into the template space using a fusion strategy. This has enabled the refinement of brain masks in the LR images at each motion correction iteration. The overall brain localization and extraction algorithm has shown to produce brain masks that are very close to manually drawn brain masks, showing an average Dice overlap measure of 94.5%. We have also demonstrated that adopting a slice-to-template registration and propagation of the brain mask slice-by-slice leads to a significant improvement in brain extraction performance compared to global rigid brain extraction and consequently in the quality of the final reconstructed images. Ratings performed by two expert observers show that the proposed pipeline can achieve similar reconstruction quality to reference reconstruction based on manual slice-by-slice brain extraction. The proposed brain mask refinement and reconstruction method has shown to provide promising results in automatic fetal brain MRI segmentation and volumetry in 26 fetuses with gestational age range of 23 to 38 weeks

Novel Image Processing Methods for Improved Fetal Brain MRI

Fetal magnetic resonance imaging (MRI) has been increasingly used as a powerful complement imaging modality to ultrasound imaging (US) for the clinical evaluation of prenatal abnormalities. Specifically, clinical application of fetal MRI has been significantly improved in the nineties by hardware and software advances with the development of ultrafast multi-slice T2-weighted (T2w) acquisition sequences able to freeze the unpredictable fetal motion and provide excellent soft-tissue contrast. Fetal motion is indeed the major challenge in fetal MRI and slice acquisition time should be kept as short as possible. As a result, typical fetal MRI examination involves the acquisition of a set of orthogonally planned scans of thick two-dimensional slices, largely free of intra-slice motion artifacts. The poor resolution in the slice-select dimension as well as possible motion occurring between slices limits further quantitative data analysis, which is the key for a better understanding of the developing brain but also the key for the determination of operator-independent biomarkers that might significantly facilitate fetal diagnosis and prognosis. To this end, several research groups have developed in the past ten years advanced image processing methods, often denoted by motion-robust super-resolution (SR) techniques, to reconstruct from a set of clinical low-resolution (LR) scans, a high-resolution (HR) motion-free volume. SR problem is usually modeled as a linear inverse problem describing the imaging degradation due to acquisition and fetal motion. Typically, such approaches consist in iterating between slice motion estimation that estimates the motion parameters and SR that recovers the HR image given the estimated degradation model. This thesis focuses on the development of novel advanced image processing methods, which have enabled the design of a completely automated reconstruction pipeline for fetal MRI. The proposed techniques help in improving state-of-the-art fetal MRI reconstruction in terms of efficiency, robustness and minimized user-interactions, with the ultimate goal of being translated to the clinical environment. The first part focuses on the development of a more efficient Total Variation (TV)-regularized optimization algorithm for the SR problem. The algorithm uses recent advances in convex optimization with a novel adaptive regularization strategy to offer simultaneously fast, accurate and robust solutions to the fetal image recovery problem. Extensive validations on both simulated fetal and real clinical data show the proposed algorithm is highly robust in front of motion artifacts and that it offers the best trade-off between speed and accuracy for fetal MRI recovery as in comparison with state-of-the art methods. The second part focuses on the development of a novel automatic brain localization and extraction approach based on template-to-slice block matching and deformable slice-totemplate registration. Asmost fetal brain MRI reconstruction algorithms rely only on brain tissue-relevant voxels of low-resolution (LR) images to enhance the quality of inter-slice motion correction and image reconstruction, the fetal brain needs to be localized and extracted as a first step. These tasks generally necessitate user interaction, manually or semi-automatically done. Our methods have enabled the design of completely automated reconstruction pipeline that involves intensity normalization, inter-slice motion estimation, and super-resolution. Quantitative evaluation on clinical MRI scans shows that our approach produces brain masks that are very close to manually drawn brain masks, and ratings performed by two expert observers show that the proposed pipeline achieves similar reconstruction quality to reference reconstruction based on manual slice-by-slice brain extraction without any further effort. The third part investigates the possibility of automatic cortical folding quantification, one of the best biomarkers of brain maturation, by combining our automatic reconstruction pipeline with a state-of-the-art fetal brain tissue segmentation method and existing automated tools provided for adult brain’s cortical folding quantification. Results indicate that our reconstruction pipeline can provide HR MR images with sufficient quality that enable the use of surface tessellation and active surface algorithms similar to those developed for adults to extract meaningful information about fetal brain maturation. Finally, the last part presents new methodological improvements of the reconstruction pipeline aiming at improving the quality of the image for quantitative data analysis, whose accuracy is highly dependent on the quality and resolution of the reconstructed image. In particular, it presents a more consistent and global magnetic bias field correction method which takes advantage of the super-resolution framework to provide a final reconstructed image quasi free of the smooth bias field. Then, it presents a new TV SR algorithm that uses the Huber norm in the data fidelity term to be more robust to non-Gaussian outliers. It also presents the design of a novel joint reconstruction-segmentation framework and the development of a novel TV SR algorithm driven by segmentation to produce images with enhanced edge information that could ultimately improve their segmentation. Finally, it preliminary investigates the capability of increasing the resolution in the in-plane dimensions using SR to ultimately reduce the partial volume effect

Towards a comprehensive framework for movement and distortion correction of diffusion MR images: Within volume movement

Most motion correction methods work by aligning a set of volumes together, or to a volume that represents a reference location. These are based on an implicit assumption that the subject remains motionless during the several seconds it takes to acquire all slices in a volume, and that any movement occurs in the brief moment between acquiring the last slice of one volume and the first slice of the next. This is clearly an approximation that can be more or less good depending on how long it takes to acquire one volume and in how rapidly the subject moves. In this paper we present a method that increases the temporal resolution of the motion correction by modelling movement as a piecewise continous function over time. This intra-volume movement correction is implemented within a previously presented framework that simultaneously estimates distortions, movement and movement-induced signal dropout. We validate the method on highly realistic simulated data containing all of these effects. It is demonstrated that we can estimate the true movement with high accuracy, and that scalar parameters derived from the data, such as fractional anisotropy, are estimated with greater fidelity when data has been corrected for intra-volume movement. Importantly, we also show that the difference in fidelity between data affected by different amounts of movement is much reduced when taking intra-volume movement into account. Additional validation was performed on data from a healthy volunteer scanned when lying still and when performing deliberate movements. We show an increased correspondence between the “still” and the “movement” data when the latter is corrected for intra-volume movement. Finally we demonstrate a big reduction in the telltale signs of intra-volume movement in data acquired on elderly subjects

A normative spatiotemporal MRI atlas of the fetal brain for automatic segmentation and analysis of early brain growth.

Longitudinal characterization of early brain growth in-utero has been limited by a number of challenges in fetal imaging, the rapid change in size, shape and volume of the developing brain, and the consequent lack of suitable algorithms for fetal brain image analysis. There is a need for an improved digital brain atlas of the spatiotemporal maturation of the fetal brain extending over the key developmental periods. We have developed an algorithm for construction of an unbiased four-dimensional atlas of the developing fetal brain by integrating symmetric diffeomorphic deformable registration in space with kernel regression in age. We applied this new algorithm to construct a spatiotemporal atlas from MRI of 81 normal fetuses scanned between 19 and 39 weeks of gestation and labeled the structures of the developing brain. We evaluated the use of this atlas and additional individual fetal brain MRI atlases for completely automatic multi-atlas segmentation of fetal brain MRI. The atlas is available online as a reference for anatomy and for registration and segmentation, to aid in connectivity analysis, and for groupwise and longitudinal analysis of early brain growth