WarpPINN: Cine-MR image registration with physics-informed neural networks

Heart failure is typically diagnosed with a global function assessment, such as ejection fraction. However, these metrics have low discriminate power, failing to distinguish different types of this disease. Quantifying local deformations in the form of cardiac strain can provide helpful information, but it remains a challenge. In this work, we introduce WarpPINN, a physics-informed neural network to perform image registration to obtain local metrics of the heart deformation. We apply this method to cine magnetic resonance images to estimate the motion during the cardiac cycle. We inform our neural network of near-incompressibility of cardiac tissue by penalizing the jacobian of the deformation field. The loss function has two components: an intensity-based similarity term between the reference and the warped template images, and a regularizer that represents the hyperelastic behavior of the tissue. The architecture of the neural network allows us to easily compute the strain via automatic differentiation to assess cardiac activity. We use Fourier feature mappings to overcome the spectral bias of neural networks, allowing us to capture discontinuities in the strain field. We test our algorithm on a synthetic example and on a cine-MRI benchmark of 15 healthy volunteers. We outperform current methodologies both landmark tracking and strain estimation. We expect that WarpPINN will enable more precise diagnostics of heart failure based on local deformation information. Source code is available at https://github.com/fsahli/WarpPINN.Comment: 18 pages, 10 figure

Three Dimensional Tissue Motion Analysis from Tagged Magnetic Resonance Imaging

Motion estimation of soft tissues during organ deformation has been an important topic in medical imaging studies. Its application involves a variety of internal and external organs including the heart, the lung, the brain, and the tongue. Tagged magnetic resonance imaging has been used for decades to observe and quantify motion and strain of deforming tissues. It places temporary noninvasive markers—so called "tags"—in the tissue of interest that deform together with the tissue during motion, producing images that carry motion information in the deformed tagged patterns. These images can later be processed using phase-extraction algorithms to achieve motion estimation and strain computation. In this dissertation, we study three-dimensional (3D) motion estimation and analysis using tagged magnetic resonance images with applications focused on speech studies and traumatic brain injury modeling. Novel algorithms are developed to assist tagged motion analysis. Firstly, a pipeline of methods—TMAP—is proposed to compute 3D motion from tagged and cine images of the tongue during speech. TMAP produces an estimation of motion along with a multi-subject analysis of motion pattern differences between healthy control subjects and post-glossectomy patients. Secondly, an enhanced 3D motion estimation algorithm—E-IDEA—is proposed. E-IDEA tackles the incompressible motion both on the internal tissue region and the tissue boundaries, reducing the boundary errors and yielding a motion estimate that is more accurate overall. Thirdly, a novel 3D motion estimation algorithm—PVIRA—is developed. Based on image registration and tracking, PVIRA is a faster and more robust method that performs phase extraction in a novel way. Lastly, a method to reveal muscles' activity using strain in the line of action of muscle fiber directions is presented. It is a first step toward relating motion production with individual muscles and provides a new tool for future clinical and scientific use

Analytical method to measure three-dimensional strain patterns in the left ventricle from single slice displacement data

Background: Displacement encoded Cardiovascular MR (CMR) can provide high spatial resolution measurements of three-dimensional (3D) Lagrangian displacement. Spatial gradients of the Lagrangian displacement field are used to measure regional myocardial strain. In general, adjacent parallel slices are needed in order to calculate the spatial gradient in the through-slice direction. This necessitates the acquisition of additional data and prolongs the scan time. The goal of this study is to define an analytic solution that supports the reconstruction of the out-of-plane components of the Lagrangian strain tensor in addition to the in-plane components from a single-slice displacement CMR dataset with high spatio-temporal resolution. The technique assumes incompressibility of the myocardium as a physical constraint. Results: The feasibility of the method is demonstrated in a healthy human subject and the results are compared to those of other studies. The proposed method was validated with simulated data and strain estimates from experimentally measured DENSE data, which were compared to the strain calculation from a conventional two-slice acquisition. Conclusion: This analytical method reduces the need to acquire data from adjacent slices when calculating regional Lagrangian strains and can effectively reduce the long scan time by a factor of two

Dynamic finite-strain modelling of the human left ventricle in health and disease using an immersed boundary-finite element method

Detailed models of the biomechanics of the heart are important both for developing improved interventions for patients with heart disease and also for patient risk stratification and treatment planning. For instance, stress distributions in the heart affect cardiac remodelling, but such distributions are not presently accessible in patients. Biomechanical models of the heart offer detailed three-dimensional deformation, stress and strain fields that can supplement conventional clinical data. In this work, we introduce dynamic computational models of the human left ventricle (LV) that are derived from clinical imaging data obtained from a healthy subject and from a patient with a myocardial infarction (MI). Both models incorporate a detailed invariant-based orthotropic description of the passive elasticity of the ventricular myocardium along with a detailed biophysical model of active tension generation in the ventricular muscle. These constitutive models are employed within a dynamic simulation framework that accounts for the inertia of the ventricular muscle and the blood that is based on an immersed boundary (IB) method with a finite element description of the structural mechanics. The geometry of the models is based on data obtained non-invasively by cardiac magnetic resonance (CMR). CMR imaging data are also used to estimate the parameters of the passive and active constitutive models, which are determined so that the simulated end-diastolic and end-systolic volumes agree with the corresponding volumes determined from the CMR imaging studies. Using these models, we simulate LV dynamics from end-diastole to end-systole. The results of our simulations are shown to be in good agreement with subject-specific CMR-derived strain measurements and also with earlier clinical studies on human LV strain distributions

Motion tracking tMRI datasets to quantify abnormal left ventricle motion using finite element modelling

According to `The Atlas of Heart Disease and Stroke'[MMMG04] published by the World Health Organization, heart disease accounts for nearly half the deaths in both the developed and developing countries and is the world's single biggest killer. However, early detection of a diseased heart condition can prevent many of these fatalities. Regional wall motion abnormalities of the heart precede both ECG abnormalities and chest pain as an indicator of myocardial ischaemia and are an excellent indicator of coronary stenosis [GZM97]. These motion abnormalities of the heart muscle are difficult to observe and track, because the heart is a relatively smooth organ with few landmarks and non-rigid motion with a twisting motion or tangential component. The MRI tissue-tagging technique gives researchers the first glimpse into how the heart actually beats. This research uses the tagged MRI images of the heart to create a three dimensional model of a beating heart indicating the stress of a region. Tagged MRI techniques are still developing and vary vastly, meaning that there needs to be a methodology that can adapt to these changes rapidly and effectively, to meet the needs of the evolving technology. The focus of this research is to develop and test such a methodology by the means of a Strain Estimation Pipeline along with an effective way of validating any changes made to the individual processes that it comprises of

Segmentation of Patient-Specific 3D Cardiac Magnetic Resonance Images of Human Right Ventricle

Right Ventricular (RV) dysfunction is a common cause of heart failure in patients with congenital heart defects and often leads to impaired functional capacity and premature death. 3D cardiac magnetic resonance imaging (CMR)-based RV/LV combination models with fluid-structure interactions have been introduced to perform mechanical analysis and optimize RV remodeling surgery. Obtaining accurate RV/LV morphology is a very important step in the model-constructing process. A semi-automatic segmentation process was introduced in this project to obtain RV/LV/Valve geometry from patient-specific 3D CMR images. A total of 420 contour results were obtained from one patient CMRI data using QMASS software package at Department of Cardiology of Children¡¯s hospital. The digital contour data were automatically acquired using a self-developed program written in MATLAB. 3D visualizations of the RV/LV combination model at different phases throughout the cardiac cycle were presented and RV/LV volume curves were given showing the volume variation based on digital contour data under MATLAB environment. For the patient considered, the RV stoke volume (SV) is 190.8 ml (normal value is 60-136 ml) and ejection fraction is 43.5% (normal value is 47%-63%). In future work, the surgical, CMR imaging and computational modeling will be integrated together to optimize patch design and RV volume reduction surgery procedures to maximize recovery of RV cardiac function

An image segmentation and registration approach to cardiac function analysis using MRI

Cardiovascular diseases (CVDs) are one of the major causes of death in the world. In recent years, significant progress has been made in the care and treatment of patients with such diseases. A crucial factor for this progress has been the development of magnetic resonance (MR) imaging which makes it possible to diagnose and assess the cardiovascular function of the patient. The ability to obtain high-resolution, cine volume images easily and safely has made it the preferred method for diagnosis of CVDs. MRI is also unique in its ability to introduce noninvasive markers directly into the tissue being imaged(MR tagging) during the image acquisition process. With the development of advanced MR imaging acquisition technologies, 3D MR imaging is more and more clinically feasible. This recent development has allowed new potentially 3D image analysis technologies to be deployed. However, quantitative analysis of cardiovascular system from the images remains a challenging topic. The work presented in this thesis describes the development of segmentation and motion analysis techniques for the study of the cardiac anatomy and function in cardiac magnetic resonance (CMR) images. The first main contribution of the thesis is the development of a fully automatic cardiac segmentation technique that integrates and combines a series of state-of-the-art techniques. The proposed segmentation technique is capable of generating an accurate 3D segmentation from multiple image sequences. The proposed segmentation technique is robust even in the presence of pathological changes, large anatomical shape variations and locally varying contrast in the images. Another main contribution of this thesis is the development of motion tracking techniques that can integrate motion information from different sources. For example, the radial motion of the myocardium can be tracked easily in untagged MR imaging since the epi- and endocardial surfaces are clearly visible. On the other hand, tagged MR imaging allows easy tracking of both longitudinal and circumferential motion. We propose a novel technique based on non-rigid image registration for the myocardial motion estimation using both untagged and 3D tagged MR images. The novel aspect of our technique is its simultaneous use of complementary information from both untagged and 3D tagged MR imaging. The similarity measure is spatially weighted to maximise the utility of information from both images. The thesis also proposes a sparse representation for free-form deformations (FFDs) using the principles of compressed sensing. The sparse free-form deformation (SFFD) model can capture fine local details such as motion discontinuities without sacrificing robustness. We demonstrate the capabilities of the proposed framework to accurately estimate smooth as well as discontinuous deformations in 2D and 3D CMR image sequences. Compared to the standard FFD approach, a significant increase in registration accuracy can be observed in datasets with discontinuous motion patterns. Both the segmentation and motion tracking techniques presented in this thesis have been applied to clinical studies. We focus on two important clinical applications that can be addressed by the techniques proposed in this thesis. The first clinical application aims at measuring longitudinal changes in cardiac morphology and function during the cardiac remodelling process. The second clinical application aims at selecting patients that positively respond to cardiac resynchronization therapy (CRT). The final chapter of this thesis summarises the main conclusions that can be drawn from the work presented here and also discusses possible avenues for future research

A non-rigid registration approach for quantifying myocardial contraction in tagged MRI using generalized information measures.

International audienceWe address the problem of quantitatively assessing myocardial function from tagged MRI sequences. We develop a two-step method comprising (i) a motion estimation step using a novel variational non-rigid registration technique based on generalized information measures, and (ii) a measurement step, yielding local and segmental deformation parameters over the whole myocardium. Experiments on healthy and pathological data demonstrate that this method delivers, within a reasonable computation time and in a fully unsupervised way, reliable measurements for normal subjects and quantitative pathology-specific information. Beyond cardiac MRI, this work redefines the foundations of variational non-rigid registration for information-theoretic similarity criteria with potential interest in multimodal medical imaging