Analysis of cardiac motion using MRI and nonrigid image registration

Imperial Users onl

An image segmentation and registration approach to cardiac function analysis using MRI

Cardiovascular diseases (CVDs) are one of the major causes of death in the world. In recent years, significant progress has been made in the care and treatment of patients with such diseases. A crucial factor for this progress has been the development of magnetic resonance (MR) imaging which makes it possible to diagnose and assess the cardiovascular function of the patient. The ability to obtain high-resolution, cine volume images easily and safely has made it the preferred method for diagnosis of CVDs. MRI is also unique in its ability to introduce noninvasive markers directly into the tissue being imaged(MR tagging) during the image acquisition process. With the development of advanced MR imaging acquisition technologies, 3D MR imaging is more and more clinically feasible. This recent development has allowed new potentially 3D image analysis technologies to be deployed. However, quantitative analysis of cardiovascular system from the images remains a challenging topic. The work presented in this thesis describes the development of segmentation and motion analysis techniques for the study of the cardiac anatomy and function in cardiac magnetic resonance (CMR) images. The first main contribution of the thesis is the development of a fully automatic cardiac segmentation technique that integrates and combines a series of state-of-the-art techniques. The proposed segmentation technique is capable of generating an accurate 3D segmentation from multiple image sequences. The proposed segmentation technique is robust even in the presence of pathological changes, large anatomical shape variations and locally varying contrast in the images. Another main contribution of this thesis is the development of motion tracking techniques that can integrate motion information from different sources. For example, the radial motion of the myocardium can be tracked easily in untagged MR imaging since the epi- and endocardial surfaces are clearly visible. On the other hand, tagged MR imaging allows easy tracking of both longitudinal and circumferential motion. We propose a novel technique based on non-rigid image registration for the myocardial motion estimation using both untagged and 3D tagged MR images. The novel aspect of our technique is its simultaneous use of complementary information from both untagged and 3D tagged MR imaging. The similarity measure is spatially weighted to maximise the utility of information from both images. The thesis also proposes a sparse representation for free-form deformations (FFDs) using the principles of compressed sensing. The sparse free-form deformation (SFFD) model can capture fine local details such as motion discontinuities without sacrificing robustness. We demonstrate the capabilities of the proposed framework to accurately estimate smooth as well as discontinuous deformations in 2D and 3D CMR image sequences. Compared to the standard FFD approach, a significant increase in registration accuracy can be observed in datasets with discontinuous motion patterns. Both the segmentation and motion tracking techniques presented in this thesis have been applied to clinical studies. We focus on two important clinical applications that can be addressed by the techniques proposed in this thesis. The first clinical application aims at measuring longitudinal changes in cardiac morphology and function during the cardiac remodelling process. The second clinical application aims at selecting patients that positively respond to cardiac resynchronization therapy (CRT). The final chapter of this thesis summarises the main conclusions that can be drawn from the work presented here and also discusses possible avenues for future research

Hierarchical template matching for 3D myocardial tracking and cardiac strain estimation

Myocardial tracking and strain estimation can non-invasively assess cardiac functioning using subject-specific MRI. As the left-ventricle does not have a uniform shape and functioning from base to apex, the development of 3D MRI has provided opportunities for simultaneous 3D tracking, and 3D strain estimation. We have extended a Local Weighted Mean (LWM) transformation function for 3D, and incorporated in a Hierarchical Template Matching model to solve 3D myocardial tracking and strain estimation problem. The LWM does not need to solve a large system of equations, provides smooth displacement of myocardial points, and adapt local geometric differences in images. Hence, 3D myocardial tracking can be performed with 1.49 mm median error, and without large error outliers. The maximum error of tracking is up to 24% reduced compared to benchmark methods. Moreover, the estimated strain can be insightful to improve 3D imaging protocols, and the computer code of LWM could also be useful for geo-spatial and manufacturing image analysis researchers

MR imaging of left-ventricular function : novel image acquisition and analysis techniques.

Many cardiac diseases, such as myocardial ischemia, secondary to coronary artery disease, may be identified and localized through the analysis of cardiac deformations. Early efforts for quantifying ventricular wall motion used surgical implantation and tracking of radiopaque markers with X-ray imaging in canine hearts [1]. Such techniques are invasive and affect the regional motion pattern of the ventricular wall during the marker tracking process and, clearly are not feasible clinically. Noninvasive imaging techniques are vital and have been widely applied to the clinic. MRI is a noninvasive imaging technique with the capability to monitor and assess the progression of cardiovascular diseases (CVD) so that effective procedures for the care and treatment of patients can be developed by physicians and researchers. It is capable of providing 3D analysis of global and regional cardiac function with great accuracy and reproducibility. In the past few years, numerous efforts have been devoted to cardiac motion recovery and deformation analysis from MR imaging sequences. In order to assess cardiac function, there are two categories of indices that are used: global and regional indices. Global indices include ejection fraction, cavity volume, and myocardial mass [2]. They are important indices for cardiac disease diagnosis. However, these global indices are not specific for regional analysis. A quantitative assessment of regional parameters may prove beneficial for the diagnosis of disease and evaluation of severity and the quantification of treatment [3]. Local measures, such as wall deformation and strain in all regions of the heart, can provide objective regional quantification of ventricular wall function and relate to the location and extent of ischemic injury. This dissertation is concerned with the development of novel MR imaging techniques and image postprocessing algorithms to analyze left ventricular deformations. A novel pulse sequence, termed Orthogonal CSPAMM (OCSPAMM), has been proposed which results in the same acquisition time as SPAMM for 2D deformation estimation while keeping the main advantages of CSPAMM [4,5]: i.e., maintaining tag contrast through-out the ECG cycle. Different from CSPAMM, in OCSPAMM the second tagging pulse orientation is rotated 90 degrees relative to the first one so that motion information can be obtained simultaneously in two directions. This reduces the acquisition time by a factor of two as compared to the traditional CSPAMM, in which two separate imaging sequences are applied per acquisition. With the application of OCSPAMM, the effect of tag fading encountered in SPAMM tagging due to Tl relaxation is mitigated and tag deformations can be visualized for the entire cardiac cycle, including diastolic phases. A multilevel B-spline fitting method (MBS) has been proposed which incorporates phase-based displacement information for accurate calculation of 2D motion and strain from tagged MRI [6, 7]. The proposed method combines the advantages of continuity and smoothness of MBS, and makes use of phase information derived from tagged MR images. Compared to previous 2D B-spline-based deformation analysis methods, MBS has the following advantages: 1) It can simultaneously achieve a smooth deformation while accurately approximating the given data set; 2) Computationally, it is very fast; and 3) It can produce more accurate deformation results. Since the tag intersections (intersections between two tag lines) can be extracted accurately and are more or less distributed evenly over the myocardium, MBS has proven effective for 2D cardiac motion tracking. To derive phase-based displacements, 2D HARP and SinMod analysis techniques [8,9] were employed. By producing virtual tags from HARP /SinMod and calculating intersections of virtual tag lines, more data points are obtained. In the reference frame, virtual tag lines are the isoparametric curves of an undeformed 2D B-spline model. In subsequent frames, the locations of intersections of virtual tag lines over the myocardium are updated with phase-based displacement. The advantage of the technique is that in acquiring denser myocardial displacements, it uses both real and virtual tag line intersections. It is fast and more accurate than 2D HARP and SinMod tracking. A novel 3D sine wave modeling (3D SinMod) approach for automatic analysis of 3D cardiac deformations has been proposed [10]. An accelerated 3D complementary spatial modulation of magnetization (CSPAMM) tagging technique [11] was used to acquire complete 3D+t tagged MR data sets of the whole heart (3 dynamic CSPAMM tagged MRI volume with tags in different orientations), in-vivo, in 54 heart beats and within 3 breath-holds. In 3D SinMod, the intensity distribution around each pixel is modeled as a cosine wave front. The principle behind 3D SinMod tracking is that both phase and frequency for each voxel are determined directly from the frequency analysis and the displacement is calculated from the quotient of phase difference and local frequency. The deformation fields clearly demonstrate longitudinal shortening during systole. The contraction of the LV base towards the apex as well as the torsional motion between basal and apical slices is clearly observable from the displacements. 3D SinMod can automatically process the image data to derive measures of motion, deformations, and strains between consecutive pair of tagged volumes in 17 seconds. Therefore, comprehensive 4D imaging and postprocessing for determination of ventricular function is now possible in under 10 minutes. For validation of 3D SinMod, 7 3D+t CSPAMM data sets of healthy subjects have been processed. Comparison of mid-wall contour deformations and circumferential shortening results by 3D SinMod showed good agreement with those by 3D HARP. Tag lines tracked by the proposed technique were also compared with manually delineated ones. The average errors calculated for the systolic phase of the cardiac cycles were in the sub-pixel range

Multi-modality cardiac image computing: a survey

Multi-modality cardiac imaging plays a key role in the management of patients with cardiovascular diseases. It allows a combination of complementary anatomical, morphological and functional information, increases diagnosis accuracy, and improves the efficacy of cardiovascular interventions and clinical outcomes. Fully-automated processing and quantitative analysis of multi-modality cardiac images could have a direct impact on clinical research and evidence-based patient management. However, these require overcoming significant challenges including inter-modality misalignment and finding optimal methods to integrate information from different modalities. This paper aims to provide a comprehensive review of multi-modality imaging in cardiology, the computing methods, the validation strategies, the related clinical workflows and future perspectives. For the computing methodologies, we have a favored focus on the three tasks, i.e., registration, fusion and segmentation, which generally involve multi-modality imaging data, either combining information from different modalities or transferring information across modalities. The review highlights that multi-modality cardiac imaging data has the potential of wide applicability in the clinic, such as trans-aortic valve implantation guidance, myocardial viability assessment, and catheter ablation therapy and its patient selection. Nevertheless, many challenges remain unsolved, such as missing modality, modality selection, combination of imaging and non-imaging data, and uniform analysis and representation of different modalities. There is also work to do in defining how the well-developed techniques fit in clinical workflows and how much additional and relevant information they introduce. These problems are likely to continue to be an active field of research and the questions to be answered in the future

Estimation of passive and active properties in the human heart using 3D tagged MRI

International audienceAdvances in medical imaging and image processing are paving the way for personalised cardiac biomechani-cal modelling. Models provide the capacity to relate kinematics to dynamics and—through patient-specific modelling— derived material parameters to underlying cardiac muscle pathologies. However, for clinical utility to be achieved, model-based analyses mandate robust model selection and parameterisation. In this paper, we introduce a patient-specific biomechanical model for the left ventricle aiming to balance model fidelity with parameter identifiability. Using non-invasive data and common clinical surrogates, we illustrate unique identifiability of passive and active parameters over the full cardiac cycle. Identifiability and accuracy of the estimates in the presence of controlled noise are verified with a number of in silico datasets. Unique parametrisation is then obtained for three datasets acquired in vivo. The model predictions show good agreement with the data extracted from the images providing a pipeline for personalised biomechan-ical analysis

Dynamic Image Processing for Guidance of Off-pump Beating Heart Mitral Valve Repair

Compared to conventional open heart procedures, minimally invasive off-pump beating heart mitral valve repair aims to deliver equivalent treatment for mitral regurgitation with reduced trauma and side effects. However, minimally invasive approaches are often limited by the lack of a direct view to surgical targets and/or tools, a challenge that is compounded by potential movement of the target during the cardiac cycle. For this reason, sophisticated image guidance systems are required in achieving procedural efficiency and therapeutic success. The development of such guidance systems is associated with many challenges. For example, the system should be able to provide high quality visualization of both cardiac anatomy and motion, as well as augmenting it with virtual models of tracked tools and targets. It should have the capability of integrating pre-operative images to the intra-operative scenario through registration techniques. The computation speed must be sufficiently fast to capture the rapid cardiac motion. Meanwhile, the system should be cost effective and easily integrated into standard clinical workflow. This thesis develops image processing techniques to address these challenges, aiming to achieve a safe and efficient guidance system for off-pump beating heart mitral valve repair. These techniques can be divided into two categories, using 3D and 2D image data respectively. When 3D images are accessible, a rapid multi-modal registration approach is proposed to link the pre-operative CT images to the intra-operative ultrasound images. The ultrasound images are used to display the real time cardiac motion, enhanced by CT data serving as high quality 3D context with annotated features. I also developed a method to generate synthetic dynamic CT images, aiming to replace real dynamic CT data in such a guidance system to reduce the radiation dose applied to the patients. When only 2D images are available, an approach is developed to track the feature of interest, i.e. the mitral annulus, based on bi-plane ultrasound images and a magnetic tracking system. The concept of modern GPU-based parallel computing is employed in most of these approaches to accelerate the computation in order to capture the rapid cardiac motion with desired accuracy. Validation experiments were performed on phantom, animal and human data. The overall accuracy of registration and feature tracking with respect to the mitral annulus was about 2-3mm with computation time of 60-400ms per frame, sufficient for one update per cardiac cycle. It was also demonstrated in the results that the synthetic CT images can provide very similar anatomical representations and registration accuracy compared to that of the real dynamic CT images. These results suggest that the approaches developed in the thesis have good potential for a safer and more effective guidance system for off-pump beating heart mitral valve repair

Analysis of myocardial contractility with magnetic resonance

Heart failure has considerable morbidity and poor prognosis. An understanding of the underlying mechanics governing myocardial contraction is a prerequisite for interpreting and predicting changes induced by heart disease. Gross changes in contractile behaviour of the myocardium are readily detected with existing techniques. For more subtle changes during early stages of cardiac dysfunction, however, it requires a sensitive method for measuring, as well as a precise criterion for quantifying, normal and impaired myocardial function. Cardiovascular Magnetic Resonance (CMR) imaging is emerging as an important clinical tool because of its safety, versatility, and the high quality images it produces that allow accurate and reproducible quantification of cardiac structure and function. Traditional CMR approaches for measuring contractility rely on tagging of the myocardium with fiducial markers and require a lengthy and often subjective dependant post-processing procedure. The aim of this research is to develop a new technique, which uses velocity as a marker for the visualisation and assessment of myocardial contractility. Two parallel approaches have been investigated for the assessment of myocardial velocity. The first of these is haimonic phase (HARP) imaging. HARP imaging allows direct derivation of myocardial velocity and strain without the need of further user interaction. We investigated the effect of respiration on the accuracy of the derived contractility, and assessed the clinical applicability and potential pitfalls of the technique by analysing results from a group of patients with hypertrophic cardiomyopathy. The second technique we have investigated is the direct measurement of myocardial velocity with phase contrast myocardial velocity mapping. The imaging sequence used employs effective blood saturation for reducing flow induced phase errors within the myocardium. View sharing was used to improve the temporal resolution, which permitted acquisition of 3D velocity information throughout the cardiac cycle in a single breath-hold, enabling a comprehensive assessment of strain rate of the left ventricle. One key factor that affects the derivation of myocardial contractility based on myocardial velocity is the practical inconsistency of the velocity data. A novel iterative optimisation scheme by incorporating the incompressibility constraint was developed for the restoration of myocardial velocity data. The method allowed accurate assessment of both in-plane and through-plan strain rates, as demonstrated with both synthetic and in vivo data acquired from normal subjects and ischaemic patients. To further enhance the clinical potential of the technique and facilitate the visual assessment of contractile abnormality with myocardial velocity mapping, a complementary analysis framework, named Virtual Tagging, has been developed. The method used velocity data in all directions combined with a finite element mesh incorporating geometrical and physical constraints. The Virtual Tagging framewoik allowed velocity measurements to be used for calculating strain distribution within the 3D volume. It also permitted easy visualisation of the displacement of the tissue, akin to traditional CMR tagging. Detailed validation of the technique is provided, which involves both numerical simulation and in vitro phantom experiments. The main contribution of this thesis is in the improvement of the effectiveness and quality of quantitative myocardial contractility analysis from both sequence design and medical image computing perspectives. It is aimed at providing a sensitive means of detecting subtle as well as gross changes in contractile behaviour of the myocardium. The study is expected to provide a clinically viable platform for functional correlation with other functional measures such as myocardial perfusion and diffusion, and to serve as an aid for further understanding of the links between intrinsicOpen acces

Cardiac image computing for myocardial infarction patients

Cardiovascular diseases (CVDs), which are a prime cause of global mortality, are disorders that affect the heart and blood vessels' functioning. CVDs may cause consequent complications, due to occlusion in a blood vessel and present as impaired cardiac wall functioning (myocardium). Identifying such impairment (infarction) of the myocardium is of great clinical interest, as it can reveal the nature of altered cardiac topography (ventricular remodelling) to aid the associated intervention decisions. With recent advances in cardiac imaging, such as Magnetic Resonance (MR) imaging, the visualisation and identification of infarcted myocardium has been routinely and effectively used in clinical practice. Diagnosing infarcted myocardium is achieved clinically through the late gadolinium enhancement (LGE) test, which acquires MR images after injecting a gadolinium-based contrast agent (GBCA). Due to the increased accuracy and reproducibility, LGE has emerged as the gold-standard MR imaging test in identifying myocardial infarction. However, clinical studies have reported gadolinium deposition concerns in different body organs and adverse outcomes in patients with advanced kidney failure, over time. Such incidents have motivated researchers to look into the development of both accurate as well as safe diagnostic tools. Emerging research on identifying infarcted myocardium utilises myocardial strain to safely identify infarcted myocardium, which has been addressed in the presented study. For example, myocardial strain represents the shortening or lengthening of the myocardium. If the myocardium is infarcted, then the corresponding strain values differ compared to the healthy myocardium. This finding can be identified and utilised for clinical applications. The research presented in this thesis aims to identify infarcted myocardium accurately and safely by using myocardial strain (shortening or lengthening of the myocardium). To achieve the aforementioned aim, the research methodology is divided into six objectives. The initial objectives relate to the development of a novel myocardial tracking method. The middle objectives relate to the development of clinical application methods, and the final objectives concern the validation of the developed methods through clinical studies and associated datasets. The research presented in this thesis has addressed the following research question: Research question 1: How can a 2D myocardial tracking and strain calculation method be developed using the 2D local weighted mean function and structural deformation within the myocardium? Research question 2: How can a 3D myocardial tracking and strain calculation method be developed using the 3D local weighted mean function to calculate 3D myocardial strain? Research question 3: How can 2D circumferential strain of the myocardium be used in identifying infarcted left ventricular segments for the diagnosis of myocardial infarction patients? In literature, myocardial tracking and strain calculation methods have limited extension to 3D and dependency on tissue material properties. Moreover, additional limitations, such as limited inclusion of structural deformation details within the myocardium, are found in the literature. Therefore, methods are likely to become subjective or numerically unstable during computation. Moreover, the inclusion of myocardial details with grid-tagging MRI, for structural deformation within the myocardium, is more realistic compared to cine MRI.   The aforementioned limitations are overcome by proposing a novel Hierarchical Template Matching method, which performs non-rigid image registration among grid-tagging MR images of a cardiac cycle. This is achieved by employing a local weighted mean transformation function. The proposed non-rigid image registration method does not require the use of tissue material properties. Grid-tagging MRI is used to capture wall function within the myocardium, and the local weighted mean function is used for numerical stability. The performance of the developed methods is evaluated with multiple error measures and with a benchmark framework. This benchmark framework has provided an open-access 3D dataset, a set of validation methods, and results of four leading methods for comparison. Validation methods include qualitative and quantitative methods. The qualitative assessment of outcomes and verified ground truth for the quantitative evaluation of results are followed from the benchmark framework paper (Tobon-Gomez, Craene, Mcleod, et al., 2013). 2D HTM method has reported the root mean square error of point tracking in left ventricular slices, which are the basal slice 0.31±0.07 mm, the upper mid-ventricular slice 0.37±0.06 mm, the mid-ventricular slice 0.41±0.05 mm, and the apical slice 0.32±0.08 mm. The mid-ventricular slice has a significantly higher 4% (P=0.05) mean root mean square error compared to the other slices. However, the other slices do not have a significant difference among them. Compared to the benchmark free form deformation method, HTM has a mean error of 0.35±0.05 mm, which is 17% (P=0.07, CI:[-0.01,0.35]) reduced to the free form deformation method. Our technical method has shown the 3D extension of HTM and a method without using material properties, which is advantageous compared to the methods which are limited to 2D or dependent on material properties. Moreover, the 3D HTM has demonstrated the use of 3D local weighted mean function in 3D myocardial tracking. While comparing to the benchmark methods, it was found that the median tracking error of 3D HTM is comparable to benchmark methods and has very few outliers compared to them. The clinical results are validated with LGE imaging. The quantitative error measure is the area under the curve (AUC) of sensitivity vs 1-specificity curve of the receiver operating characteristic (ROC) test. The achieved AUC value in detecting infarcted segments in basal, mid-ventricular, and apical slices are 0.85, 0.82, and 0.87, respectively. Calculating AUC with 95% confidence level, the confidence intervals of lower and upper mean AUC values in basal, mid-ventricular and apical slices are [0.80, 0.89], [0.74, 0.85], and [0.78, 0.91], respectively. Overall, considering the detections of LGE imaging as the base, our method has an accuracy of AUC 0.73 (P=0.05) in identifying infarcted left ventricular segments. The developed methods have shown, systematically, a promising approach in identifying infarcted left ventricular segments by image processing method and without using GBCA-based LGE imaging.

When Cardiac Biophysics Meets Groupwise Statistics: Complementary Modelling Approaches for Patient-Specific Medicine

This habilitation manuscript contains research on biophysical and statistical modeling of the heart, as well as interactions between these two approaches