Analysis of cardiac motion using MRI and nonrigid image registration

Imperial Users onl

Biomechanics-informed Neural Networks for Myocardial Motion Tracking in MRI

Image registration is an ill-posed inverse problem which often requires regularisation on the solution space. In contrast to most of the current approaches which impose explicit regularisation terms such as smoothness, in this paper we propose a novel method that can implicitly learn biomechanics-informed regularisation. Such an approach can incorporate application-specific prior knowledge into deep learning based registration. Particularly, the proposed biomechanics-informed regularisation leverages a variational autoencoder (VAE) to learn a manifold for biomechanically plausible deformations and to implicitly capture their underlying properties via reconstructing biomechanical simulations. The learnt VAE regulariser then can be coupled with any deep learning based registration network to regularise the solution space to be biomechanically plausible. The proposed method is validated in the context of myocardial motion tracking on 2D stacks of cardiac MRI data from two different datasets. The results show that it can achieve better performance against other competing methods in terms of motion tracking accuracy and has the ability to learn biomechanical properties such as incompressibility and strains. The method has also been shown to have better generalisability to unseen domains compared with commonly used L2 regularisation schemes.Comment: The paper is early accepted by MICCAI 202

An image segmentation and registration approach to cardiac function analysis using MRI

Cardiovascular diseases (CVDs) are one of the major causes of death in the world. In recent years, significant progress has been made in the care and treatment of patients with such diseases. A crucial factor for this progress has been the development of magnetic resonance (MR) imaging which makes it possible to diagnose and assess the cardiovascular function of the patient. The ability to obtain high-resolution, cine volume images easily and safely has made it the preferred method for diagnosis of CVDs. MRI is also unique in its ability to introduce noninvasive markers directly into the tissue being imaged(MR tagging) during the image acquisition process. With the development of advanced MR imaging acquisition technologies, 3D MR imaging is more and more clinically feasible. This recent development has allowed new potentially 3D image analysis technologies to be deployed. However, quantitative analysis of cardiovascular system from the images remains a challenging topic. The work presented in this thesis describes the development of segmentation and motion analysis techniques for the study of the cardiac anatomy and function in cardiac magnetic resonance (CMR) images. The first main contribution of the thesis is the development of a fully automatic cardiac segmentation technique that integrates and combines a series of state-of-the-art techniques. The proposed segmentation technique is capable of generating an accurate 3D segmentation from multiple image sequences. The proposed segmentation technique is robust even in the presence of pathological changes, large anatomical shape variations and locally varying contrast in the images. Another main contribution of this thesis is the development of motion tracking techniques that can integrate motion information from different sources. For example, the radial motion of the myocardium can be tracked easily in untagged MR imaging since the epi- and endocardial surfaces are clearly visible. On the other hand, tagged MR imaging allows easy tracking of both longitudinal and circumferential motion. We propose a novel technique based on non-rigid image registration for the myocardial motion estimation using both untagged and 3D tagged MR images. The novel aspect of our technique is its simultaneous use of complementary information from both untagged and 3D tagged MR imaging. The similarity measure is spatially weighted to maximise the utility of information from both images. The thesis also proposes a sparse representation for free-form deformations (FFDs) using the principles of compressed sensing. The sparse free-form deformation (SFFD) model can capture fine local details such as motion discontinuities without sacrificing robustness. We demonstrate the capabilities of the proposed framework to accurately estimate smooth as well as discontinuous deformations in 2D and 3D CMR image sequences. Compared to the standard FFD approach, a significant increase in registration accuracy can be observed in datasets with discontinuous motion patterns. Both the segmentation and motion tracking techniques presented in this thesis have been applied to clinical studies. We focus on two important clinical applications that can be addressed by the techniques proposed in this thesis. The first clinical application aims at measuring longitudinal changes in cardiac morphology and function during the cardiac remodelling process. The second clinical application aims at selecting patients that positively respond to cardiac resynchronization therapy (CRT). The final chapter of this thesis summarises the main conclusions that can be drawn from the work presented here and also discusses possible avenues for future research

MR imaging of left-ventricular function : novel image acquisition and analysis techniques.

Many cardiac diseases, such as myocardial ischemia, secondary to coronary artery disease, may be identified and localized through the analysis of cardiac deformations. Early efforts for quantifying ventricular wall motion used surgical implantation and tracking of radiopaque markers with X-ray imaging in canine hearts [1]. Such techniques are invasive and affect the regional motion pattern of the ventricular wall during the marker tracking process and, clearly are not feasible clinically. Noninvasive imaging techniques are vital and have been widely applied to the clinic. MRI is a noninvasive imaging technique with the capability to monitor and assess the progression of cardiovascular diseases (CVD) so that effective procedures for the care and treatment of patients can be developed by physicians and researchers. It is capable of providing 3D analysis of global and regional cardiac function with great accuracy and reproducibility. In the past few years, numerous efforts have been devoted to cardiac motion recovery and deformation analysis from MR imaging sequences. In order to assess cardiac function, there are two categories of indices that are used: global and regional indices. Global indices include ejection fraction, cavity volume, and myocardial mass [2]. They are important indices for cardiac disease diagnosis. However, these global indices are not specific for regional analysis. A quantitative assessment of regional parameters may prove beneficial for the diagnosis of disease and evaluation of severity and the quantification of treatment [3]. Local measures, such as wall deformation and strain in all regions of the heart, can provide objective regional quantification of ventricular wall function and relate to the location and extent of ischemic injury. This dissertation is concerned with the development of novel MR imaging techniques and image postprocessing algorithms to analyze left ventricular deformations. A novel pulse sequence, termed Orthogonal CSPAMM (OCSPAMM), has been proposed which results in the same acquisition time as SPAMM for 2D deformation estimation while keeping the main advantages of CSPAMM [4,5]: i.e., maintaining tag contrast through-out the ECG cycle. Different from CSPAMM, in OCSPAMM the second tagging pulse orientation is rotated 90 degrees relative to the first one so that motion information can be obtained simultaneously in two directions. This reduces the acquisition time by a factor of two as compared to the traditional CSPAMM, in which two separate imaging sequences are applied per acquisition. With the application of OCSPAMM, the effect of tag fading encountered in SPAMM tagging due to Tl relaxation is mitigated and tag deformations can be visualized for the entire cardiac cycle, including diastolic phases. A multilevel B-spline fitting method (MBS) has been proposed which incorporates phase-based displacement information for accurate calculation of 2D motion and strain from tagged MRI [6, 7]. The proposed method combines the advantages of continuity and smoothness of MBS, and makes use of phase information derived from tagged MR images. Compared to previous 2D B-spline-based deformation analysis methods, MBS has the following advantages: 1) It can simultaneously achieve a smooth deformation while accurately approximating the given data set; 2) Computationally, it is very fast; and 3) It can produce more accurate deformation results. Since the tag intersections (intersections between two tag lines) can be extracted accurately and are more or less distributed evenly over the myocardium, MBS has proven effective for 2D cardiac motion tracking. To derive phase-based displacements, 2D HARP and SinMod analysis techniques [8,9] were employed. By producing virtual tags from HARP /SinMod and calculating intersections of virtual tag lines, more data points are obtained. In the reference frame, virtual tag lines are the isoparametric curves of an undeformed 2D B-spline model. In subsequent frames, the locations of intersections of virtual tag lines over the myocardium are updated with phase-based displacement. The advantage of the technique is that in acquiring denser myocardial displacements, it uses both real and virtual tag line intersections. It is fast and more accurate than 2D HARP and SinMod tracking. A novel 3D sine wave modeling (3D SinMod) approach for automatic analysis of 3D cardiac deformations has been proposed [10]. An accelerated 3D complementary spatial modulation of magnetization (CSPAMM) tagging technique [11] was used to acquire complete 3D+t tagged MR data sets of the whole heart (3 dynamic CSPAMM tagged MRI volume with tags in different orientations), in-vivo, in 54 heart beats and within 3 breath-holds. In 3D SinMod, the intensity distribution around each pixel is modeled as a cosine wave front. The principle behind 3D SinMod tracking is that both phase and frequency for each voxel are determined directly from the frequency analysis and the displacement is calculated from the quotient of phase difference and local frequency. The deformation fields clearly demonstrate longitudinal shortening during systole. The contraction of the LV base towards the apex as well as the torsional motion between basal and apical slices is clearly observable from the displacements. 3D SinMod can automatically process the image data to derive measures of motion, deformations, and strains between consecutive pair of tagged volumes in 17 seconds. Therefore, comprehensive 4D imaging and postprocessing for determination of ventricular function is now possible in under 10 minutes. For validation of 3D SinMod, 7 3D+t CSPAMM data sets of healthy subjects have been processed. Comparison of mid-wall contour deformations and circumferential shortening results by 3D SinMod showed good agreement with those by 3D HARP. Tag lines tracked by the proposed technique were also compared with manually delineated ones. The average errors calculated for the systolic phase of the cardiac cycles were in the sub-pixel range

Fully automatic left ventricular myocardial strain estimation in 2D short-axis tagged magnetic resonance imaging

Cardiovascular diseases are among the leading causes of death and frequently result in local myocardial dysfunction. Among the numerous imaging modalities available to detect these dysfunctional regions, cardiac deformation imaging through tagged magnetic resonance imaging (t-MRI) has been an attractive approach. Nevertheless, fully automatic analysis of these data sets is still challenging. In this work, we present a fully automatic framework to estimate left ventricular myocardial deformation from t-MRI. This strategy performs automatic myocardial segmentation based on B-spline explicit active surfaces, which are initialized using an annular model. A non-rigid image-registration technique is then used to assess myocardial deformation. Three experiments were set up to validate the proposed framework using a clinical database of 75 patients. First, automatic segmentation accuracy was evaluated by comparing against manual delineations at one specific cardiac phase. The proposed solution showed an average perpendicular distance error of 2.35 +/- 1.21 mm and 2.27 +/- 1.02 mm for the endo- and epicardium, respectively. Second, starting from either manual or automatic segmentation, myocardial tracking was performed and the resulting strain curves were compared. It is shown that the automatic segmentation adds negligible differences during the strain-estimation stage, corroborating its accuracy. Finally, segmental strain was compared with scar tissue extent determined by delay-enhanced MRI. The results proved that both strain components were able to distinguish between normal and infarct regions. Overall, the proposed framework was shown to be accurate, robust, and attractive for clinical practice, as it overcomes several limitations of a manual analysis.FCT—Fundacão para a Ciência e a Tecnologia, Portugal, and the European Social Found, European Union, for funding support through the Programa Operacional Capital Humano (POCH) in the scope of the PhD grants SFRH/BD/95438/2013 (P Morais) and SFRH/BD/93443/2013 (S Queirós). This work was supported by the projects NORTE-07-0124-FEDER-000017 and NORTE-01-0145-FEDER-000013, co-funded by Programa Operacional Regional do Norte, Quadro de Referência Estratégico Nacional, through Fundo Europeu de Desenvolvimento Regional (FEDER). The authors would also like to acknowledge the EU (FP7) framework program, for the financial support of the DOPPLER-CIP project (grant no. 223615)info:eu-repo/semantics/publishedVersio

MulViMotion: shape-aware 3D myocardial motion tracking from multi-view cardiac MRI

Recovering the 3D motion of the heart from cine cardiac magnetic resonance (CMR) imaging enables the assessment of regional myocardial function and is important for understanding and analyzing cardiovascular disease. However, 3D cardiac motion estimation is challenging because the acquired cine CMR images are usually 2D slices which limit the accurate estimation of through-plane motion. To address this problem, we propose a novel multi-view motion estimation network (MulViMotion), which integrates 2D cine CMR images acquired in short-axis and long-axis planes to learn a consistent 3D motion field of the heart. In the proposed method, a hybrid 2D/3D network is built to generate dense 3D motion fields by learning fused representations from multi-view images. To ensure that the motion estimation is consistent in 3D, a shape regularization module is introduced during training, where shape information from multi-view images is exploited to provide weak supervision to 3D motion estimation. We extensively evaluate the proposed method on 2D cine CMR images from 580 subjects of the UK Biobank study for 3D motion tracking of the left ventricular myocardium. Experimental results show that the proposed method quantitatively and qualitatively outperforms competing methods

Cardiac motion and deformation estimation in tagged magnetic resonance imaging

Dissertação de mestrado integrado em Engenharia Biomédica (área de especialização em Electrónica Médica)Cardiovascular diseases are the main cause of death in Europe, with an estimate of 4.3 million deaths each year. The assessment of the regional wall deformation is a relevant clinical indicator, and can be used to detect several cardiac lesions. Nowadays, this study can be performed using several image modalities. In the current thesis, we focus on tagged Magnetic Resonance imaging (t-MRI) technique. Such technique allows acquiring images with tags on the myocardium, which deform with the muscle. The present thesis intends to assess the left ventricle (LV) deformation using radial and circumferential strain. To compute such strain values, both endo- and epicardial contours of the LV are required. As such, a new framework to automatically assess the LV function is proposed. This framework presents: (i) an automatic segmentation technique, based on a tag suppression strategy followed by an active contour segmentation method, and (ii) a tracking approach to extract myocardial deformation, based on a non-rigid registration method. The automatic segmentation uses the B-spline Explicit Active Surface framework, which was previously applied in ultra-sound and cine-MRI images. In both cases, a real-time and accurate contour was achieved. Regarding the registration step, starting from a state-of-art approach, termed sequential 2D, we suggest a new method (termed sequential 2D+t), where the temporal information is included on the model. The tracking methods were first tested on synthetic data to study the registration parameters influence. Furthermore, the proposed and original methods were applied on porcine data with myocardial ischemia. Both methods were able to detect dysfunctional regions. A comparison between the strain curve in the sequential 2D and sequential 2D+t strategies was also shown. As conclusion, a smoothing effect in the strain curve was detected in the sequential 2D+t strategy. The validation of the segmentation approach uses a human dataset. A comparison between the manual contour and the proposed segmentation method results was performed. The results, suggest that proposed method has an acceptable performance, removing the tedious task related with manual segmentation and the intra-observer variability. Finally, a comparison between the proposed framework and the currently available commercial software was performed. The commercial software results were obtained from core-lab analysis. An acceptable result (r = 0.601) was achieved when comparing the strain peak values. Importantly, the proposed framework appears to present a more acceptable result.As doenças cardiovasculares são a principal causa de morte na Europa, com aproximadamente 4.7 milhões de mortes por ano. A avaliação da deformação do miocárdio a um nível local é um importante indicador clínico e pode ser usado para a deteção de lesões cardíacas. Este estudo é normalmente realizado usando várias modalidades de imagem médica. Nesta tese, a Resonância Magnética (RM) marcada foi a técnica selecionada. Estas imagens têm marcadores no músculo cardíaco, os quais se deformam com o miocárdio e podem ser usados para o estudo da deformação cardíaca. Nesta tese, pretende-se estudar a deformação radial e circunferencial do ventrículo esquerdo (VE). Assim, um contorno do endo- e epicárdio no VE é essencial. Desta forma, uma ferramenta para o estudo da deformação do VE foi desenvolvida. Esta possui: (i) um método de segmentação automático, usando uma estratégia de supressão dos marcadores, seguido de uma segmentação c um contorno ativo, e (ii) um método de tracking para determinação da deformação cardíaca, baseado em registo não rígido. A segmentação automática utiliza a ferramenta B-spline Explicit Active Surface, que foi previamente aplicada em imagens de ultrassons e cine-RM. Em ambos os casos, uma segmentação em tempo real e com elevada exatidão foi alcançada. Vários esquemas de registo foram apresentados. Neste ponto, começando com uma técnica do estado da arte (designada de sequencial 2D), uma nova metodologia foi proposta (sequencial 2D+t), onde a informação temporal é incorporada no modelo. De forma a analisar a influência dos parâmetros do registo, estes foram estudados num dataset sintético. De seguida, os diferentes esquemas de registo foram testados num dataset suíno com isquemia. Ambos os métodos foram capazes de detetar as regiões disfuncionais. De igual forma, utilizando as curvas de deformação obtidas para cada um dos métodos propostos, foi possível observar uma suavização na direção temporal para o método sequencial 2D+t. Relativamente à segmentação, esta foi validada com um dataset humano. Um contorno manual foi comparado com o obtido pelo método proposto. Os resultados sugerem que a nova estratégia é aceitável, sendo mais rápida do que a realização de um contorno manual e eliminando a variabilidade entre observadores. Por fim, realizou-se uma comparação entre a ferramenta proposta e um software comercial (com análise de core-lab). A comparação entre os valores de pico da deformação exibe uma correlação plausível (r=0.601). Contudo, é importante notar, que a nova ferramenta tende a apresentar um resultado mais aceitável

Atlas-based Quantification of Myocardial Motion Abnormalities: Added-value for the Understanding of CRT Outcome?

International audienceIn this paper, we present the use of atlas-based indexes of abnormality for the quantification of cardiac resynchronization therapy (CRT) outcome in terms of motion. We build an atlas of normal motion from 21 healthy volunteers to which we compare 88 CRT candidates before and after the therapy. Abnormal motion is quantified locally in time and space using a statistical distance to normality, and changes induced by the therapy are related with clinical measurements of CRT outcome. Results correlate with recent clinical hypothesis about CRT response, namely that the correction of specific mechanisms responsible for cardiac dyssynchrony conditions the response to the therapy