Meshless deformable models for LV motion analysis

We propose a novel meshless deformable model for in vivo cardiac left ventricle (LV) 3D motion estimation. As a relatively new technology, tagged MRI (tMRI) provides a direct and noninvasive way to reveal local deformation of the myocardium, which creates a large amount of heart motion data which requiring quantitative analysis. In our study, we sample the heart motion sparsely at intersections of three sets of orthogonal tagging planes and then use a new meshless deformable model to recover the dense 3D motion of the myocardium temporally during the cardiac cycle. We compute external forces at tag intersections based on tracked local motion and redistribute the force to meshless particles throughout the myocardium. Internal constraint forces at particles are derived from local strain energy using a Moving Least Squares (MLS) method. The dense 3D motion field is then computed and updated using the Lagrange equation. The new model avoids the singularity problem of mesh-based models and is capable of tracking large deformation with high efficiency and accuracy. In particular, the model performs well even when the control points (tag intersections) are relatively sparse. We tested the performance of the meshless model on a numerical phantom, as well as in vivo heart data of healthy subjects and patients. The experimental results show that the meshless deformable model can fully recover the myocardium motion in 3D. 1

Non-rigid registration of 2-D/3-D dynamic data with feature alignment

In this work, we are computing the matching between 2D manifolds and 3D manifolds with temporal constraints, that is we are computing the matching among a time sequence of 2D/3D manifolds. It is solved by mapping all the manifolds to a common domain, then build their matching by composing the forward mapping and the inverse mapping. At first, we solve the matching problem between 2D manifolds with temporal constraints by using mesh-based registration method. We propose a surface parameterization method to compute the mapping between the 2D manifold and the common 2D planar domain. We can compute the matching among the time sequence of deforming geometry data through this common domain. Compared with previous work, our method is independent of the quality of mesh elements and more efficient for the time sequence data. Then we develop a global intensity-based registration method to solve the matching problem between 3D manifolds with temporal constraints. Our method is based on a 4D(3D+T) free-from B-spline deformation model which has both spatial and temporal smoothness. Compared with previous 4D image registration techniques, our method avoids some local minimum. Thus it can be solved faster and achieve better accuracy of landmark point predication. We demonstrate the efficiency of these works on the real applications. The first one is applied to the dynamic face registering and texture mapping. The second one is applied to lung tumor motion tracking in the medical image analysis. In our future work, we are developing more efficient mesh-based 4D registration method. It can be applied to tumor motion estimation and tracking, which can be used to calculate the read dose delivered to the lung and surrounding tissues. Thus this can support the online treatment of lung cancer radiotherapy

Efficient Physics-Based Tracking of Heart Surface Motion for Beating Heart Surgery Robotic Systems

Purpose: Tracking of beating heart motion in a robotic surgery system is required for complex cardiovascular interventions. Methods: A heart surface motion tracking method is developed, including a stochastic physics-based heart surface model and an efficient reconstruction algorithm. The algorithm uses the constraints provided by the model that exploits the physical characteristics of the heart. The main advantage of the model is that it is more realistic than most standard heartmodels. Additionally, no explicit matching between the measurements and the model is required. The application of meshless methods significantly reduces the complexity of physics-based tracking. Results: Based on the stochastic physical model of the heart surface, this approach considers the motion of the intervention area and is robust to occlusions and reflections. The tracking algorithm is evaluated in simulations and experiments on an artificial heart. Providing higher accuracy than the standardmodel-based methods, it successfully copes with occlusions and provides high performance even when all measurements are not available. Conclusions: Combining the physical and stochastic description of the heart surface motion ensures physically correct and accurate prediction. Automatic initialization of the physics-based cardiac motion tracking enables system evaluation in a clinical environment

Physics-Based Probabilistic Motion Compensation of Elastically Deformable Objects

A predictive tracking approach and a novel method for visual motion compensation are introduced, which accurately reconstruct and compensate the deformation of the elastic object, even in the case of complete measurement information loss. The core of the methods involves a probabilistic physical model of the object, from which all other mathematical models are systematically derived. Due to flexible adaptation of the models, the balance between their complexity and their accuracy is achieved

Meshfree and Particle Methods in Biomechanics: Prospects and Challenges

The use of meshfree and particle methods in the field of bioengineering and biomechanics has significantly increased. This may be attributed to their unique abilities to overcome most of the inherent limitations of mesh-based methods in dealing with problems involving large deformation and complex geometry that are common in bioengineering and computational biomechanics in particular. This review article is intended to identify, highlight and summarize research works on topics that are of substantial interest in the field of computational biomechanics in which meshfree or particle methods have been employed for analysis, simulation or/and modeling of biological systems such as soft matters, cells, biological soft and hard tissues and organs. We also anticipate that this review will serve as a useful resource and guide to researchers who intend to extend their work into these research areas. This review article includes 333 references

An image segmentation and registration approach to cardiac function analysis using MRI

Cardiovascular diseases (CVDs) are one of the major causes of death in the world. In recent years, significant progress has been made in the care and treatment of patients with such diseases. A crucial factor for this progress has been the development of magnetic resonance (MR) imaging which makes it possible to diagnose and assess the cardiovascular function of the patient. The ability to obtain high-resolution, cine volume images easily and safely has made it the preferred method for diagnosis of CVDs. MRI is also unique in its ability to introduce noninvasive markers directly into the tissue being imaged(MR tagging) during the image acquisition process. With the development of advanced MR imaging acquisition technologies, 3D MR imaging is more and more clinically feasible. This recent development has allowed new potentially 3D image analysis technologies to be deployed. However, quantitative analysis of cardiovascular system from the images remains a challenging topic. The work presented in this thesis describes the development of segmentation and motion analysis techniques for the study of the cardiac anatomy and function in cardiac magnetic resonance (CMR) images. The first main contribution of the thesis is the development of a fully automatic cardiac segmentation technique that integrates and combines a series of state-of-the-art techniques. The proposed segmentation technique is capable of generating an accurate 3D segmentation from multiple image sequences. The proposed segmentation technique is robust even in the presence of pathological changes, large anatomical shape variations and locally varying contrast in the images. Another main contribution of this thesis is the development of motion tracking techniques that can integrate motion information from different sources. For example, the radial motion of the myocardium can be tracked easily in untagged MR imaging since the epi- and endocardial surfaces are clearly visible. On the other hand, tagged MR imaging allows easy tracking of both longitudinal and circumferential motion. We propose a novel technique based on non-rigid image registration for the myocardial motion estimation using both untagged and 3D tagged MR images. The novel aspect of our technique is its simultaneous use of complementary information from both untagged and 3D tagged MR imaging. The similarity measure is spatially weighted to maximise the utility of information from both images. The thesis also proposes a sparse representation for free-form deformations (FFDs) using the principles of compressed sensing. The sparse free-form deformation (SFFD) model can capture fine local details such as motion discontinuities without sacrificing robustness. We demonstrate the capabilities of the proposed framework to accurately estimate smooth as well as discontinuous deformations in 2D and 3D CMR image sequences. Compared to the standard FFD approach, a significant increase in registration accuracy can be observed in datasets with discontinuous motion patterns. Both the segmentation and motion tracking techniques presented in this thesis have been applied to clinical studies. We focus on two important clinical applications that can be addressed by the techniques proposed in this thesis. The first clinical application aims at measuring longitudinal changes in cardiac morphology and function during the cardiac remodelling process. The second clinical application aims at selecting patients that positively respond to cardiac resynchronization therapy (CRT). The final chapter of this thesis summarises the main conclusions that can be drawn from the work presented here and also discusses possible avenues for future research

Heterogeneous volumetric data mapping and its medical applications

With the advance of data acquisition techniques, massive solid geometries are being collected routinely in scientific tasks, these complex and unstructured data need to be effectively correlated for various processing and analysis. Volumetric mapping solves bijective low-distortion correspondence between/among 3D geometric data, and can serve as an important preprocessing step in many tasks in compute-aided design and analysis, industrial manufacturing, medical image analysis, to name a few. This dissertation studied two important volumetric mapping problems: the mapping of heterogeneous volumes (with nonuniform inner structures/layers) and the mapping of sequential dynamic volumes. To effectively handle heterogeneous volumes, first, we studied the feature-aligned harmonic volumetric mapping. Compared to previous harmonic mapping, it supports the point, curve, and iso-surface alignment, which are important low-dimensional structures in heterogeneous volumetric data. Second, we proposed a biharmonic model for volumetric mapping. Unlike the conventional harmonic volumetric mapping that only supports positional continuity on the boundary, this new model allows us to have higher order continuity $C^1$ along the boundary surface. This suggests a potential model to solve the volumetric mapping of complex and big geometries through divide-and-conquer. We also studied the medical applications of our volumetric mapping in lung tumor respiratory motion modeling. We were building an effective digital platform for lung tumor radiotherapy based on effective volumetric CT/MRI image matching and analysis. We developed and integrated in this platform a set of geometric/image processing techniques including advanced image segmentation, finite element meshing, volumetric registration and interpolation. The lung organ/tumor and surrounding tissues are treated as a heterogeneous region and a dynamic 4D registration framework is developed for lung tumor motion modeling and tracking. Compared to the previous 3D pairwise registration, our new 4D parameterization model leads to a significantly improved registration accuracy. The constructed deforming model can hence approximate the deformation of the tissues and tumor

Physical Constraint Finite Element Model for Medical Image Registration

Due to being derived from linear assumption, most elastic body based non-rigid image registration algorithms are facing challenges for soft tissues with complex nonlinear behavior and with large deformations. To take into account the geometric nonlinearity of soft tissues, we propose a registration algorithm on the basis of Newtonian differential equation. The material behavior of soft tissues is modeled as St. Venant-Kirchhoff elasticity, and the nonlinearity of the continuum represents the quadratic term of the deformation gradient under the Green- St.Venant strain. In our algorithm, the elastic force is formulated as the derivative of the deformation energy with respect to the nodal displacement vectors of the finite element; the external force is determined by the registration similarity gradient flow which drives the floating image deforming to the equilibrium condition. We compared our approach to three other models: 1) the conventional linear elastic finite element model (FEM); 2) the dynamic elastic FEM; 3) the robust block matching (RBM) method. The registration accuracy was measured using three similarities: MSD (Mean Square Difference), NC (Normalized Correlation) and NMI (Normalized Mutual Information), and was also measured using the mean and max distance between the ground seeds and corresponding ones after registration. We validated our method on 60 image pairs including 30 medical image pairs with artificial deformation and 30 clinical image pairs for both the chest chemotherapy treatment in different periods and brain MRI normalization. Our method achieved a distance error of 0.320±0.138 mm in x direction and 0.326±0.111 mm in y direction, MSD of 41.96±13.74, NC of 0.9958±0.0019, NMI of 1.2962±0.0114 for images with large artificial deformations; and average NC of 0.9622±0.008 and NMI of 1.2764±0.0089 for the real clinical cases. Student's t-test demonstrated that our model statistically outperformed the other methods in comparison (p-values <0.05)

MR imaging of left-ventricular function : novel image acquisition and analysis techniques.

Many cardiac diseases, such as myocardial ischemia, secondary to coronary artery disease, may be identified and localized through the analysis of cardiac deformations. Early efforts for quantifying ventricular wall motion used surgical implantation and tracking of radiopaque markers with X-ray imaging in canine hearts [1]. Such techniques are invasive and affect the regional motion pattern of the ventricular wall during the marker tracking process and, clearly are not feasible clinically. Noninvasive imaging techniques are vital and have been widely applied to the clinic. MRI is a noninvasive imaging technique with the capability to monitor and assess the progression of cardiovascular diseases (CVD) so that effective procedures for the care and treatment of patients can be developed by physicians and researchers. It is capable of providing 3D analysis of global and regional cardiac function with great accuracy and reproducibility. In the past few years, numerous efforts have been devoted to cardiac motion recovery and deformation analysis from MR imaging sequences. In order to assess cardiac function, there are two categories of indices that are used: global and regional indices. Global indices include ejection fraction, cavity volume, and myocardial mass [2]. They are important indices for cardiac disease diagnosis. However, these global indices are not specific for regional analysis. A quantitative assessment of regional parameters may prove beneficial for the diagnosis of disease and evaluation of severity and the quantification of treatment [3]. Local measures, such as wall deformation and strain in all regions of the heart, can provide objective regional quantification of ventricular wall function and relate to the location and extent of ischemic injury. This dissertation is concerned with the development of novel MR imaging techniques and image postprocessing algorithms to analyze left ventricular deformations. A novel pulse sequence, termed Orthogonal CSPAMM (OCSPAMM), has been proposed which results in the same acquisition time as SPAMM for 2D deformation estimation while keeping the main advantages of CSPAMM [4,5]: i.e., maintaining tag contrast through-out the ECG cycle. Different from CSPAMM, in OCSPAMM the second tagging pulse orientation is rotated 90 degrees relative to the first one so that motion information can be obtained simultaneously in two directions. This reduces the acquisition time by a factor of two as compared to the traditional CSPAMM, in which two separate imaging sequences are applied per acquisition. With the application of OCSPAMM, the effect of tag fading encountered in SPAMM tagging due to Tl relaxation is mitigated and tag deformations can be visualized for the entire cardiac cycle, including diastolic phases. A multilevel B-spline fitting method (MBS) has been proposed which incorporates phase-based displacement information for accurate calculation of 2D motion and strain from tagged MRI [6, 7]. The proposed method combines the advantages of continuity and smoothness of MBS, and makes use of phase information derived from tagged MR images. Compared to previous 2D B-spline-based deformation analysis methods, MBS has the following advantages: 1) It can simultaneously achieve a smooth deformation while accurately approximating the given data set; 2) Computationally, it is very fast; and 3) It can produce more accurate deformation results. Since the tag intersections (intersections between two tag lines) can be extracted accurately and are more or less distributed evenly over the myocardium, MBS has proven effective for 2D cardiac motion tracking. To derive phase-based displacements, 2D HARP and SinMod analysis techniques [8,9] were employed. By producing virtual tags from HARP /SinMod and calculating intersections of virtual tag lines, more data points are obtained. In the reference frame, virtual tag lines are the isoparametric curves of an undeformed 2D B-spline model. In subsequent frames, the locations of intersections of virtual tag lines over the myocardium are updated with phase-based displacement. The advantage of the technique is that in acquiring denser myocardial displacements, it uses both real and virtual tag line intersections. It is fast and more accurate than 2D HARP and SinMod tracking. A novel 3D sine wave modeling (3D SinMod) approach for automatic analysis of 3D cardiac deformations has been proposed [10]. An accelerated 3D complementary spatial modulation of magnetization (CSPAMM) tagging technique [11] was used to acquire complete 3D+t tagged MR data sets of the whole heart (3 dynamic CSPAMM tagged MRI volume with tags in different orientations), in-vivo, in 54 heart beats and within 3 breath-holds. In 3D SinMod, the intensity distribution around each pixel is modeled as a cosine wave front. The principle behind 3D SinMod tracking is that both phase and frequency for each voxel are determined directly from the frequency analysis and the displacement is calculated from the quotient of phase difference and local frequency. The deformation fields clearly demonstrate longitudinal shortening during systole. The contraction of the LV base towards the apex as well as the torsional motion between basal and apical slices is clearly observable from the displacements. 3D SinMod can automatically process the image data to derive measures of motion, deformations, and strains between consecutive pair of tagged volumes in 17 seconds. Therefore, comprehensive 4D imaging and postprocessing for determination of ventricular function is now possible in under 10 minutes. For validation of 3D SinMod, 7 3D+t CSPAMM data sets of healthy subjects have been processed. Comparison of mid-wall contour deformations and circumferential shortening results by 3D SinMod showed good agreement with those by 3D HARP. Tag lines tracked by the proposed technique were also compared with manually delineated ones. The average errors calculated for the systolic phase of the cardiac cycles were in the sub-pixel range