1,790 research outputs found
Learning the dynamics and time-recursive boundary detection of deformable objects
We propose a principled framework for recursively segmenting deformable objects across a sequence
of frames. We demonstrate the usefulness of this method on left ventricular segmentation across a cardiac
cycle. The approach involves a technique for learning the system dynamics together with methods of
particle-based smoothing as well as non-parametric belief propagation on a loopy graphical model capturing
the temporal periodicity of the heart. The dynamic system state is a low-dimensional representation
of the boundary, and the boundary estimation involves incorporating curve evolution into recursive state
estimation. By formulating the problem as one of state estimation, the segmentation at each particular
time is based not only on the data observed at that instant, but also on predictions based on past and future
boundary estimates. Although the paper focuses on left ventricle segmentation, the method generalizes
to temporally segmenting any deformable object
Computational Methods for Segmentation of Multi-Modal Multi-Dimensional Cardiac Images
Segmentation of the heart structures helps compute the cardiac contractile function quantified via the systolic and diastolic volumes, ejection fraction, and myocardial mass, representing a reliable diagnostic value. Similarly, quantification of the myocardial mechanics throughout the cardiac cycle, analysis of the activation patterns in the heart via electrocardiography (ECG) signals, serve as good cardiac diagnosis indicators. Furthermore, high quality anatomical models of the heart can be used in planning and guidance of minimally invasive interventions under the assistance of image guidance.
The most crucial step for the above mentioned applications is to segment the ventricles and myocardium from the acquired cardiac image data. Although the manual delineation of the heart structures is deemed as the gold-standard approach, it requires significant time and effort, and is highly susceptible to inter- and intra-observer variability. These limitations suggest a need for fast, robust, and accurate semi- or fully-automatic segmentation algorithms. However, the complex motion and anatomy of the heart, indistinct borders due to blood flow, the presence of trabeculations, intensity inhomogeneity, and various other imaging artifacts, makes the segmentation task challenging.
In this work, we present and evaluate segmentation algorithms for multi-modal, multi-dimensional cardiac image datasets. Firstly, we segment the left ventricle (LV) blood-pool from a tri-plane 2D+time trans-esophageal (TEE) ultrasound acquisition using local phase based filtering and graph-cut technique, propagate the segmentation throughout the cardiac cycle using non-rigid registration-based motion extraction, and reconstruct the 3D LV geometry. Secondly, we segment the LV blood-pool and myocardium from an open-source 4D cardiac cine Magnetic Resonance Imaging (MRI) dataset by incorporating average atlas based shape constraint into the graph-cut framework and iterative segmentation refinement. The developed fast and robust framework is further extended to perform right ventricle (RV) blood-pool segmentation from a different open-source 4D cardiac cine MRI dataset. Next, we employ convolutional neural network based multi-task learning framework to segment the myocardium and regress its area, simultaneously, and show that segmentation based computation of the myocardial area is significantly better than that regressed directly from the network, while also being more interpretable. Finally, we impose a weak shape constraint via multi-task learning framework in a fully convolutional network and show improved segmentation performance for LV, RV and myocardium across healthy and pathological cases, as well as, in the challenging apical and basal slices in two open-source 4D cardiac cine MRI datasets.
We demonstrate the accuracy and robustness of the proposed segmentation methods by comparing the obtained results against the provided gold-standard manual segmentations, as well as with other competing segmentation methods
Coronary Artery Segmentation and Motion Modelling
Conventional coronary artery bypass surgery requires invasive sternotomy and the
use of a cardiopulmonary bypass, which leads to long recovery period and has high
infectious potential. Totally endoscopic coronary artery bypass (TECAB) surgery
based on image guided robotic surgical approaches have been developed to allow the
clinicians to conduct the bypass surgery off-pump with only three pin holes incisions
in the chest cavity, through which two robotic arms and one stereo endoscopic camera
are inserted. However, the restricted field of view of the stereo endoscopic images leads
to possible vessel misidentification and coronary artery mis-localization. This results
in 20-30% conversion rates from TECAB surgery to the conventional approach.
We have constructed patient-specific 3D + time coronary artery and left ventricle
motion models from preoperative 4D Computed Tomography Angiography (CTA)
scans. Through temporally and spatially aligning this model with the intraoperative
endoscopic views of the patient's beating heart, this work assists the surgeon to identify
and locate the correct coronaries during the TECAB precedures. Thus this work has
the prospect of reducing the conversion rate from TECAB to conventional coronary
bypass procedures.
This thesis mainly focus on designing segmentation and motion tracking methods
of the coronary arteries in order to build pre-operative patient-specific motion models.
Various vessel centreline extraction and lumen segmentation algorithms are presented,
including intensity based approaches, geometric model matching method and
morphology-based method. A probabilistic atlas of the coronary arteries is formed
from a group of subjects to facilitate the vascular segmentation and registration procedures.
Non-rigid registration framework based on a free-form deformation model
and multi-level multi-channel large deformation diffeomorphic metric mapping are
proposed to track the coronary motion. The methods are applied to 4D CTA images
acquired from various groups of patients and quantitatively evaluated
An image segmentation and registration approach to cardiac function analysis using MRI
Cardiovascular diseases (CVDs) are one of the major causes of death in the world. In recent
years, significant progress has been made in the care and treatment of patients with such
diseases. A crucial factor for this progress has been the development of magnetic resonance
(MR) imaging which makes it possible to diagnose and assess the cardiovascular function
of the patient. The ability to obtain high-resolution, cine volume images easily and safely
has made it the preferred method for diagnosis of CVDs. MRI is also unique in its ability
to introduce noninvasive markers directly into the tissue being imaged(MR tagging) during
the image acquisition process. With the development of advanced MR imaging acquisition
technologies, 3D MR imaging is more and more clinically feasible. This recent development has
allowed new potentially 3D image analysis technologies to be deployed. However, quantitative
analysis of cardiovascular system from the images remains a challenging topic.
The work presented in this thesis describes the development of segmentation and motion
analysis techniques for the study of the cardiac anatomy and function in cardiac magnetic
resonance (CMR) images. The first main contribution of the thesis is the development of a fully
automatic cardiac segmentation technique that integrates and combines a series of state-of-the-art
techniques. The proposed segmentation technique is capable of generating an accurate 3D
segmentation from multiple image sequences. The proposed segmentation technique is robust
even in the presence of pathological changes, large anatomical shape variations and locally
varying contrast in the images.
Another main contribution of this thesis is the development of motion tracking techniques that
can integrate motion information from different sources. For example, the radial motion of
the myocardium can be tracked easily in untagged MR imaging since the epi- and endocardial
surfaces are clearly visible. On the other hand, tagged MR imaging allows easy tracking of
both longitudinal and circumferential motion. We propose a novel technique based on non-rigid
image registration for the myocardial motion estimation using both untagged and 3D tagged MR
images. The novel aspect of our technique is its simultaneous use of complementary information
from both untagged and 3D tagged MR imaging. The similarity measure is spatially weighted
to maximise the utility of information from both images.
The thesis also proposes a sparse representation for free-form deformations (FFDs) using the principles of compressed sensing. The sparse free-form deformation (SFFD) model can
capture fine local details such as motion discontinuities without sacrificing robustness. We
demonstrate the capabilities of the proposed framework to accurately estimate smooth as well
as discontinuous deformations in 2D and 3D CMR image sequences. Compared to the standard
FFD approach, a significant increase in registration accuracy can be observed in datasets with
discontinuous motion patterns.
Both the segmentation and motion tracking techniques presented in this thesis have been
applied to clinical studies. We focus on two important clinical applications that can be
addressed by the techniques proposed in this thesis. The first clinical application aims
at measuring longitudinal changes in cardiac morphology and function during the cardiac
remodelling process. The second clinical application aims at selecting patients that positively
respond to cardiac resynchronization therapy (CRT).
The final chapter of this thesis summarises the main conclusions that can be drawn from the
work presented here and also discusses possible avenues for future research
Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery
One of the main challenges for computer-assisted surgery (CAS) is to determine the intra-opera- tive morphology and motion of soft-tissues. This information is prerequisite to the registration of multi-modal patient-specific data for enhancing the surgeon’s navigation capabilites by observ- ing beyond exposed tissue surfaces and for providing intelligent control of robotic-assisted in- struments. In minimally invasive surgery (MIS), optical techniques are an increasingly attractive approach for in vivo 3D reconstruction of the soft-tissue surface geometry. This paper reviews the state-of-the-art methods for optical intra-operative 3D reconstruction in laparoscopic surgery and discusses the technical challenges and future perspectives towards clinical translation. With the recent paradigm shift of surgical practice towards MIS and new developments in 3D opti- cal imaging, this is a timely discussion about technologies that could facilitate complex CAS procedures in dynamic and deformable anatomical regions
Real-time myocardial landmark tracking for MRI-guided cardiac radio-ablation using Gaussian Processes
The high speed of cardiorespiratory motion introduces a unique challenge for
cardiac stereotactic radio-ablation (STAR) treatments with the MR-linac. Such
treatments require tracking myocardial landmarks with a maximum latency of 100
ms, which includes the acquisition of the required data. The aim of this study
is to present a new method that allows to track myocardial landmarks from few
readouts of MRI data, thereby achieving a latency sufficient for STAR
treatments. We present a tracking framework that requires only few readouts of
k-space data as input, which can be acquired at least an order of magnitude
faster than MR-images. Combined with the real-time tracking speed of a
probabilistic machine learning framework called Gaussian Processes, this allows
to track myocardial landmarks with a sufficiently low latency for cardiac STAR
guidance, including both the acquisition of required data, and the tracking
inference. The framework is demonstrated in 2D on a motion phantom, and in vivo
on volunteers and a ventricular tachycardia (arrhythmia) patient. Moreover, the
feasibility of an extension to 3D was demonstrated by in silico 3D experiments
with a digital motion phantom. The framework was compared with template
matching - a reference, image-based, method - and linear regression methods.
Results indicate an order of magnitude lower total latency (<10 ms) for the
proposed framework in comparison with alternative methods. The
root-mean-square-distances and mean end-point-distance with the reference
tracking method was less than 0.8 mm for all experiments, showing excellent
(sub-voxel) agreement. The high accuracy in combination with a total latency of
less than 10 ms - including data acquisition and processing - make the proposed
method a suitable candidate for tracking during STAR treatments
- …