Template-based 3D-2D rigid registration of vascular structures in frequency domain from a single view

Image guided interventions in angiography are performed with a real-time X-ray sequences acquired by a C-arm device which provides the surgeon two dimensional visualization needed to guide the surgical instruments. This visualization may be augmented by registering a three dimensional preoperative volume with the interventional images to provide additional information such as depth, removal of occlusions and alternative views of vessel paths. This thesis presents two novel methods for rigid registration of vascular structures in the preoperative volume to the interventional X-ray image for enhancing visualization in Image Guided Interventions. In the first part of this thesis, estimation of rotation and translation are decoupled. Rotation is estimated by comparing rotated projections of the segmented vessels of the volume with segmented X-ray vessels in frequency domain. Translation is then estimated by minimizing the distances and maximizing the overlap ratio between segmented vessels. The registration results are reported in mean Projection Distances. The second part of the thesis adds separation of out-of-plane translation estimation to the first part and replaces segmentation by gradients. Rotation and out-of-plane translation are estimated by comparing rotational projected templates of volume with depth templates formed by scaling the X-ray image in the Fourier Magnitude Domain. The in-plane translation is then estimated by a Fourier Phase correlation. The registration results are evaluated by a Gold Standard dataset on cerebral arteries. This method is robust against occlusions and noises due to its usage of gradients and frequency domain similarity, has high capture range and fast, fixed computation times for every step due to template based framework

Medical image registration by neural networks: a regression-based registration approach

This thesis focuses on the development and evaluation of a registration-by-regression approach for the 3D/2D registration of coronary Computed Tomography Angiography (CTA) and X-ray angiography. This regression-based method relates image features of 2D projection images to the transformation parameters of the 3D image by a nonlinear regression. It treats registration as a regression problem, as an alternative for the traditional iterative approach that often comes with high computational costs and limited capture range. First we presented a survey of the methods with a regression-based registration approach for medical applications, as well as a summary of their main characteristics (Chapter 2). Second, we studied the registration methodology, addressing the input features and the choice of regression model (Chapter 3 and Chapter 4). For that purpose, we evaluated different options using simulated X-ray images generated from coronary artery tree models derived from 3D CTA scans. We also compared the registration-by-regression results with a method based on iterative optimization. Different image features of 2D projections and seven regression techniques were considered. The regression approach for simulated X-rays was shown to be slightly less accurate, but much more robust than the method based on an iterative optimization approach. Neural Networks obtained accurate results and showed to be robust to large initial misalignment. Third, we evaluated the registration-by-regression method using clinical data, integrating the 3D preoperative CTA of the coronary arteries with intraoperative 2D X-ray angiography images (Chapter 5). For the evaluation of the image registration, a gold standard registration was established using an exhaustive search followed by a multi-observer visual scoring procedure. The influence of preprocessing options for the simulated images and the real X-rays was studied. Several image features were also compared. The coronary registration–by-regression results were not satisfactory, resembling manual initialization accuracy. Therefore, the proposed method for this concrete problem and in its current configuration is not sufficiently accurate to be used in the clinical practice. The framework developed enables us to better understand the dependency of the proposed method on the differences between simulated and real images. The main difficulty lies in the substantial differences in appearance between the images used for training (simulated X-rays from 3D coronary models) and the actual images obtained during the intervention (real X-ray angiography). We suggest alternative solutions and recommend to evaluate the registration-by-regression approach in other applications where training data is available that has similar appearance to the eventual test data

Dynamic Analysis of X-ray Angiography for Image-Guided Coronary Interventions

Percutaneous coronary intervention (PCI) is a minimally-invasive procedure for treating patients with coronary artery disease. PCI is typically performed with image guidance using X-ray angiograms (XA) in which coronary arter

Coronary Artery Segmentation and Motion Modelling

Conventional coronary artery bypass surgery requires invasive sternotomy and the use of a cardiopulmonary bypass, which leads to long recovery period and has high infectious potential. Totally endoscopic coronary artery bypass (TECAB) surgery based on image guided robotic surgical approaches have been developed to allow the clinicians to conduct the bypass surgery off-pump with only three pin holes incisions in the chest cavity, through which two robotic arms and one stereo endoscopic camera are inserted. However, the restricted field of view of the stereo endoscopic images leads to possible vessel misidentification and coronary artery mis-localization. This results in 20-30% conversion rates from TECAB surgery to the conventional approach. We have constructed patient-specific 3D + time coronary artery and left ventricle motion models from preoperative 4D Computed Tomography Angiography (CTA) scans. Through temporally and spatially aligning this model with the intraoperative endoscopic views of the patient's beating heart, this work assists the surgeon to identify and locate the correct coronaries during the TECAB precedures. Thus this work has the prospect of reducing the conversion rate from TECAB to conventional coronary bypass procedures. This thesis mainly focus on designing segmentation and motion tracking methods of the coronary arteries in order to build pre-operative patient-specific motion models. Various vessel centreline extraction and lumen segmentation algorithms are presented, including intensity based approaches, geometric model matching method and morphology-based method. A probabilistic atlas of the coronary arteries is formed from a group of subjects to facilitate the vascular segmentation and registration procedures. Non-rigid registration framework based on a free-form deformation model and multi-level multi-channel large deformation diffeomorphic metric mapping are proposed to track the coronary motion. The methods are applied to 4D CTA images acquired from various groups of patients and quantitatively evaluated

Continuous roadmapping in liver TACE procedures using 2D–3D catheter-based registration

PURPOSE: Fusion of pre/perioperative images and intra-operative images may add relevant information during image-guided procedures. In abdominal procedures, respiratory motion changes the position of organs, and thus accurate image guidance requires a continuous update of the spatial alignment of the (pre/perioperative) information with the organ position during the intervention. METHODS: In this paper, we propose a method to register in real time perioperative 3D rotational angiography images (3DRA) to intra-operative single-plane 2D fluoroscopic images for improved guidance in TACE interventions. The method uses the shape of 3D vessels extracted from the 3DRA and the 2D catheter shape extracted from fluoroscopy. First, the appropriate 3D vessel is selected from the complete vascular tree using a shape similarity metric. Subsequently, the catheter is registered to this vessel, and the 3DRA is visualized based on the registration results. The method is evaluated on simulated data and clinical data. RESULTS: The first selected vessel, ranked with the shape similarity metric, is used more than 39 % in the final registration and the second more than 21 %. The median of the closest corresponding points distance between 2D angiography vessels and projected 3D vessels is 4.7–5.4 mm when using the brute force optimizer and 5.2–6.6 mm when using the Powell optimizer. CONCLUSION: We present a catheter-based registration method to continuously fuse a 3DRA roadmap arterial tree onto 2D fluoroscopic images with an efficient shape similarity

Iterative Closest Curve: a Framework for Curvilinear Structure Registration Application to 2D/3D Coronary Arteries Registration

International audienceTreatment coronary arteries endovascular involves catheter navigation through patient vasculature. The projective angiography guidance is limited in the case of chronic total occlusion where occluded vessel can not be seen. Integrating standard preoperative CT angiography information with live fluoroscopic images addresses this limitation but requires alignment of both modalities. This article proposes a structure-based registration method that intrinsically preserves both the geometrical and topological coherencies of the vascular centrelines to be registered, by the means of a dedicated curve-to-curve distance pairs of closest curves are identified, while pairing their points. Preliminary experiments demonstrate that the proposed approach performs better than the standard Iterative Closest Point method giving a wider attraction basin and improved accuracy

간 조영술을 위한 혈관 모델 기반의 국부 적응 2D-3D 정합 알고리즘 기법 연구

학위논문 (박사)-- 서울대학교 대학원 : 전기·컴퓨터공학부, 2017. 2. 신영길.Two-dimensional–three-dimensional (2D–3D) registration between intra-operative 2D digital subtraction angiography (DSA) and pre-operative 3D computed tomography angiography (CTA) can be used for roadmapping purposes. However, through the projection of 3D vessels, incorrect intersections and overlaps between vessels are produced because of the complex vascular structure, which make it difficult to obtain the correct solution of 2D–3D registration. To overcome these problems, we propose a registration method that selects a suitable part of a 3D vascular structure for a given DSA image and finds the optimized solution to the partial 3D structure. The proposed algorithm can reduce the registration errors because it restricts the range of the 3D vascular structure for the registration by using only the relevant 3D vessels with the given DSA. To search for the appropriate 3D partial structure, we first construct a tree model of the 3D vascular structure and divide it into several subtrees in accordance with the connectivity. Then, the best matched subtree with the given DSA image is selected using the results from the coarse registration between each subtree and the vessels in the DSA image. Finally, a fine registration is conducted to minimize the difference between the selected subtree and the vessels of the DSA image. In experimental results obtained using 10 clinical datasets, the average distance errors in the case of the proposed method were 2.34 ± 1.94 mm. The proposed algorithm converges faster and produces more correct results than the conventional method in evaluations on patient datasets.Chapter 1 Introduction 1 1.1 Background 1 1.2 Problem statement 6 1.3 Main contributions 8 1.4 Contents organization 10 Chapter 2 Related Works 12 2.1 Overview 12 2.1.1 Definitions 14 2.1.2 Intensity-based and feature-based registration 17 2.2 Neurovascular applications 19 2.3 Liver applications 22 2.4 Cardiac applications 27 2.4.1 Rigid registration 27 2.4.2 Non-rigid registration 31 Chapter 3 3D Vascular Structure Model 33 3.1 Vessel segmentation 34 3.1.1 Overview 34 3.1.2 Vesselness filter 36 3.1.3 Vessel segmentation 39 3.2 Skeleton extraction 40 3.2.1 Overview 40 3.2.2 Skeleton extraction based on fast marching method 41 3.3 Graph construction 45 3.4 Generation of subtree structures from 3D tree model 46 Chapter 4 Locally Adaptive Registration 52 4.1 2D centerline extraction 53 4.1.1 Extraction from a single DSA image 54 4.1.2 Extraction from angiographic image sequence 55 4.2 Coarse registration for the detection of the best matched subtree 58 4.3 Fine registration with selected 3D subtree 61 Chapter 5 Experimental Results 63 5.1 Materials 63 5.2 Phantom study 65 5.3 Performance evaluation 69 5.3.1 Evaluation for a single DSA image 69 5.3.2 Evaluation for angiographic image sequence 75 5.4 Comparison with other methods 77 5.5 Parameter study 87 Chapter 6 Conclusion 90 Bibliography 92 초록 109Docto

3D/2D Registration with Superabundant Vessel Reconstruction for Cardiac Resynchronization Therapy

<p>Miscellaneous classes: consistent/single studies of pregnancy associated pharmacokinetic changes (percent calculated as pregnant/nonpregnant values).</p