Sub-pixel Registration In Computational Imaging And Applications To Enhancement Of Maxillofacial Ct Data

In computational imaging, data acquired by sampling the same scene or object at different times or from different orientations result in images in different coordinate systems. Registration is a crucial step in order to be able to compare, integrate and fuse the data obtained from different measurements. Tomography is the method of imaging a single plane or slice of an object. A Computed Tomography (CT) scan, also known as a CAT scan (Computed Axial Tomography scan), is a Helical Tomography, which traditionally produces a 2D image of the structures in a thin section of the body. It uses X-ray, which is ionizing radiation. Although the actual dose is typically low, repeated scans should be limited. In dentistry, implant dentistry in specific, there is a need for 3D visualization of internal anatomy. The internal visualization is mainly based on CT scanning technologies. The most important technological advancement which dramatically enhanced the clinician\u27s ability to diagnose, treat, and plan dental implants has been the CT scan. Advanced 3D modeling and visualization techniques permit highly refined and accurate assessment of the CT scan data. However, in addition to imperfections of the instrument and the imaging process, it is not uncommon to encounter other unwanted artifacts in the form of bright regions, flares and erroneous pixels due to dental bridges, metal braces, etc. Currently, removing and cleaning up the data from acquisition backscattering imperfections and unwanted artifacts is performed manually, which is as good as the experience level of the technician. On the other hand the process is error prone, since the editing process needs to be performed image by image. We address some of these issues by proposing novel registration methods and using stonecast models of patient\u27s dental imprint as reference ground truth data. Stone-cast models were originally used by dentists to make complete or partial dentures. The CT scan of such stone-cast models can be used to automatically guide the cleaning of patients\u27 CT scans from defects or unwanted artifacts, and also as an automatic segmentation system for the outliers of the CT scan data without use of stone-cast models. Segmented data is subsequently used to clean the data from artifacts using a new proposed 3D inpainting approach

An Optimized Spline-Based Registration of a 3D CT to a Set of C-Arm Images

We have developed an algorithm for the rigid-body registration of a CT volume to a set of C-arm images. The algorithm uses a gradient-based iterative minimization of a least-squares measure of dissimilarity between the C-arm images and projections of the CT volume. To compute projections, we use a novel method for fast integration of the volume along rays. To improve robustness and speed, we take advantage of a coarse-to-fine processing of the volume/image pyramids. To compute the projections of the volume, the gradient of the dissimilarity measure, and the multiresolution data pyramids, we use a continuous image/volume model based on cubic B-splines, which ensures a high interpolation accuracy and a gradient of the dissimilarity measure that is well defined everywhere. We show the performance of our algorithm on a human spine phantom, where the true alignment is determined using a set of fiducial markers

Registration of ultrasound and computed tomography for guidance of laparoscopic liver surgery

Laparoscopic Ultrasound (LUS) imaging is a standard tool used for image-guidance during laparoscopic liver resection, as it provides real-time information on the internal structure of the liver. However, LUS probes are di cult to handle and their resulting images hard to interpret. Additionally, some anatomical targets such as tumours are not always visible, making the LUS guidance less e ective. To solve this problem, registration between the LUS images and a pre-operative Computed Tomography (CT) scan using information from blood vessels has been previously proposed. By merging these two modalities, the relative position between the LUS images and the anatomy of CT is obtained and both can be used to guide the surgeon. The problem of LUS to CT registration is specially challenging, as besides being a multi-modal registration, the eld of view of LUS is signi cantly smaller than that of CT. Therefore, this problem becomes poorly constrained and typically an accurate initialisation is needed. Also, the liver is highly deformed during laparoscopy, complicating the problem further. So far, the methods presented in the literature are not clinically feasible as they depend on manually set correspondences between both images. In this thesis, a solution for this registration problem that may be more transferable to the clinic is proposed. Firstly, traditional registration approaches comprised of manual initialisation and optimisation of a cost function are studied. Secondly, it is demonstrated that a globally optimal registration without a manual initialisation is possible. Finally, a new globally optimal solution that does not require commonly used tracking technologies is proposed and validated. The resulting approach provides clinical value as it does not require manual interaction in the operating room or tracking devices. Furthermore, the proposed method could potentially be applied to other image-guidance problems that require registration between ultrasound and a pre-operative scan

A 3D computer assisted Orthopedic Surgery Planning approach based on planar radiography

Dissertação de mestrado integrado em Engenharia Biomédica (área de especialização em Informática Médica)The main goal of this work consisted in develop a system to perform the 3D reconstruction of bone models from radiographic images. This system can be then integrated with a commercial software that performs pre-operative planning of orthopedic surgeries. The benefit of performing this 3D reconstruction from planar radiography is that this modality has some advantages over other modalities that perform this reconstruction directly, like CT and MRI. To develop the system it was used radiographic images of the femur obtained from medical image databases online. It was also used a generic model of the femur available in the online repository BEL. This generic model completes the information missing in the radiographic images. It was developed two methods to perform the 3D reconstruction through the deformation of the generic model, one uses triangulation of extracted edge points and the other don't. The first method was not successful, the final model had very low thickness, possibly because the triangulation process was not performed correctly. With the second method it was obtained a 3D bone model of the femur aligned with the radiographic images of the patient and with the same size as the patient's bone. However, the obtained model still needs some adjustment to coincide fully with reality. To perform this is necessary to enhance the deformation step of the model so that it will have the same shape as the patient's bone. The second method is more advantageous because it doesn't need the parameters of the x-ray imaging system. However, it's necessary to enhance the step deformation of this method so that the final model matches patient's anatomy.O principal objetivo deste trabalho consistiu em desenvolver um sistema capaz de realizar a reconstrução 3D de modelos ósseos a partir de imagens radiográficas. Este sistema pode posteriormente ser integrado num produto comercial que realiza o planeamento pré-operativo de cirurgias ortopédicas. O benefício de realizar esta reconstrução 3D a partir de radiografias está relacionado com o facto desta modalidade ter vantagens em relação às outras modalidades que fazem esta reconstrução diretamente, como as modalidades CT e MRI. Para desenvolver este sistema foram usadas imagens radiográficas do fémur obtidas através de bases de dados online de imagens médicas. Também foi usado um modelo genérico do fémur disponível no repositório online BEL. Este modelo genérico completa a informação que está em falta nas imagens radiográficas. Foram desenvolvidos dois métodos, que realizam a reconstrução 3D através da deformação do modelo genérico sendo que num é feita a triangulação de pontos dos contornos e noutro não. O primeiro método não foi bem sucedido, visto que o modelo final tinha uma espessura muito pequena, possivelmente devido ao facto do processo de triangulação não ter sido executado corretamente. Com o segundo método foi obtido um modelo 3D do fémur alinhado com as imagens radiográficas do paciente e com o mesmo tamanho do osso do paciente. No entanto, o modelo obtido carece ainda de alguma afinação de modo a coincidir na íntegra com a realidade. Para fazer isto é necessário melhorar o passo de deformação do modelo, para que este fique com a mesma forma do osso do paciente. O segundo método é mais vantajoso porque não necessita dos parâmetros dos sistema de raios- X. No entanto, é necessário melhorar o passo de deformação deste método para que o modelo final coincida com a anatomia do paciente

간 조영술을 위한 혈관 모델 기반의 국부 적응 2D-3D 정합 알고리즘 기법 연구

학위논문 (박사)-- 서울대학교 대학원 : 전기·컴퓨터공학부, 2017. 2. 신영길.Two-dimensional–three-dimensional (2D–3D) registration between intra-operative 2D digital subtraction angiography (DSA) and pre-operative 3D computed tomography angiography (CTA) can be used for roadmapping purposes. However, through the projection of 3D vessels, incorrect intersections and overlaps between vessels are produced because of the complex vascular structure, which make it difficult to obtain the correct solution of 2D–3D registration. To overcome these problems, we propose a registration method that selects a suitable part of a 3D vascular structure for a given DSA image and finds the optimized solution to the partial 3D structure. The proposed algorithm can reduce the registration errors because it restricts the range of the 3D vascular structure for the registration by using only the relevant 3D vessels with the given DSA. To search for the appropriate 3D partial structure, we first construct a tree model of the 3D vascular structure and divide it into several subtrees in accordance with the connectivity. Then, the best matched subtree with the given DSA image is selected using the results from the coarse registration between each subtree and the vessels in the DSA image. Finally, a fine registration is conducted to minimize the difference between the selected subtree and the vessels of the DSA image. In experimental results obtained using 10 clinical datasets, the average distance errors in the case of the proposed method were 2.34 ± 1.94 mm. The proposed algorithm converges faster and produces more correct results than the conventional method in evaluations on patient datasets.Chapter 1 Introduction 1 1.1 Background 1 1.2 Problem statement 6 1.3 Main contributions 8 1.4 Contents organization 10 Chapter 2 Related Works 12 2.1 Overview 12 2.1.1 Definitions 14 2.1.2 Intensity-based and feature-based registration 17 2.2 Neurovascular applications 19 2.3 Liver applications 22 2.4 Cardiac applications 27 2.4.1 Rigid registration 27 2.4.2 Non-rigid registration 31 Chapter 3 3D Vascular Structure Model 33 3.1 Vessel segmentation 34 3.1.1 Overview 34 3.1.2 Vesselness filter 36 3.1.3 Vessel segmentation 39 3.2 Skeleton extraction 40 3.2.1 Overview 40 3.2.2 Skeleton extraction based on fast marching method 41 3.3 Graph construction 45 3.4 Generation of subtree structures from 3D tree model 46 Chapter 4 Locally Adaptive Registration 52 4.1 2D centerline extraction 53 4.1.1 Extraction from a single DSA image 54 4.1.2 Extraction from angiographic image sequence 55 4.2 Coarse registration for the detection of the best matched subtree 58 4.3 Fine registration with selected 3D subtree 61 Chapter 5 Experimental Results 63 5.1 Materials 63 5.2 Phantom study 65 5.3 Performance evaluation 69 5.3.1 Evaluation for a single DSA image 69 5.3.2 Evaluation for angiographic image sequence 75 5.4 Comparison with other methods 77 5.5 Parameter study 87 Chapter 6 Conclusion 90 Bibliography 92 초록 109Docto

Computational Depth-resolved Imaging and Metrology

In this thesis, the main research challenge boils down to extracting 3D spatial information of an object from 2D measurements using light. Our goal is to achieve depth-resolved tomographic imaging of transparent or semi-transparent 3D objects, and to perform topography characterization of rough surfaces. The essential tool we used is computational imaging, where depending on the experimental scheme, often indirect measurements are taken, and tailored algorithms are employed to perform image reconstructions. The computational imaging approach enables us to relax the hardware requirement of an imaging system, which is essential when using light in the EUV and x-ray regimes, where high-quality optics are not readily available. In this thesis, visible and infrared light sources are used, where computational imaging also offers several advantages. First of all, it often leads to a simple, flexible imaging system with low cost. In the case of a lensless configuration, where no lenses are involved in the final image-forming stage between the object and the detector, aberration-free image reconstructions can be obtained. More importantly, computational imaging provides quantitative reconstructions of scalar electric fields, enabling phase imaging, numerical refocus, as well as 3D imaging