Multiscale medial shape-based analysis of image objects

pre-printMedial representation of a three-dimensional (3-D) object or an ensemble of 3-D objects involves capturing the object interior as a locus of medial atoms, each atom being two vectors of equal length joined at the tail at the medial point. Medial representation has a variety of beneficial properties, among the most important of which are 1) its inherent geometry, provides an object-intrinsic coordinate system and thus provides correspondence between instances of the object in and near the object(s); 2) it captures the object interior and is, thus, very suitable for deformation; and 3) it provides the basis for an intuitive object-based multiscale sequence leading to efficiency of segmentation algorithms and trainability of statistical characterizations with limited training sets. As a result of these properties, medial representation is particularly suitable for the following image analysis tasks; how each operates will be described and will be illustrated by results: 1) segmentation of objects and object complexes via deformable models; 2) segmentation of tubular trees, e.g., of blood vessels, by following height ridges of measures of fit of medial atoms to target images; 3) object-based image registration via medial loci of such blood vessel trees; 4) statistical characterization of shape differences between control and pathological classes of structures. These analysis tasks are made possible by a new form of medial representation called m-reps, which is described

A new approach for centerline extraction in handwritten strokes: an application to the constitution of a code book

International audienceWe present in this paper a new method of analysis and decomposition of handwritten documents into glyphs (graphemes) and their associated code book. The different techniques that are involved in this paper are inspired by image processing methods in a large sense and mathematical models implying graph coloring. Our approaches provide firstly a rapid and detailed characterization of handwritten shapes based on dynamic tracking of the handwriting (curvature, thickness, direction, etc.) and also a very efficient analysis method for the categorization of basic shapes (graphemes). The tools that we have produced enable paleographers to study quickly and more accurately a large volume of manuscripts and to extract a large number of characteristics that are specific to an individual or an era

Segmentation of tumor vessels based on parallel double snakes including region information

International audience— In this paper, we address the problem of the seg-mentation of vessels in images of mouse tumors, with an efficient algorithm that minimizes the user's intervention. For each vessel, two points delimiting its extremities have to be selected. Then, a line inside the vessel is automatically determined based on a Dijkstra-type algorithm. Finally, an original active contour model combining both parallel double snakes and region criteria aims at finding the borders of the vessel. Our segmentation algorithm provides numerical models of tumor vessels, suitable for the simulation of blood and contrast agent flow

Model generation of coronary artery bifurcations from CTA and single plane angiography

International audiencePurpose: To generate accurate and realistic models of coronary artery bifurcations before and after percutaneous coronary intervention (PCI), using information from two image modalities. Because bifurcations are regions where atherosclerotic plaque appears frequently and intervention is more challenging, generation of such realistic models could be of high value to predict the risk of restenosis or thrombosis after stent implantation, and to study geometrical and hemodynamical changes. Methods: Two image modalities have been employed to generate the bifurcation models: computer tomography angiography (CTA) to obtain the 3D trajectory of vessels, and 2D conventional coronary angiography (CCA) to obtain radius information of the vessel lumen, due to its better contrast and image resolution. In addition, CCA can be acquired right before and after the intervention in the operation room; therefore, the combination of CTA and CCA allows the generation of realistic prepro-cedure and postprocedure models of coronary bifurcations. The method proposed is semiautomatic, based on landmarks manually placed on both image modalities. Results: A comparative study of the models obtained with the proposed method with models manually obtained using only CTA, shows more reliable results when both modalities are used together. The authors show that using preprocedure CTA and postprocedure CCA, realistic postprocedure models can be obtained. Analysis carried out of the Murray's law in all patient bifurcations shows the geometric improvement of PCI in our models, better than using manual models from CTA alone. An experiment using a cardiac phantom also shows the feasibility of the proposed method. Conclusions: The authors have shown that fusion of CTA and CCA is feasible for realistic generation of coronary bifurcation models before and after PCI. The method proposed is efficient, and relies on minimal user interaction, and therefore is of high value to study geometric and hemo-dynamic changes of treated patients

Coronary Artery Segmentation and Motion Modelling

Conventional coronary artery bypass surgery requires invasive sternotomy and the use of a cardiopulmonary bypass, which leads to long recovery period and has high infectious potential. Totally endoscopic coronary artery bypass (TECAB) surgery based on image guided robotic surgical approaches have been developed to allow the clinicians to conduct the bypass surgery off-pump with only three pin holes incisions in the chest cavity, through which two robotic arms and one stereo endoscopic camera are inserted. However, the restricted field of view of the stereo endoscopic images leads to possible vessel misidentification and coronary artery mis-localization. This results in 20-30% conversion rates from TECAB surgery to the conventional approach. We have constructed patient-specific 3D + time coronary artery and left ventricle motion models from preoperative 4D Computed Tomography Angiography (CTA) scans. Through temporally and spatially aligning this model with the intraoperative endoscopic views of the patient's beating heart, this work assists the surgeon to identify and locate the correct coronaries during the TECAB precedures. Thus this work has the prospect of reducing the conversion rate from TECAB to conventional coronary bypass procedures. This thesis mainly focus on designing segmentation and motion tracking methods of the coronary arteries in order to build pre-operative patient-specific motion models. Various vessel centreline extraction and lumen segmentation algorithms are presented, including intensity based approaches, geometric model matching method and morphology-based method. A probabilistic atlas of the coronary arteries is formed from a group of subjects to facilitate the vascular segmentation and registration procedures. Non-rigid registration framework based on a free-form deformation model and multi-level multi-channel large deformation diffeomorphic metric mapping are proposed to track the coronary motion. The methods are applied to 4D CTA images acquired from various groups of patients and quantitatively evaluated

Aquatics reconstruction software: the design of a diagnostic tool based on computer vision algorithms

Computer vision methods can be applied to a variety of medical and surgical applications, and many techniques and algorithms are available that can be used to recover 3D shapes and information from images range and volume data. Complex practical applications, however, are rarely approachable with a single technique, and require detailed analysis on how they can be subdivided in subtasks that are computationally treatable and that, at the same time, allow for the appropriate level of user-interaction. In this paper we show an example of a complex application where, following criteria of efficiency, reliability and user friendliness, several computer vision techniques have been selected and customized to build a system able to support diagnosis and endovascular treatment of Abdominal Aortic Aneurysms. The system reconstructs the geometrical representation of four different structures related to the aorta (vessel lumen, thrombus, calcifications and skeleton) from CT angiography data. In this way it supports the three dimensional measurements required for a careful geometrical evaluation of the vessel, that is fundamental to decide if the treatment is necessary and to perform, in this case, its planning. The system has been realized within the European trial AQUATICS (IST-1999-20226 EUTIST-M WP 12), and it has been widely tested on clinical data

Automation of Hessian-Based Tubularity Measure Response Function in 3D Biomedical Images

The blood vessels and nerve trees consist of tubular objects interconnected into a complex tree- or web-like structure that has a range of structural scale 5 μm diameter capillaries to 3 cm aorta. This large-scale range presents two major problems; one is just making the measurements, and the other is the exponential increase of component numbers with decreasing scale. With the remarkable increase in the volume imaged by, and resolution of, modern day 3D imagers, it is almost impossible to make manual tracking of the complex multiscale parameters from those large image data sets. In addition, the manual tracking is quite subjective and unreliable. We propose a solution for automation of an adaptive nonsupervised system for tracking tubular objects based on multiscale framework and use of Hessian-based object shape detector incorporating National Library of Medicine Insight Segmentation and Registration Toolkit (ITK) image processing libraries

Vascular Modeling from Volumetric Diagnostic Data: A Review

Reconstruction of vascular trees from digital diagnostic images is a challenging task in the development of tools for simulation and procedural planning for clinical use. Improvements in quality and resolution of acquisition modalities are constantly increasing the fields of application of computer assisted techniques for vascular modeling and a lot of Computer Vision and Computer Graphics research groups are currently active in the field, developing methodologies, algorithms and software prototypes able to recover models of branches of human vascular system from different kinds of input images. Reconstruction methods can be extremely different according to image type, accuracy requirements and level of automation. Some technologies have been validated and are available on medical workstation, others have still to be validated in clinical environments. It is difficult, therefore, to give a complete overview of the different approach used and results obtained, this paper just presents a short review including some examples of the principal reconstruction approaches proposed for vascular reconstruction, showing also the contribution given to the field by the Medical Application Area of CRS4, where methods to recover vascular models have been implemented and used for blood flow analysis, quantitative diagnosis and surgical planning tools based on Virtual Reality

Segmentation of nerve bundles and ganglia in spine MRI using particle filters

14th International Conference, Toronto, Canada, September 18-22, 2011, Proceedings, Part IIIAutomatic segmentation of spinal nerve bundles that originate within the dural sac and exit the spinal canal is important for diagnosis and surgical planning. The variability in intensity, contrast, shape and direction of nerves seen in high resolution myelographic MR images makes segmentation a challenging task. In this paper, we present an automatic tracking method for nerve segmentation based on particle filters. We develop a novel approach to particle representation and dynamics, based on Bézier splines. Moreover, we introduce a robust image likelihood model that enables delineation of nerve bundles and ganglia from the surrounding anatomical structures. We demonstrate accurate and fast nerve tracking and compare it to expert manual segmentation.National Institutes of Health (U.S.) (NAMIC award U54-EB005149)National Science Foundation (U.S.) (CAREER grant 0642971

Parallel centerline extraction on the GPU

Centerline extraction is important in a variety of visualization applications including shape analysis, geometry processing, and virtual endoscopy. Centerlines allow accurate measurements of length along winding tubular structures, assist automatic virtual navigation, and provide a path-planning system to control the movement and orientation of a virtual camera. However, efficiently computing centerlines with the desired accuracy has been a major challenge. Existing centerline methods are either not fast enough or not accurate enough for interactive application to complex 3D shapes. Some methods based on distance mapping are accurate, but these are sequential algorithms which have limited performance when running on the CPU. To our knowledge, there is no accurate parallel centerline algorithm that can take advantage of modern many-core parallel computing resources, such as GPUs, to perform automatic centerline extraction from large data volumes at interactive speed and with high accuracy. In this paper, we present a new parallel centerline extraction algorithm suitable for implementation on a GPU to produce highly accurate, 26-connected, one-voxel-thick centerlines at interactive speed. The resulting centerlines are as accurate as those produced by a state-of-the-art sequential CPU method [40], while being computed hundreds of times faster. Applications to fly through path planning and virtual endoscopy are discussed. Experimental results demonstrating centeredness, robustness and efficiency are presented