2D and 3D digital shape modelling strategies

Image segmentation of organs in medical images using model-based approaches requires a priori information which is often given by manually tagging landmarks on a training set of shapes. This is a tedious, time-consuming, and error prone task. To overcome some of these drawbacks, several automatic methods were devised. Identification of the same homologous set of points in a training set of object shapes is the most crucial step in Active Shape Modelling, which has encountered several challenges. The most crucial among these are: (C1) defining and characterizing landmarks; (C2) obtaining landmarks at the desired level of detail; (C3) ensuring homology; (C4) generalizing to n>2 dimensions; (C5) achieving practical computations. This thesis proposes several novel modelling techniques attempting to meet C1-C5. In this process, this thesis makes the following key contributions: the concept of local scale for shapes; the idea of allowing level of detail for selecting landmarks; the concept of equalization of shape variance for selecting landmarks; the idea of recursively subdividing shapes and letting the sub-shapes guide landmark selection, which is a very general n-dimensional strategy; the idea of virtual landmarks, which may be situated anywhere relative to, not necessarily on, the shape boundary; a new compactness measure that considers both the number of landmarks and the number of modes selected as independent variables. The first of three methods uses the c-scale shape descriptor, based on the new concept of curvature-scale, to automatically locate mathematical landmarks on the mean of the training shapes. The landmarks are propagated to the training shapes to establish correspondence among shapes. Since all shapes of the same family do not necessarily present exactly the same shape features, another novel method was devised that takes into account the real shape variability existing in the training set and that is guided by the strategy of equalization of the variance observed in the training set for selecting landmarks. By incorporating the above basic concepts into modelling, a third family of methods with numerous possibilities was developed, taking into account shape features, and the variability among shapes, while being easily generalized to the 3D space. Its output is multi-resolutional allowing landmark selection at any lower resolution trivially as a subset of those found at a higher resolution. The best strategy to use within the family will have to be determined according to the clinical application at hand. All methods were evaluated in terms of compactness on two data sets - 40 CT images of the liver and 40 MR images of the talus bone of the foot. Further, numerous artificial shapes with known salient points were also used for testing the accuracy of the proposed methods. The results show that, for the same number of landmarks, the proposed methods are more compact than manual and equally spaced annotations. Besides, the accuracy (in terms of false positives and negatives and the location of landmarks) of the proposed shape descriptor on artificial shapes is considerably superior to a state-of-the-art scale space approach to finding salient points on shapes

Three-dimensional model-based analysis of vascular and cardiac images

This thesis is concerned with the geometrical modeling of organs to perform medical image analysis tasks. The thesis is divided in two main parts devoted to model linear vessel segments and the left ventricle of the heart, respectively. Chapters 2 to 4 present different aspects of a model-based technique for semi-automated quantification of linear vessel segments from 3-D Magnetic Resonance Angiography (MRA). Chapter 2 is concerned with a multiscale filter for the enhancement of vessels in 2-D and 3-D angiograms. Chapter 3 applies the filter developed in Chapter 2 to determine the central vessel axis in 3-D MRA images. This procedure is initialized using an efficient user interaction technique that naturally incorporates the knowledge of the operator about the vessel of interest. Also in this chapter, a linear vessel model is used to recover the position of the vessel wall in order to carry out an accurate quantitative analysis of vascular morphology. Prior knowledge is provided in two main forms: a cylindrical model introduces a shape prior while prior knowledge on the image acquisition (type of MRA technique) is used to define an appropriate vessel boundary criterion. In Chapter 4 an extensive in vitro and in vivo evaluation of the algorithm introduced in Chapter 3 is described. Chapters 5 to 7 change the focus to 3D cardiac image analysis from Magnetic Resonance Imaging. Chapter 5 presents an extensive survey, a categorization and a critical review of the field of cardiac modeling. Chapter 6 and Chapter 7 present successive refinements of a method for building statistical models of shape variability with particular emphasis on cardiac modeling. The method is based on an elastic registration method using hierarchical free-form deformations. A 3D shape model of the left and right ventricles of the heart was constructed. This model contains both the average shape of these organs as well as their shape variability. The methodology presented in the last two chapters could also be applied to other anatomical structures. This has been illustrated in Chapter 6 with examples of geometrical models of the nucleus caudate and the radius

Medical image segmentation and analysis using statistical shape modelling and inter-landmark relationships

The study of anatomical morphology is of great importance to medical imaging, with applications varying from clinical diagnosis to computer-aided surgery. To this end, automated tools are required for accurate extraction of the anatomical boundaries from the image data and detailed interpretation of morphological information. This thesis introduces a novel approach to shape-based analysis of medical images based on Inter- Landmark Descriptors (ILDs). Unlike point coordinates that describe absolute position, these shape variables represent relative configuration of landmarks in the shape. The proposed work is motivated by the inherent difficulties of methods based on landmark coordinates in challenging applications. Through explicit invariance to pose parameters and decomposition of the global shape constraints, this work permits anatomical shape analysis that is resistant to image inhomogeneities and geometrical inconsistencies. Several algorithms are presented to tackle specific image segmentation and analysis problems, including automatic initialisation, optimal feature point search, outlier handling and dynamic abnormality localisation. Detailed validation results are provided based on various cardiovascular magnetic resonance datasets, showing increased robustness and accuracy.Open acces

Registration of prone and supine CT colonography images and its clinical application

Computed tomographic (CT) colonography is a technique for detecting bowel cancer and potentially precancerous polyps. CT imaging is performed on the cleansed and insufflated bowel in order to produce a virtual endoluminal representation similar to optical colonoscopy. Because fluids and stool can mimic pathology, images are acquired with the patient in both prone and supine positions. Radiologists then match endoluminal locations visually between the two acquisitions in order to determine whether pathology is real or not. This process is hindered by the fact that the colon can undergo considerable deformation between acquisitions. Robust and accurate automated registration between prone and supine data acquisitions is therefore pivotal for medical interpretation, but a challenging problem. The method proposed in this thesis reduces the complexity of the registration task of aligning the prone and supine CT colonography acquisitions. This is done by utilising cylindrical representations of the colonic surface which reflect the colon's specific anatomy. Automated alignment in the cylindrical domain is achieved by non-rigid image registration using surface curvatures, applicable even when cases exhibit local luminal collapses. It is furthermore shown that landmark matches for initialisation improve the registration's accuracy and robustness. Additional performance improvements are achieved by symmetric and inverse-consistent registration and iteratively deforming the surface in order to compensate for differences in distension and bowel preparation. Manually identified reference points in human data and fiducial markers in a porcine phantom are used to validate the registration accuracy. The potential clinical impact of the method has been evaluated using data that reflects clinical practise. Furthermore, correspondence between follow-up CT colonography acquisitions is established in order to facilitate the clinical need to investigate polyp growth over time. Accurate registration has the potential to both improve the diagnostic process and decrease the radiologist's interpretation time. Furthermore, its result could be integrated into algorithms for improved computer-aided detection of colonic polyps

An image segmentation and registration approach to cardiac function analysis using MRI

Cardiovascular diseases (CVDs) are one of the major causes of death in the world. In recent years, significant progress has been made in the care and treatment of patients with such diseases. A crucial factor for this progress has been the development of magnetic resonance (MR) imaging which makes it possible to diagnose and assess the cardiovascular function of the patient. The ability to obtain high-resolution, cine volume images easily and safely has made it the preferred method for diagnosis of CVDs. MRI is also unique in its ability to introduce noninvasive markers directly into the tissue being imaged(MR tagging) during the image acquisition process. With the development of advanced MR imaging acquisition technologies, 3D MR imaging is more and more clinically feasible. This recent development has allowed new potentially 3D image analysis technologies to be deployed. However, quantitative analysis of cardiovascular system from the images remains a challenging topic. The work presented in this thesis describes the development of segmentation and motion analysis techniques for the study of the cardiac anatomy and function in cardiac magnetic resonance (CMR) images. The first main contribution of the thesis is the development of a fully automatic cardiac segmentation technique that integrates and combines a series of state-of-the-art techniques. The proposed segmentation technique is capable of generating an accurate 3D segmentation from multiple image sequences. The proposed segmentation technique is robust even in the presence of pathological changes, large anatomical shape variations and locally varying contrast in the images. Another main contribution of this thesis is the development of motion tracking techniques that can integrate motion information from different sources. For example, the radial motion of the myocardium can be tracked easily in untagged MR imaging since the epi- and endocardial surfaces are clearly visible. On the other hand, tagged MR imaging allows easy tracking of both longitudinal and circumferential motion. We propose a novel technique based on non-rigid image registration for the myocardial motion estimation using both untagged and 3D tagged MR images. The novel aspect of our technique is its simultaneous use of complementary information from both untagged and 3D tagged MR imaging. The similarity measure is spatially weighted to maximise the utility of information from both images. The thesis also proposes a sparse representation for free-form deformations (FFDs) using the principles of compressed sensing. The sparse free-form deformation (SFFD) model can capture fine local details such as motion discontinuities without sacrificing robustness. We demonstrate the capabilities of the proposed framework to accurately estimate smooth as well as discontinuous deformations in 2D and 3D CMR image sequences. Compared to the standard FFD approach, a significant increase in registration accuracy can be observed in datasets with discontinuous motion patterns. Both the segmentation and motion tracking techniques presented in this thesis have been applied to clinical studies. We focus on two important clinical applications that can be addressed by the techniques proposed in this thesis. The first clinical application aims at measuring longitudinal changes in cardiac morphology and function during the cardiac remodelling process. The second clinical application aims at selecting patients that positively respond to cardiac resynchronization therapy (CRT). The final chapter of this thesis summarises the main conclusions that can be drawn from the work presented here and also discusses possible avenues for future research

Computer-aided detection of wall motion abnormalities in cardiac MRI

With the increasing prevalence and hospitalization rate of ischaemic heart disease, an explosive growth of diagnostic imaging for ischaemia is ongoing. Clinical decision making on revascularization procedures requires reliable viability assessment to assure long-term patient survival and to elevate cost effectiveness of the therapy and treatment. As such, the demand is increasing for a computer-assisted diagnosis (CAD) method for ischaemic heart disease that supports clinicians with an objective analysis of infarct severity, a viability assessment or a prediction of potential functional improvement before performing revascularization. The goal of this thesis was to explore novel mechanisms that can be used for CAD in ischaemic heart disease, particularly through wall motion analysis from cardiac MR images. Existing diagnostic treatment of wall motion analysis from cardiac MR relies on visual wall motion scoring, which suffers from inter- and intra-observer variability. To minimize this variability, the automated method must contain essential knowledge on how the heart contracts normally. This enables automatic quantification of regional abnormal wall motion, detection of segments with contractile reserve and prediction of functional improvement in stress.1. Bontius Stichting inz. Doelfonds beeldverwerking, 2. Foundation Imago, 3. ASCI research school, and 4. Library of the University of Leiden.UBL - phd migration 201

Self-Localization of Autonomous Vehicles Using Landmark Object Detection

Fully autonomous vehicles are rapidly approaching realization and concerns regarding their safety and robustness are a prominent obstacle to their integration into society. A bottleneck of an autonomous vehicle’s safety is its ability to self-localize under all types of conditions. Self-localization is critical for the vehicle to route to a destination, for the vehicle itself to be tracked in case of theft, and in determining local traffic laws to operate harmoniously with other traffic and pedestrians. The global positioning system (GPS) is utilized by autonomous vehicles for self-localization, but the availability and reliability of GPS is not guaranteed in all situations, such as when GPS reception is weak or when an adversary is spoofing information. We address this problem by proposing a self-localization method for autonomous vehicles that does not require GPS at localization time. The framework herein describes the representation of a road network as a graph using the data made available by OpenStreetMap, and an encoding of street segments based on detected landmark objects. We derive the current state observer transition function from the resulting graph, and employ localization methods based on set distance and minimum cost paths to determine the most probable location of the vehicle given a sequence of observed landmarks. Through simulating vehicle traveling paths along a road network generated from real data of a region of Washington D.C., we evaluate the performance of our method for varying degrees of landmark observation error and analyze the algorithm’s time and memory complexity, demonstrating that the approach provides a feasible solution to the problem