Object Tracking

Object tracking consists in estimation of trajectory of moving objects in the sequence of images. Automation of the computer object tracking is a difficult task. Dynamics of multiple parameters changes representing features and motion of the objects, and temporary partial or full occlusion of the tracked objects have to be considered. This monograph presents the development of object tracking algorithms, methods and systems. Both, state of the art of object tracking methods and also the new trends in research are described in this book. Fourteen chapters are split into two sections. Section 1 presents new theoretical ideas whereas Section 2 presents real-life applications. Despite the variety of topics contained in this monograph it constitutes a consisted knowledge in the field of computer object tracking. The intention of editor was to follow up the very quick progress in the developing of methods as well as extension of the application

A novel MRA-based framework for the detection of changes in cerebrovascular blood pressure.

Background: High blood pressure (HBP) affects 75 million adults and is the primary or contributing cause of mortality in 410,000 adults each year in the United States. Chronic HBP leads to cerebrovascular changes and is a significant contributor for strokes, dementia, and cognitive impairment. Non-invasive measurement of changes in cerebral vasculature and blood pressure (BP) may enable physicians to optimally treat HBP patients. This manuscript describes a method to non-invasively quantify changes in cerebral vasculature and BP using Magnetic Resonance Angiography (MRA) imaging. Methods: MRA images and BP measurements were obtained from patients (n=15, M=8, F=7, Age= 49.2 ± 7.3 years) over a span of 700 days. A novel segmentation algorithm was developed to identify brain vasculature from surrounding tissue. The data was processed to calculate the vascular probability distribution function (PDF); a measure of the vascular diameters in the brain. The initial (day 0) PDF and final (day 700) PDF were used to correlate the changes in cerebral vasculature and BP. Correlation was determined by a mixed effects linear model analysis. Results: The segmentation algorithm had a 99.9% specificity and 99.7% sensitivity in identifying and delineating cerebral vasculature. The PDFs had a statistically significant correlation to BP changes below the circle of Willis (p-value = 0.0007), but not significant (p-value = 0.53) above the circle of Willis, due to smaller blood vessels. Conclusion: Changes in cerebral vasculature and pressure can be non-invasively obtained through MRA image analysis, which may be a useful tool for clinicians to optimize medical management of HBP

Combinatorial optimisation for arterial image segmentation.

Cardiovascular disease is one of the leading causes of the mortality in the western world. Many imaging modalities have been used to diagnose cardiovascular diseases. However, each has different forms of noise and artifacts that make the medical image analysis field important and challenging. This thesis is concerned with developing fully automatic segmentation methods for cross-sectional coronary arterial imaging in particular, intra-vascular ultrasound and optical coherence tomography, by incorporating prior and tracking information without any user intervention, to effectively overcome various image artifacts and occlusions. Combinatorial optimisation methods are proposed to solve the segmentation problem in polynomial time. A node-weighted directed graph is constructed so that the vessel border delineation is considered as computing a minimum closed set. A set of complementary edge and texture features is extracted. Single and double interface segmentation methods are introduced. Novel optimisation of the boundary energy function is proposed based on a supervised classification method. Shape prior model is incorporated into the segmentation framework based on global and local information through the energy function design and graph construction. A combination of cross-sectional segmentation and longitudinal tracking is proposed using the Kalman filter and the hidden Markov model. The border is parameterised using the radial basis functions. The Kalman filter is used to adapt the inter-frame constraints between every two consecutive frames to obtain coherent temporal segmentation. An HMM-based border tracking method is also proposed in which the emission probability is derived from both the classification-based cost function and the shape prior model. The optimal sequence of the hidden states is computed using the Viterbi algorithm. Both qualitative and quantitative results on thousands of images show superior performance of the proposed methods compared to a number of state-of-the-art segmentation methods

Image enhancement in digital X-ray angiography

Anyone who does not look back to the beginning throughout a course of action, does not look forward to the end. Hence it necessarily follows that an intention which looks ahead, depends on a recollection which looks back. | Aurelius Augustinus, De civitate Dei, VII.7 (417 A.D.) Chapter 1 Introduction and Summary D espite the development of imaging techniques based on alternative physical phenomena, such as nuclear magnetic resonance, emission of single photons ( -radiation) by radio-pharmaceuticals and photon pairs by electron-positron annihilations, re ection of ultrasonic waves, and the Doppler eect, X-ray based im- age acquisition is still daily practice in medicine. Perhaps this can be attributed to the fact that, contrary to many other phenomena, X-rays lend themselves naturally for registration by means of materials and methods widely available at the time of their discovery | a fact that gave X-ray based medical imaging an at least 50-year head start over possible alternatives. Immediately after the preliminary communica- tion on the discovery of the \new light" by R¨ ontgen [317], late December 1895, the possible applications of X-rays were investigated intensively. In 1896 alone, almost one 1,000 articles about the new phenomenon appeared in print (Glasser [119] lists all of them). Although most of the basics of the diagnostic as well as the therapeutic uses of X-rays had been worked out by the end of that year [289], research on im- proved acquisition and reduction of potential risks for humans continued steadily in the century to follow. The development of improved X-ray tubes, rapid lm changers, image intensiers, the introduction of television cameras into uoroscopy, and com- puters in digital radiography and computerized tomography, formed a succession of achievements which increased the diagnostic potential of X-ray based imaging. One of the areas in medical imaging where X-rays have always played an im- portant role is angiography,y which concerns the visualization of blood vessels in the human body. As already suggested, research on the possibility of visualization of the human vasculature was initiated shortly after the discovery of X-rays. A photograph of a rst \angiogram" | obtained by injection of a mixture of chalk, red mercury, and petroleum into an amputated hand, followed by almost an hour of exposure to X-rays | was published as early as January 1896, by Hascheck & Lindenthal [139]. Although studies on cadavers led to greatly improved knowledge of the anatomy of the human vascular system, angiography in living man for the purpose of diagnosis and intervention became feasible only after substantial progress in the development yA term originating from the Greek words o (aggeion), meaning \vessel" or \bucket", and -' (graphein), meaning \to write" or \to record". 2 1 Introduction and Summary of relatively safe contrast media and methods of administration, as well as advance- ments in radiological equipment. Of special interest in the context of this thesis is the improvement brought by photographic subtraction, a technique known since the early 1900s and since then used successfully in e.g. astronomy, but rst introduced in X-ray angiography in 1934, by Ziedses des Plantes [425, 426]. This technique al- lowed for a considerable enhancement of vessel visibility by cancellation of unwanted background structures. In the 1960s, the time consuming lm subtraction process was replaced by analog video subtraction techniques [156, 275] which, with the in- troduction of digital computers, gave rise to the development of digital subtraction angiography [194] | a technique still considered by many the \gold standard" for de- tection and quantication of vascular anomalies. Today, research on improved X-ray based imaging techniques for angiography continues, witness the recent developments in three-dimensional rotational angiography [88, 185, 186, 341,373]. The subject of this thesis is enhancement of digital X-ray angiography images. In contrast with the previously mentioned developments, the emphasis is not on the further improvement of image acquisition techniques, but rather on the development and evaluation of digital image processing techniques for retrospective enhancement of images acquired with existing techniques. In the context of this thesis, the term \enhancement" must be regarded in a rather broad sense. It does not only refer to improvement of image quality by reduction of disturbing artifacts and noise, but also to minimization of possible image quality degradation and loss of quantitative information, inevitably introduced by required image processing operations. These two aspects of image enhancement will be claried further in a brief summary of each of the chapters of this thesis. The rst three chapters deal with the problem of patient motion artifacts in digital subtraction angiography (DSA). In DSA imaging, a sequence of 2D digital X-ray projection images is acquired, at a rate of e.g. two per second, following the injection of contrast material into one of the arteries or veins feeding the part of the vasculature to be diagnosed. Acquisition usually starts about one or two seconds prior to arrival of the contrast bolus in the vessels of interest, so that the rst few images included in the sequence do not show opacied vessels. In a subsequent post-processing step, one of these \pre-bolus" images is then subtracted automatically from each of the contrast images so as to mask out background structures such as bone and soft- tissue shadows. However, it is clear that in the resulting digital subtraction images, the unwanted background structures will have been removed completely only when the patient lied perfectly still during acquisition of the original images. Since most patients show at least some physical reaction to the passage of a contrast medium, this proviso is generally not met. As a result, DSA images frequently show patient-motion induced artifacts (see e.g. the bottom-left image in Fig. 1.1), which may in uence the subsequent analysis and diagnosis carried out by radiologists. Since the introduction of DSA, in the early 1980s, many solutions to the problem of patient motion artifacts have been put forward. Chapter 2 presents an overview of the possible types of motion artifacts reported in the literature and the techniques that have been proposed to avoid them. The main purpose of that chapter is to review and discuss the techniques proposed over the past two decades to correct for 1 Introduction and Summary 3 Figure 1.1. Example of creation and reduction of patient motion artifacts in cerebral DSA imaging. Top left: a \pre-bolus" or mask image acquired just prior to the arrival of the contrast medium. Top right: one of the contrast or live images showing opacied vessels. Bottom left: DSA image obtained after subtraction of the mask from the contrast image, followed by contrast enhancement. Due to patient motion, the background structures in the mask and contrast image were not perfectly aligned, as a result of which the DSA image does not only show blood vessels, but also additional undesired structures (in this example primarily in the bottom-left part of the image). Bottom right: DSA image resulting from subtraction of the mask and contast image after application of the automatic registration algorithm described in Chapter 3. 4 1 Introduction and Summary patient motion artifacts retrospectively, by means of digital image processing. The chapter addresses fundamental problems, such as whether it is possible to construct a 2D geometrical transformation that exactly describes the projective eects of an originally 3D transformation, as well as practical problems, such as how to retrieve the correspondence between mask and contrast images by using only the grey-level information contained in the images, and how to align the images according to that correspondence in a computationally ecient manner. The review in Chapter 2 reveals that there exists quite some literature on the topic of (semi-)automatic image alignment, or image registration, for the purpose of motion artifact reduction in DSA images. However, to the best of our knowledge, research in this area has never led to algorithms which are suciently fast and robust to be acceptable for routine use in clinical practice. By drawing upon the suggestions put forward in Chapter 2, a new approach to automatic registration of digital X-ray angiography images is presented in Chapter 3. Apart from describing the functionality of the components of the algorithm, special attention is paid to their computationally optimal implementation. The results of preliminary experiments described in that chapter indicate that the algorithm is eective, very fast, and outperforms alterna- tive approaches, in terms of both image quality and required computation time. It is concluded that the algorithm is most eective in cerebral and peripheral DSA imag- ing. An example of the image quality enhancement obtained after application of the algorithm in the case of a cerebral DSA image is provided in Fig 1.1. Chapter 4 reports on a clinical evaluation of the automatic registration technique. The evaluation involved 104 cerebral DSA images, which were corrected for patient motion artifacts by the automatic technique, as well as by pixel shifting | a manual correction technique currently used in clinical practice. The quality of the DSA images resulting from the two techniques was assessed by four observers, who compared the images both mutually and to the corresponding original images. The results of the evaluation presented in Chapter 4 indicate that the dierence in performance between the two correction techniques is statistically signicant. From the results of the mutual comparisons it is concluded that, on average, the automatic registration technique performs either comparably, better than, or even much better than manual pixel shifting in 95% of all cases. In the other 5% of the cases, the remaining artifacts are located near the borders of the image, which are generally diagnostically non-relevant. In addition, the results show that the automatic technique implies a considerable reduction of post-processing time compared to manual pixel shifting (on average, one second versus 12 seconds per DSA image). The last two chapters deal with somewhat dierent topics. Chapter 5 is concerned with visualization and quantication of vascular anomalies in three-dimensional rota- tional angiography (3DRA). Similar to DSA imaging, 3DRA involves the acquisition of a sequence of 2D digital X-ray projection images, following a single injection of contrast material. Contrary to DSA, however, this sequence is acquired during a 180 rotation of the C-arch on which the X-ray source and detector are mounted antipo- dally, with the object of interest positioned in its iso-center. The rotation is completed in about eight seconds and the resulting image sequence typically contains 100 images, which form the input to a ltered back-projection algorithm for 3D reconstruction. In contrast with most other 3D medical imaging techniques, 3DRA is capable of provid- 1 Introduction and Summary 5 Figure 1.2. Visualizations of a clinical 3DRA dataset, illustrating the qualitative improvement obtained after noise reduction ltering. Left: volume rendering of the original, raw image. Right: volume rendering of the image after application of edge-enhancing anisotropic diusion ltering (see Chapter 5 for a description of this technique). The visualizations were obtained by using the exact same settings for the parameters of the volume rendering algorithm. ing high-resolution isotropic datasets. However, due to the relatively high noise level and the presence of other unwanted background variations caused by surrounding tissue, the use of noise reduction techniques is inevitable in order to obtain smooth visualizations of these datasets (see Fig. 1.2). Chapter 5 presents an inquiry into the eects of several linear and nonlinear noise reduction techniques on the visualization and subsequent quantication of vascular anomalies in 3DRA images. The evalua- tion is focussed on frequently occurring anomalies such as a narrowing (or stenosis) of the internal carotid artery or a circumscribed dilation (or aneurysm) of intracra- nial arteries. Experiments on anthropomorphic vascular phantoms indicate that, of the techniques considered, edge-enhancing anisotropic diusion ltering is most suit- able, although the practical use of this technique may currently be limited due to its memory and computation-time requirements. Finally, Chapter 6 addresses the problem of interpolation of sampled data, which occurs e.g. when applying geometrical transformations to digital medical images for the purpose of registration or visualization. In most practical situations, interpola- tion of a sampled image followed by resampling of the resulting continuous image on a geometrically transformed grid, inevitably implies loss of grey-level information, and hence image degradation, the amount of which is dependent on image content, but also on the employed interpolation scheme (see Fig. 1.3). It follows that the choice for a particular interpolation scheme is important, since it in uences the re- sults of registrations and visualizations, and the outcome of subsequent quantitative analyses which rely on grey-level information contained in transformed images. Al- though many interpolation techniques have been developed over the past decades, 6 1 Introduction and Summary Figure 1.3. Illustration of the fact that the loss of information due to interpola- tion and resampling operations is dependent on the employed interpolation scheme. Left: slice of a 3DRA image after rotation over 5:0, by using linear interpolation. Middle: the same slice, after rotation by using cubic spline interpolation. Right: the dierence between the two rotated images. Although it is not possible with such a comparison to come to conclusions as to which of the two methods yields the smallest loss of grey-level information, this example clearly illustrates the point that dierent interpolation methods usually yield dierent results. thorough quantitative evaluations and comparisons of these techniques for medical image transformation problems are still lacking. Chapter 6 presents such a compar- ative evaluation. The study is limited to convolution-based interpolation techniques, as these are most frequently used for registration and visualization of medical image data. Because of the ubiquitousness of interpolation in medical image processing and analysis, the study is not restricted to XRA and 3DRA images, but also includes datasets from many other modalities. It is concluded that for all modalities, spline interpolation constitutes the best trade-o between accuracy and computational cost, and therefore is to be preferred over all other methods. In summary, this thesis is concerned with the improvement of image quality and the reduction of image quality degradation and loss of quantitative information. The subsequent chapters describe techniques for reduction of patient motion artifacts in DSA images, noise reduction techniques for improved visualization and quantication of vascular anomalies in 3DRA images, and interpolation techniques for the purpose of accurate geometrical transformation of medical image data. The results and con- clusions of the evaluations described in this thesis provide general guidelines for the applicability and practical use of these techniques

Model-driven segmentation of X-ray left ventricular angiograms

X-ray left ventricular (LV) angiography is an important imaging modality to assess cardiac function. Using a contrast fluid a 2D projection of the heart is obtained. In current clinical practice cardiac function is analyzed by drawing two contours manually: one in the end diastolic (ED) phase and one in the end systolic (ES) phase. From the contours the LV volumes in these phases are calculated and the patient__s ejection fraction is assessed. Drawing these contours manually is a cumbersome and time-consuming task for a medical doctor. Furthermore, manual drawing introduces inter- and intra-observer variabilities. The focus of the research presented in this thesis was to automate the process of contour drawing in X-ray LV angiography. The developed method is based on Active Appearance Models. These statistical models, in which the cardiac shape and the cardiac appearance are modeled, have proven to be able to mimic the drawing behavior of an expert cardiologist. The clinical parameters, as determined by the automated method, showed a similar degree of accuracy as when determined by an expert. Furthermore, the required time for patient analysis was reduced considerably and the inter- and intra-observer variabilities were structurally decreased.UBL - phd migration 201

High-performance geometric vascular modelling

Image-based high-performance geometric vascular modelling and reconstruction is an essential component of computer-assisted surgery on the diagnosis, analysis and treatment of cardiovascular diseases. However, it is an extremely challenging task to efficiently reconstruct the accurate geometric structures of blood vessels out of medical images. For one thing, the shape of an individual section of a blood vessel is highly irregular because of the squeeze of other tissues and the deformation caused by vascular diseases. For another, a vascular system is a very complicated network of blood vessels with different types of branching structures. Although some existing vascular modelling techniques can reconstruct the geometric structure of a vascular system, they are either time-consuming or lacking sufficient accuracy. What is more, these techniques rarely consider the interior tissue of the vascular wall, which consists of complicated layered structures. As a result, it is necessary to develop a better vascular geometric modelling technique, which is not only of high performance and high accuracy in the reconstruction of vascular surfaces, but can also be used to model the interior tissue structures of the vascular walls.This research aims to develop a state-of-the-art patient-specific medical image-based geometric vascular modelling technique to solve the above problems. The main contributions of this research are:- Developed and proposed the Skeleton Marching technique to reconstruct the geometric structures of blood vessels with high performance and high accuracy. With the proposed technique, the highly complicated vascular reconstruction task is reduced to a set of simple localised geometric reconstruction tasks, which can be carried out in a parallel manner. These locally reconstructed vascular geometric segments are then combined together using shape-preserving blending operations to faithfully represent the geometric shape of the whole vascular system.- Developed and proposed the Thin Implicit Patch method to realistically model the interior geometric structures of the vascular tissues. This method allows the multi-layer interior tissue structures to be embedded inside the vascular wall to illustrate the geometric details of the blood vessel in real world

3D reconstruction of coronary arteries from angiographic sequences for interventional assistance

Introduction -- Review of literature -- Research hypothesis and objectives -- Methodology -- Results and discussion -- Conclusion and future perspectives