A Rigid Image Registration Based on the Nonsubsampled Contourlet Transform and Genetic Algorithms

Image registration is a fundamental task used in image processing to match two or more images taken at different times, from different sensors or from different viewpoints. The objective is to find in a huge search space of geometric transformations, an acceptable accurate solution in a reasonable time to provide better registered images. Exhaustive search is computationally expensive and the computational cost increases exponentially with the number of transformation parameters and the size of the data set. In this work, we present an efficient image registration algorithm that uses genetic algorithms within a multi-resolution framework based on the Non-Subsampled Contourlet Transform (NSCT). An adaptable genetic algorithm for registration is adopted in order to minimize the search space. This approach is used within a hybrid scheme applying the two techniques fitness sharing and elitism. Two NSCT based methods are proposed for registration. A comparative study is established between these methods and a wavelet based one. Because the NSCT is a shift-invariant multidirectional transform, the second method is adopted for its search speeding up property. Simulation results clearly show that both proposed techniques are really promising methods for image registration compared to the wavelet approach, while the second technique has led to the best performance results of all. Moreover, to demonstrate the effectiveness of these methods, these registration techniques have been successfully applied to register SPOT, IKONOS and Synthetic Aperture Radar (SAR) images. The algorithm has been shown to work perfectly well for multi-temporal satellite images as well, even in the presence of noise

Advanced Algorithms for 3D Medical Image Data Fusion in Specific Medical Problems

Fúze obrazu je dnes jednou z nejběžnějších avšak stále velmi diskutovanou oblastí v lékařském zobrazování a hraje důležitou roli ve všech oblastech lékařské péče jako je diagnóza, léčba a chirurgie. V této dizertační práci jsou představeny tři projekty, které jsou velmi úzce spojeny s oblastí fúze medicínských dat. První projekt pojednává o 3D CT subtrakční angiografii dolních končetin. V práci je využito kombinace kontrastních a nekontrastních dat pro získání kompletního cévního stromu. Druhý projekt se zabývá fúzí DTI a T1 váhovaných MRI dat mozku. Cílem tohoto projektu je zkombinovat stukturální a funkční informace, které umožňují zlepšit znalosti konektivity v mozkové tkáni. Třetí projekt se zabývá metastázemi v CT časových datech páteře. Tento projekt je zaměřen na studium vývoje metastáz uvnitř obratlů ve fúzované časové řadě snímků. Tato dizertační práce představuje novou metodologii pro klasifikaci těchto metastáz. Všechny projekty zmíněné v této dizertační práci byly řešeny v rámci pracovní skupiny zabývající se analýzou lékařských dat, kterou vedl pan Prof. Jiří Jan. Tato dizertační práce obsahuje registrační část prvního a klasifikační část třetího projektu. Druhý projekt je představen kompletně. Další část prvního a třetího projektu, obsahující specifické předzpracování dat, jsou obsaženy v disertační práci mého kolegy Ing. Romana Petera.Image fusion is one of today´s most common and still challenging tasks in medical imaging and it plays crucial role in all areas of medical care such as diagnosis, treatment and surgery. Three projects crucially dependent on image fusion are introduced in this thesis. The first project deals with the 3D CT subtraction angiography of lower limbs. It combines pre-contrast and contrast enhanced data to extract the blood vessel tree. The second project fuses the DTI and T1-weighted MRI brain data. The aim of this project is to combine the brain structural and functional information that purvey improved knowledge about intrinsic brain connectivity. The third project deals with the time series of CT spine data where the metastases occur. In this project the progression of metastases within the vertebrae is studied based on fusion of the successive elements of the image series. This thesis introduces new methodology of classifying metastatic tissue. All the projects mentioned in this thesis have been solved by the medical image analysis group led by Prof. Jiří Jan. This dissertation concerns primarily the registration part of the first project and the classification part of the third project. The second project is described completely. The other parts of the first and third project, including the specific preprocessing of the data, are introduced in detail in the dissertation thesis of my colleague Roman Peter, M.Sc.

Feasibility of using Lodox to perform digital subtraction angiography

Bibliography: leaves 150-157.Many cases in trauma involve vessel imaging to determine integrity and the origin of lesions or blockages. Digital subtraction angiography (DSA) is a tool used to improve the clarity of the vessels being imaged for better and easier decision making in diagnostics and planning. Lodox, a low dose x-ray system developed by Debex (Pty) Ltd, a subsidiary of de Beers, was designed specifically for the trauma environment. It therefore follows that, if possible, a function so readily used in trauma, such as DSA, should be added to the imaging repertoire of an x-ray system designed for use in this environment. In this dissertation the feasibility of using Lodox to perform DSA is therefore explored. In doing so, the requirements of a trauma unit and the theory behind DSA were researched so as to obtain a better understanding into what would be required

Automated detection of brain abnormalities in neonatal hypoxia ischemic injury from MR images.

We compared the efficacy of three automated brain injury detection methods, namely symmetry-integrated region growing (SIRG), hierarchical region splitting (HRS) and modified watershed segmentation (MWS) in human and animal magnetic resonance imaging (MRI) datasets for the detection of hypoxic ischemic injuries (HIIs). Diffusion weighted imaging (DWI, 1.5T) data from neonatal arterial ischemic stroke (AIS) patients, as well as T2-weighted imaging (T2WI, 11.7T, 4.7T) at seven different time-points (1, 4, 7, 10, 17, 24 and 31 days post HII) in rat-pup model of hypoxic ischemic injury were used to assess the temporal efficacy of our computational approaches. Sensitivity, specificity, and similarity were used as performance metrics based on manual ('gold standard') injury detection to quantify comparisons. When compared to the manual gold standard, automated injury location results from SIRG performed the best in 62% of the data, while 29% for HRS and 9% for MWS. Injury severity detection revealed that SIRG performed the best in 67% cases while 33% for HRS. Prior information is required by HRS and MWS, but not by SIRG. However, SIRG is sensitive to parameter-tuning, while HRS and MWS are not. Among these methods, SIRG performs the best in detecting lesion volumes; HRS is the most robust, while MWS lags behind in both respects

Fusion and Analysis of Multidimensional Medical Image Data

Analýza medicínských obrazů je předmětem základního výzkumu již řadu let. Za tu dobu bylo v této oblasti publikováno mnoho výzkumných prací zabývajících se dílčími částmi jako je rekonstrukce obrazů, restaurace, segmentace, klasifikace, registrace (lícování) a fúze. Kromě obecného úvodu, pojednává tato disertační práce o dvou medicínsky orientovaných tématech, jež byla formulována ve spolupráci s Philips Netherland BV, divizí Philips Healthcare. První téma je zaměřeno na oblast zpracování obrazů subtrakční angiografie dolních končetin člověka získaných pomocí výpočetní X-Ray tomografie (CT). Subtrakční angiografie je obvykle využívaná při podezření na periferní cévní onemocnění (PAOD) nebo při akutním poškození dolních končetin jako jsou fraktury apod. Současné komerční metody nejsou dostatečně spolehlivé už v předzpracování, jako je například odstranění pacientského stolu, pokrývky, dlahy, apod. Spolehlivost a přesnost identifikace cév v subtrahovaných datech vedoucích v blízkosti kostí je v důsledku Partial Volume artefaktu rovněž nízká. Automatické odstranění kalcifikací nebo detekce malých cév doplňujících nezbytnou informaci o náhradním zásobení dolních končetin krví v případě přerušení hlavních zásobujících cév v současné době rovněž nesplňují kritéria pro plně automatické zpracování. Proto hlavním cílem týkající se tohoto tématu bylo vyvinout automatický systém, který by mohl současné nedostatky v CTSA vyšetření odstranit. Druhé téma je orientováno na identifikaci patologických změn na páteři člověka v CT obrazech se zaměřením na osteolytické a osteoblastické léze u jednotlivých obratlů. Tyto změny obvykle nastávají v důsledků postižení metastazujícím procesem rakovinového onemocnění. Pro detekci patologických změn je pak potřeba identifikace a segmentace jednotlivých obratlů. Přesnost analýzy jednotlivých lézí však závisí rovněž na správné identifikaci těla a zadních segmentů u jednotlivých obratlů a na segmentaci trabekulárního centra obratlů, tj. odstranění kortikální kosti. Během léčby mohou být pacienti skenováni vícekrát, obvykle s několika-mesíčním odstupem. Hodnocení případného vývoje již detekovaných patologických změn pak logicky vychází ze správné detekce patologií v jednotlivých obratlech korespondujících si v jednotlivých akvizicích. Jelikož jsou příslušné obratle v jednotlivých akvizicích obvykle na různé pozici, jejich fúze, vedoucí k analýze časového vývoje detekovaných patologií, je komplikovaná. Požadovaným výsledkem v tomto tématu je vytvoření komplexního systému pro detekci patologických změn v páteři, především osteoblastických a osteolytických lézí. Takový systém tedy musí umožnovat jak segmentaci jednotlivých obratlů, jejich automatické rozdělení na hlavní části a odstranění kortikální kosti, tak také detekci patologických změn a jejich hodnocení. Ačkoliv je tato disertační práce v obou výše zmíněných tématech primárně zaměřena na experimentální část zpracování medicínských obrazů, zabývá se všemi nezbytnými kroky, jako je předzpracování, registrace, dodatečné zpracování a hodnocení výsledků, vedoucími k možné aplikovatelnosti obou systému v klinické praxi. Jelikož oba systémy byly řešeny v rámci týmové spolupráce jako celek, u obou témat jsou pro některé konkrétní kroky uvedeny odkazy na doktorskou práci Miloše Malínského.Analysis of medical images has been subject of basic research for many years. Many research papers have been published in the field related to image analysis and focused on partial aspects such as reconstruction, restoration, segmentation and classification, registration (spatial alignment) and fusion. Besides the introduction of related general concepts used in medical image processing, this thesis deals with two specific medical problems formulated in cooperation with Philips Netherland BV, Philips Healthcare division. The first topic is focused on subtraction angiography in patients’ lower legs utilizing image data from X-Ray computed tomography (CT). CT subtraction angiography (CTSA) is typically used for indication of the Peripheral Artery Occlusive Disease (PAOD) and for examination of acute injuries of lower legs such as acute fractures, etc. Current methods in clinical praxis are not sufficient regarding the pre-processing such as masking of patient desk, cover, splint, etc. The subtraction of blood vessels adjacent to neighboring bones in lower legs is of low accuracy due to the Partial Volume artifact. Masking of calcifications and detection of tiny blood vessels complementing necessary information about the alternative blood supply in lower legs in case of obstruction in main arteries is also not reliable for fully automated process presently. Therefore, the main aim regarding this topic was to develop an automated framework that could overcome current shortcomings in CTSA examination. The second topic is oriented on the identification and evaluation of pathologic changes in human spine, focusing on osteolytic and osteoblastic lesions in individual vertebrae in CT images. Such changes occur typically as a consequence of metastasizing process of cancerous disease. For the detection of pathologic changes, an identification and segmentation of individual vertebrae is necessary. Moreover, the analysis of individual lesions in vertebrae depends also on correct identification of vertebral body and posterior segments of each vertebra, and on segmentation of their trabecular centers. Patients are typically examined more than once during their therapy. Then, the evaluation of possible tumorous progression is based on accurate detection of pathologies in individual vertebrae in the base-line and corresponding follow-up images. Since the corresponding vertebrae are in mutually different positions in the follow-up images, their fusion leading to the analysis of the lesion progression is complicated. The main aim regarding this topic is to develop a complex framework for detection of pathologic lesions on spine, with the main focus on osteoblastic and osteolystic lesions. Such system has to provide not only reliable segmentation of individual vertebrae and detection of their main regions but also the masking of their cortical bone, detection of their pathologic changes and their evaluation. Although this dissertation thesis is primarily oriented at the experimental part of medical image processing considering both the above mentioned topics, it deals with all necessary processing steps, i.e. preprocessing, image registration, post-processing and evaluation of results, leading to the future use of both frameworks in clinical practice. Since both frameworks were developed in a team, there are some chapters referring to the dissertation thesis of Milos Malinsky.

Coronary Artery Segmentation and Motion Modelling

Conventional coronary artery bypass surgery requires invasive sternotomy and the use of a cardiopulmonary bypass, which leads to long recovery period and has high infectious potential. Totally endoscopic coronary artery bypass (TECAB) surgery based on image guided robotic surgical approaches have been developed to allow the clinicians to conduct the bypass surgery off-pump with only three pin holes incisions in the chest cavity, through which two robotic arms and one stereo endoscopic camera are inserted. However, the restricted field of view of the stereo endoscopic images leads to possible vessel misidentification and coronary artery mis-localization. This results in 20-30% conversion rates from TECAB surgery to the conventional approach. We have constructed patient-specific 3D + time coronary artery and left ventricle motion models from preoperative 4D Computed Tomography Angiography (CTA) scans. Through temporally and spatially aligning this model with the intraoperative endoscopic views of the patient's beating heart, this work assists the surgeon to identify and locate the correct coronaries during the TECAB precedures. Thus this work has the prospect of reducing the conversion rate from TECAB to conventional coronary bypass procedures. This thesis mainly focus on designing segmentation and motion tracking methods of the coronary arteries in order to build pre-operative patient-specific motion models. Various vessel centreline extraction and lumen segmentation algorithms are presented, including intensity based approaches, geometric model matching method and morphology-based method. A probabilistic atlas of the coronary arteries is formed from a group of subjects to facilitate the vascular segmentation and registration procedures. Non-rigid registration framework based on a free-form deformation model and multi-level multi-channel large deformation diffeomorphic metric mapping are proposed to track the coronary motion. The methods are applied to 4D CTA images acquired from various groups of patients and quantitatively evaluated

Image quality of energy-dependent approaches for x-ray angiography

Digital subtraction angiography (DSA) is an x-ray-based imaging method widely used for diagnosis and treatment of patients with vascular disease. This technique uses subtraction of images acquired before and after injection of an iodinated contrast agent to generate iodine-specific images. While it is extremely successful at imaging structures that are near-stationary over a period of several seconds, motion artifacts can result in poor image quality with uncooperative patients and DSA is rarely used for coronary applications. Alternative methods of generating iodine-specific images with reduced motion artifacts might exploit the energy-dependence of x-ray attenuation in a patient. This could be performed either by aquiring two or more post-injection images at different x-ray energies or from an analysis of the spectral shape of the transmitted spectrum. The first method, which we call energy-subtraction angiography (ESA), was introduced as a dual-energy alternative to DSA over two decades ago but technological limitations of the time resulted in poor image quality. The second potential method, energy-resolved angiography (ERA), requires energy-resolving photon-counting (EPC) x-ray detectors that are under development in a number of laboratories. The goals of this thesis were to: 1) develop a method of comparing image quality in terms of signal-to-noise ratio (SNR) obtained using ESA and ERA with DSA assuming ideal instrumentation for each; 2) develop a method of describing performance and image quality that can be obtained in practice with photon-counting detectors, and; 3) assess the potential of ESA and ERA by comparing the available iodine SNR with that of DSA including the effects of non-ideal detector performance. It is shown that using ideal instrumentation both ESA and ERA can provide iodine-specific images with SNR equal to that of DSA. However, stochastic x-ray interaction and detection processes will degrade SNR obtained with ERA and ESA to a larger extent than DSA. Energy-resolved angiography will achieve near-ideal performance only with low detector electronic noise levels, high collection efficiency of secondary quanta liberated in the detector, and low Compton cross sections. It is concluded that, when these conditions are satsified, ESA and ERA can provide iodine SNR within 25% of that of DSA for the same patient entrance exposure, and therefore may provide alternatives to DSA in situations where motion artifacts are expected to result in compromised DSA procedures, such as in coronary applications. This could have important applications for subtraction imaging of the coronary arteries in the near future

Object Tracking

Object tracking consists in estimation of trajectory of moving objects in the sequence of images. Automation of the computer object tracking is a difficult task. Dynamics of multiple parameters changes representing features and motion of the objects, and temporary partial or full occlusion of the tracked objects have to be considered. This monograph presents the development of object tracking algorithms, methods and systems. Both, state of the art of object tracking methods and also the new trends in research are described in this book. Fourteen chapters are split into two sections. Section 1 presents new theoretical ideas whereas Section 2 presents real-life applications. Despite the variety of topics contained in this monograph it constitutes a consisted knowledge in the field of computer object tracking. The intention of editor was to follow up the very quick progress in the developing of methods as well as extension of the application

Blur Invariants for Image Recognition

Blur is an image degradation that is difficult to remove. Invariants with respect to blur offer an alternative way of a~description and recognition of blurred images without any deblurring. In this paper, we present an original unified theory of blur invariants. Unlike all previous attempts, the new theory does not require any prior knowledge of the blur type. The invariants are constructed in the Fourier domain by means of orthogonal projection operators and moment expansion is used for efficient and stable computation. It is shown that all blur invariants published earlier are just particular cases of this approach. Experimental comparison to concurrent approaches shows the advantages of the proposed theory.Comment: 15 page