Automatic Affine and Elastic Registration Strategies for Multi-dimensional Medical Images

Medical images have been used increasingly for diagnosis, treatment planning, monitoring disease processes, and other medical applications. A large variety of medical imaging modalities exists including CT, X-ray, MRI, Ultrasound, etc. Frequently a group of images need to be compared to one another and/or combined for research or cumulative purposes. In many medical studies, multiple images are acquired from subjects at different times or with different imaging modalities. Misalignment inevitably occurs, causing anatomical and/or functional feature shifts within the images. Computerized image registration (alignment) approaches can offer automatic and accurate image alignments without extensive user involvement and provide tools for visualizing combined images. This dissertation focuses on providing automatic image registration strategies. After a through review of existing image registration techniques, we identified two registration strategies that enhance the current field: (1) an automated rigid body and affine registration using voxel similarity measurements based on a sequential hybrid genetic algorithm, and (2) an automated deformable registration approach based upon a linear elastic finite element formulation. Both methods streamlined the registration process. They are completely automatic and require no user intervention. The proposed registration strategies were evaluated with numerous 2D and 3D MR images with a variety of tissue structures, orientations and dimensions. Multiple registration pathways were provided with guidelines for their applications. The sequential genetic algorithm mimics the pathway of an expert manually doing registration. Experiments demonstrated that the sequential genetic algorithm registration provides high alignment accuracy and is reliable for brain tissues. It avoids local minima/maxima traps of conventional optimization techniques, and does not require any preprocessing such as threshold, smoothing, segmentation, or definition of base points or edges. The elastic model was shown to be highly effective to accurately align areas of interest that are automatically extracted from the images, such as brains. Using a finite element method to get the displacement of each element node by applying a boundary mapping, this method provides an accurate image registration with excellent boundary alignment of each pair of slices and consequently align the entire volume automatically. This dissertation presented numerous volume alignments. Surface geometries were created directly from the aligned segmented images using the Multiple Material Marching Cubes algorithm. Using the proposed registration strategies, multiple subjects were aligned to a standard MRI reference, which is aligned to a segmented reference atlas. Consequently, multiple subjects are aligned to the segmented atlas and a full fMRI analysis is possible

Towards multiple 3D bone surface identification and reconstruction using few 2D X-ray images for intraoperative applications

This article discusses a possible method to use a small number, e.g. 5, of conventional 2D X-ray images to reconstruct multiple 3D bone surfaces intraoperatively. Each bone’s edge contours in X-ray images are automatically identified. Sparse 3D landmark points of each bone are automatically reconstructed by pairing the 2D X-ray images. The reconstructed landmark point distribution on a surface is approximately optimal covering main characteristics of the surface. A statistical shape model, dense point distribution model (DPDM), is then used to fit the reconstructed optimal landmarks vertices to reconstruct a full surface of each bone separately. The reconstructed surfaces can then be visualised and manipulated by surgeons or used by surgical robotic systems

Semi-Automatic Segmentation of Normal Female Pelvic Floor Structures from Magnetic Resonance Images

Stress urinary incontinence (SUI) and pelvic organ prolapse (POP) are important health issues affecting millions of American women. Investigation of the cause of SUI and POP requires a better understand of the anatomy of female pelvic floor. In addition, pre-surgical planning and individualized treatment plans require development of patient-specific three-dimensional or virtual reality models. The biggest challenge in building those models is to segment pelvic floor structures from magnetic resonance images because of their complex shapes, which make manual segmentation labor-intensive and inaccurate. In this dissertation, a quick and reliable semi-automatic segmentation method based on a shape model is proposed. The model is built on statistical analysis of the shapes of structures in a training set. A local feature map of the target image is obtained by applying a filtering pipeline, including contrast enhancement, noise reduction, smoothing, and edge extraction. With the shape model and feature map, automatic segmentation is performed by matching the model to the border of the structure using an optimization technique called evolution strategy. Segmentation performance is evaluated by calculating a similarity coefficient between semi-automatic and manual segmentation results. Taguchi analysis is performed to investigate the significance of segmentation parameters and provide tuning trends for better performance. The proposed method was successfully tested on both two-dimensional and three-dimensional image segmentation using the levator ani and obturator muscles as examples. Although the method is designed for segmentation of female pelvic floor structures, it can also be applied to other structures or organs without large shape variatio

Semi-Automatic Segmentation of Normal Female Pelvic Floor Structures from Magnetic Resonance Images

Stress urinary incontinence (SUI) and pelvic organ prolapse (POP) are important health issues affecting millions of American women. Investigation of the cause of SUI and POP requires a better understand of the anatomy of female pelvic floor. In addition, pre-surgical planning and individualized treatment plans require development of patient-specific three-dimensional or virtual reality models. The biggest challenge in building those models is to segment pelvic floor structures from magnetic resonance images because of their complex shapes, which make manual segmentation labor-intensive and inaccurate. In this dissertation, a quick and reliable semi-automatic segmentation method based on a shape model is proposed. The model is built on statistical analysis of the shapes of structures in a training set. A local feature map of the target image is obtained by applying a filtering pipeline, including contrast enhancement, noise reduction, smoothing, and edge extraction. With the shape model and feature map, automatic segmentation is performed by matching the model to the border of the structure using an optimization technique called evolution strategy. Segmentation performance is evaluated by calculating a similarity coefficient between semi-automatic and manual segmentation results. Taguchi analysis is performed to investigate the significance of segmentation parameters and provide tuning trends for better performance. The proposed method was successfully tested on both two-dimensional and three-dimensional image segmentation using the levator ani and obturator muscles as examples. Although the method is designed for segmentation of female pelvic floor structures, it can also be applied to other structures or organs without large shape variatio

Semi-Automatic Segmentation of Normal Female Pelvic Floor Structures from Magnetic Resonance Images

Stress urinary incontinence (SUI) and pelvic organ prolapse (POP) are important health issues affecting millions of American women. Investigation of the cause of SUI and POP requires a better understand of the anatomy of female pelvic floor. In addition, pre-surgical planning and individualized treatment plans require development of patient-specific three-dimensional or virtual reality models. The biggest challenge in building those models is to segment pelvic floor structures from magnetic resonance images because of their complex shapes, which make manual segmentation labor-intensive and inaccurate. In this dissertation, a quick and reliable semi-automatic segmentation method based on a shape model is proposed. The model is built on statistical analysis of the shapes of structures in a training set. A local feature map of the target image is obtained by applying a filtering pipeline, including contrast enhancement, noise reduction, smoothing, and edge extraction. With the shape model and feature map, automatic segmentation is performed by matching the model to the border of the structure using an optimization technique called evolution strategy. Segmentation performance is evaluated by calculating a similarity coefficient between semi-automatic and manual segmentation results. Taguchi analysis is performed to investigate the significance of segmentation parameters and provide tuning trends for better performance. The proposed method was successfully tested on both two-dimensional and three-dimensional image segmentation using the levator ani and obturator muscles as examples. Although the method is designed for segmentation of female pelvic floor structures, it can also be applied to other structures or organs without large shape variatio

High Dimensional Classification of Structural MRI Alzheimer’s Disease Data Based on Large Scale Regularization

In this work we use a large scale regularization approach based on penalized logistic regression to automatically classify structural MRI images (sMRI) according to cognitive status. Its performance is illustrated using sMRI data from the Alzheimer Disease Neuroimaging Initiative (ADNI) clinical database. We downloaded sMRI data from 98 subjects (49 cognitive normal and 49 patients) matched by age and sex from the ADNI website. Images were segmented and normalized using SPM8 and ANTS software packages. Classification was performed using GLMNET library implementation of penalized logistic regression based on coordinate-wise descent optimization techniques. To avoid optimistic estimates classification accuracy, sensitivity, and specificity were determined based on a combination of three-way split of the data with nested 10-fold cross-validations. One of the main features of this approach is that classification is performed based on large scale regularization. The methodology presented here was highly accurate, sensitive, and specific when automatically classifying sMRI images of cognitive normal subjects and Alzheimer disease (AD) patients. Higher levels of accuracy, sensitivity, and specificity were achieved for gray matter (GM) volume maps (85.7, 82.9, and 90%, respectively) compared to white matter volume maps (81.1, 80.6, and 82.5%, respectively). We found that GM and white matter tissues carry useful information for discriminating patients from cognitive normal subjects using sMRI brain data. Although we have demonstrated the efficacy of this voxel-wise classification method in discriminating cognitive normal subjects from AD patients, in principle it could be applied to any clinical population

Computerized Analysis of Magnetic Resonance Images to Study Cerebral Anatomy in Developing Neonates

The study of cerebral anatomy in developing neonates is of great importance for the understanding of brain development during the early period of life. This dissertation therefore focuses on three challenges in the modelling of cerebral anatomy in neonates during brain development. The methods that have been developed all use Magnetic Resonance Images (MRI) as source data. To facilitate study of vascular development in the neonatal period, a set of image analysis algorithms are developed to automatically extract and model cerebral vessel trees. The whole process consists of cerebral vessel tracking from automatically placed seed points, vessel tree generation, and vasculature registration and matching. These algorithms have been tested on clinical Time-of- Flight (TOF) MR angiographic datasets. To facilitate study of the neonatal cortex a complete cerebral cortex segmentation and reconstruction pipeline has been developed. Segmentation of the neonatal cortex is not effectively done by existing algorithms designed for the adult brain because the contrast between grey and white matter is reversed. This causes pixels containing tissue mixtures to be incorrectly labelled by conventional methods. The neonatal cortical segmentation method that has been developed is based on a novel expectation-maximization (EM) method with explicit correction for mislabelled partial volume voxels. Based on the resulting cortical segmentation, an implicit surface evolution technique is adopted for the reconstruction of the cortex in neonates. The performance of the method is investigated by performing a detailed landmark study. To facilitate study of cortical development, a cortical surface registration algorithm for aligning the cortical surface is developed. The method first inflates extracted cortical surfaces and then performs a non-rigid surface registration using free-form deformations (FFDs) to remove residual alignment. Validation experiments using data labelled by an expert observer demonstrate that the method can capture local changes and follow the growth of specific sulcus

Temporal - spatial recognizer for multi-label data

Pattern recognition is an important artificial intelligence task with practical applications in many fields such as medical and species distribution. Such application involves overlapping data points which are demonstrated in the multi- label dataset. Hence, there is a need for a recognition algorithm that can separate the overlapping data points in order to recognize the correct pattern. Existing recognition methods suffer from sensitivity to noise and overlapping points as they could not recognize a pattern when there is a shift in the position of the data points. Furthermore, the methods do not implicate temporal information in the process of recognition, which leads to low quality of data clustering. In this study, an improved pattern recognition method based on Hierarchical Temporal Memory (HTM) is proposed to solve the overlapping in data points of multi- label dataset. The imHTM (Improved HTM) method includes improvement in two of its components; feature extraction and data clustering. The first improvement is realized as TS-Layer Neocognitron algorithm which solves the shift in position problem in feature extraction phase. On the other hand, the data clustering step, has two improvements, TFCM and cFCM (TFCM with limit- Chebyshev distance metric) that allows the overlapped data points which occur in patterns to be separated correctly into the relevant clusters by temporal clustering. Experiments on five datasets were conducted to compare the proposed method (imHTM) against statistical, template and structural pattern recognition methods. The results showed that the percentage of success in recognition accuracy is 99% as compared with the template matching method (Featured-Based Approach, Area-Based Approach), statistical method (Principal Component Analysis, Linear Discriminant Analysis, Support Vector Machines and Neural Network) and structural method (original HTM). The findings indicate that the improved HTM can give an optimum pattern recognition accuracy, especially the ones in multi- label dataset

Deformable Medical Image Registration: A Survey

Deformable image registration is a fundamental task in medical image processing. Among its most important applications, one may cite: i) multi-modality fusion, where information acquired by different imaging devices or protocols is fused to facilitate diagnosis and treatment planning; ii) longitudinal studies, where temporal structural or anatomical changes are investigated; and iii) population modeling and statistical atlases used to study normal anatomical variability. In this technical report, we attempt to give an overview of deformable registration methods, putting emphasis on the most recent advances in the domain. Additional emphasis has been given to techniques applied to medical images. In order to study image registration methods in depth, their main components are identified and studied independently. The most recent techniques are presented in a systematic fashion. The contribution of this technical report is to provide an extensive account of registration techniques in a systematic manner.Le recalage déformable d'images est une des tâches les plus fondamentales dans l'imagerie médicale. Parmi ses applications les plus importantes, on compte: i) la fusion d' information provenant des différents types de modalités a n de faciliter le diagnostic et la planification du traitement; ii) les études longitudinales, oú des changements structurels ou anatomiques sont étudiées en fonction du temps; et iii) la modélisation de la variabilité anatomique normale d'une population et les atlas statistiques. Dans ce rapport de recherche, nous essayons de donner un aperçu des différentes méthodes du recalage déformables, en mettant l'accent sur les avancées les plus récentes du domaine. Nous avons particulièrement insisté sur les techniques appliquées aux images médicales. A n d'étudier les méthodes du recalage d'images, leurs composants principales sont d'abord identifiés puis étudiées de manière indépendante, les techniques les plus récentes étant classifiées en suivant un schéma logique déterminé. La contribution de ce rapport de recherche est de fournir un compte rendu détaillé des techniques de recalage d'une manière systématique