A comparative evaluation of 3 different free-form deformable image registration and contour propagation methods for head and neck MRI : the case of parotid changes radiotherapy

Purpose: To validate and compare the deformable image registration and parotid contour propagation process for head and neck magnetic resonance imaging in patients treated with radiotherapy using 3 different approachesthe commercial MIM, the open-source Elastix software, and an optimized version of it. Materials and Methods: Twelve patients with head and neck cancer previously treated with radiotherapy were considered. Deformable image registration and parotid contour propagation were evaluated by considering the magnetic resonance images acquired before and after the end of the treatment. Deformable image registration, based on free-form deformation method, and contour propagation available on MIM were compared to Elastix. Two different contour propagation approaches were implemented for Elastix software, a conventional one (DIR_Trx) and an optimized homemade version, based on mesh deformation (DIR_Mesh). The accuracy of these 3 approaches was estimated by comparing propagated to manual contours in terms of average symmetric distance, maximum symmetric distance, Dice similarity coefficient, sensitivity, and inclusiveness. Results: A good agreement was generally found between the manual contours and the propagated ones, without differences among the 3 methods; in few critical cases with complex deformations, DIR_Mesh proved to be more accurate, having the lowest values of average symmetric distance and maximum symmetric distance and the highest value of Dice similarity coefficient, although nonsignificant. The average propagation errors with respect to the reference contours are lower than the voxel diagonal (2 mm), and Dice similarity coefficient is around 0.8 for all 3 methods. Conclusion: The 3 free-form deformation approaches were not significantly different in terms of deformable image registration accuracy and can be safely adopted for the registration and parotid contour propagation during radiotherapy on magnetic resonance imaging. More optimized approaches (as DIR_Mesh) could be preferable for critical deformations

Image databases in medical applications

The number of medical images acquired yearly in hospitals increases all the time. These imaging data contain lots of information on the characteristics of anatomical structures and on their variations. This information can be utilized in numerous medical applications. In deformable model-based segmentation and registration methods, the information in the image databases can be used to give a priori information on the shape of the object studied and the gray-level values in the image, and on their variations. On the other hand, by studying the variations of the object of interest in different populations, the effects of, for example, aging, gender, and diseases on anatomical structures can be detected. In the work described in this Thesis, methods that utilize image databases in medical applications were studied. Methods were developed and compared for deformable model-based segmentation and registration. Model selection procedure, mean models, and combination of classifiers were studied for the construction of a good a priori model. Statistical and probabilistic shape models were generated to constrain the deformations in segmentation and registration so that only the shapes typical to the object studied were accepted. In the shape analysis of the striatum, both volume and local shape changes were studied. The effects of aging and gender, and also the asymmetries were examined. The results proved that the segmentation and registration accuracy of deformable model-based methods can be improved by utilizing the information in image databases. The databases used were relatively small. Therefore, the statistical and probabilistic methods were not able to model all the population-specific variation. On the other hand, the simpler methods, the model selection procedure, mean models, and combination of classifiers, gave good results also with the small image databases. Two main applications were the reconstruction of 3-D geometry from incomplete data and the segmentation of heart ventricles and atria from short- and long-axis magnetic resonance images. In both applications, the methods studied provided promising results. The shape analysis of the striatum showed that the volume of the striatum decreases in aging. Also, the shape of the striatum changes locally. Asymmetries in the shape were found, too, but any gender-related local shape differences were not found.reviewe

Robust Algorithms for Registration of 3D Images of Human Brain

This thesis is concerned with the process of automatically aligning 3D medical images of human brain. It concentrates on rigid-body matching of Positron Emission Tomography images (PET) and Magnetic Resonance images (MR) within one patient and on non-linear matching of PET images of different patients. In recent years, mutual information has proved to be an excellent criterion for automatic registration of intra-individual images from different modalities. We propose and evaluate a method that combines a multi-resolution optimization of mutual information with an efficient segmentation of background voxels and a modified principal axes algorithm. We show that an acceleration factor of 6-7 can be achieved without loss of accuracy and that the method significantly reduces the rate of unsuccessful registrations. Emphasis was also laid on creation of an automatic registration system that could be used routinely in clinical environment. Non-linear registration tries to reduce the inter-individual variability of shape and structure between two brain images by deforming one image so that homologous regions in both images get aligned. It is an important step of many procedures in medical image processing and analysis. We present a novel algorithm for an automatic non-linear registration of PET images based on hierarchical volume subdivisions and local affine optimizations. It produces a C2-continuous deformation function and guarantees that the deformation is one-to-one. Performance of the algorithm was evaluated on more than 600 clinical PET images

Sub-pixel Registration In Computational Imaging And Applications To Enhancement Of Maxillofacial Ct Data

In computational imaging, data acquired by sampling the same scene or object at different times or from different orientations result in images in different coordinate systems. Registration is a crucial step in order to be able to compare, integrate and fuse the data obtained from different measurements. Tomography is the method of imaging a single plane or slice of an object. A Computed Tomography (CT) scan, also known as a CAT scan (Computed Axial Tomography scan), is a Helical Tomography, which traditionally produces a 2D image of the structures in a thin section of the body. It uses X-ray, which is ionizing radiation. Although the actual dose is typically low, repeated scans should be limited. In dentistry, implant dentistry in specific, there is a need for 3D visualization of internal anatomy. The internal visualization is mainly based on CT scanning technologies. The most important technological advancement which dramatically enhanced the clinician\u27s ability to diagnose, treat, and plan dental implants has been the CT scan. Advanced 3D modeling and visualization techniques permit highly refined and accurate assessment of the CT scan data. However, in addition to imperfections of the instrument and the imaging process, it is not uncommon to encounter other unwanted artifacts in the form of bright regions, flares and erroneous pixels due to dental bridges, metal braces, etc. Currently, removing and cleaning up the data from acquisition backscattering imperfections and unwanted artifacts is performed manually, which is as good as the experience level of the technician. On the other hand the process is error prone, since the editing process needs to be performed image by image. We address some of these issues by proposing novel registration methods and using stonecast models of patient\u27s dental imprint as reference ground truth data. Stone-cast models were originally used by dentists to make complete or partial dentures. The CT scan of such stone-cast models can be used to automatically guide the cleaning of patients\u27 CT scans from defects or unwanted artifacts, and also as an automatic segmentation system for the outliers of the CT scan data without use of stone-cast models. Segmented data is subsequently used to clean the data from artifacts using a new proposed 3D inpainting approach

In Vivo 3D Digital Atlas Database of the Adult C57BL/6J Mouse Brain by Magnetic Resonance Microscopy

In this study, a 3D digital atlas of the live mouse brain based on magnetic resonance microscopy (MRM) is presented. C57BL/6J adult mouse brains were imaged in vivo on a 9.4 Tesla MR instrument at an isotropic spatial resolution of 100 μm. With sufficient signal-to-noise (SNR) and contrast-to-noise ratio (CNR), 20 brain regions were identified. Several atlases were constructed including 12 individual brain atlases, an average atlas, a probabilistic atlas and average geometrical deformation maps. We also investigated the feasibility of using lower spatial resolution images to improve time efficiency for future morphological phenotyping. All of the new in vivo data were compared to previous published in vitro C57BL/6J mouse brain atlases and the morphological differences were characterized. Our analyses revealed significant volumetric as well as unexpected geometrical differences between the in vivo and in vitro brain groups which in some instances were predictable (e.g. collapsed and smaller ventricles in vitro) but not in other instances. Based on these findings we conclude that although in vitro datasets, compared to in vivo images, offer higher spatial resolutions, superior SNR and CNR, leading to improved image segmentation, in vivo atlases are likely to be an overall better geometric match for in vivo studies, which are necessary for longitudinal examinations of the same animals and for functional brain activation studies. Thus the new in vivo mouse brain atlas dataset presented here is a valuable complement to the current mouse brain atlas collection and will be accessible to the neuroscience community on our public domain mouse brain atlas website

Segmentation of pelvic structures from preoperative images for surgical planning and guidance

Prostate cancer is one of the most frequently diagnosed malignancies globally and the second leading cause of cancer-related mortality in males in the developed world. In recent decades, many techniques have been proposed for prostate cancer diagnosis and treatment. With the development of imaging technologies such as CT and MRI, image-guided procedures have become increasingly important as a means to improve clinical outcomes. Analysis of the preoperative images and construction of 3D models prior to treatment would help doctors to better localize and visualize the structures of interest, plan the procedure, diagnose disease and guide the surgery or therapy. This requires efficient and robust medical image analysis and segmentation technologies to be developed. The thesis mainly focuses on the development of segmentation techniques in pelvic MRI for image-guided robotic-assisted laparoscopic radical prostatectomy and external-beam radiation therapy. A fully automated multi-atlas framework is proposed for bony pelvis segmentation in MRI, using the guidance of MRI AE-SDM. With the guidance of the AE-SDM, a multi-atlas segmentation algorithm is used to delineate the bony pelvis in a new \ac{MRI} where there is no CT available. The proposed technique outperforms state-of-the-art algorithms for MRI bony pelvis segmentation. With the SDM of pelvis and its segmented surface, an accurate 3D pelvimetry system is designed and implemented to measure a comprehensive set of pelvic geometric parameters for the examination of the relationship between these parameters and the difficulty of robotic-assisted laparoscopic radical prostatectomy. This system can be used in both manual and automated manner with a user-friendly interface. A fully automated and robust multi-atlas based segmentation has also been developed to delineate the prostate in diagnostic MR scans, which have large variation in both intensity and shape of prostate. Two image analysis techniques are proposed, including patch-based label fusion with local appearance-specific atlases and multi-atlas propagation via a manifold graph on a database of both labeled and unlabeled images when limited labeled atlases are available. The proposed techniques can achieve more robust and accurate segmentation results than other multi-atlas based methods. The seminal vesicles are also an interesting structure for therapy planning, particularly for external-beam radiation therapy. As existing methods fail for the very onerous task of segmenting the seminal vesicles, a multi-atlas learning framework via random decision forests with graph cuts refinement has further been proposed to solve this difficult problem. Motivated by the performance of this technique, I further extend the multi-atlas learning to segment the prostate fully automatically using multispectral (T1 and T2-weighted) MR images via hybrid \ac{RF} classifiers and a multi-image graph cuts technique. The proposed method compares favorably to the previously proposed multi-atlas based prostate segmentation. The work in this thesis covers different techniques for pelvic image segmentation in MRI. These techniques have been continually developed and refined, and their application to different specific problems shows ever more promising results.Open Acces

Computerized Analysis of Magnetic Resonance Images to Study Cerebral Anatomy in Developing Neonates

The study of cerebral anatomy in developing neonates is of great importance for the understanding of brain development during the early period of life. This dissertation therefore focuses on three challenges in the modelling of cerebral anatomy in neonates during brain development. The methods that have been developed all use Magnetic Resonance Images (MRI) as source data. To facilitate study of vascular development in the neonatal period, a set of image analysis algorithms are developed to automatically extract and model cerebral vessel trees. The whole process consists of cerebral vessel tracking from automatically placed seed points, vessel tree generation, and vasculature registration and matching. These algorithms have been tested on clinical Time-of- Flight (TOF) MR angiographic datasets. To facilitate study of the neonatal cortex a complete cerebral cortex segmentation and reconstruction pipeline has been developed. Segmentation of the neonatal cortex is not effectively done by existing algorithms designed for the adult brain because the contrast between grey and white matter is reversed. This causes pixels containing tissue mixtures to be incorrectly labelled by conventional methods. The neonatal cortical segmentation method that has been developed is based on a novel expectation-maximization (EM) method with explicit correction for mislabelled partial volume voxels. Based on the resulting cortical segmentation, an implicit surface evolution technique is adopted for the reconstruction of the cortex in neonates. The performance of the method is investigated by performing a detailed landmark study. To facilitate study of cortical development, a cortical surface registration algorithm for aligning the cortical surface is developed. The method first inflates extracted cortical surfaces and then performs a non-rigid surface registration using free-form deformations (FFDs) to remove residual alignment. Validation experiments using data labelled by an expert observer demonstrate that the method can capture local changes and follow the growth of specific sulcus

Semi-Automatic Segmentation of Normal Female Pelvic Floor Structures from Magnetic Resonance Images

Stress urinary incontinence (SUI) and pelvic organ prolapse (POP) are important health issues affecting millions of American women. Investigation of the cause of SUI and POP requires a better understand of the anatomy of female pelvic floor. In addition, pre-surgical planning and individualized treatment plans require development of patient-specific three-dimensional or virtual reality models. The biggest challenge in building those models is to segment pelvic floor structures from magnetic resonance images because of their complex shapes, which make manual segmentation labor-intensive and inaccurate. In this dissertation, a quick and reliable semi-automatic segmentation method based on a shape model is proposed. The model is built on statistical analysis of the shapes of structures in a training set. A local feature map of the target image is obtained by applying a filtering pipeline, including contrast enhancement, noise reduction, smoothing, and edge extraction. With the shape model and feature map, automatic segmentation is performed by matching the model to the border of the structure using an optimization technique called evolution strategy. Segmentation performance is evaluated by calculating a similarity coefficient between semi-automatic and manual segmentation results. Taguchi analysis is performed to investigate the significance of segmentation parameters and provide tuning trends for better performance. The proposed method was successfully tested on both two-dimensional and three-dimensional image segmentation using the levator ani and obturator muscles as examples. Although the method is designed for segmentation of female pelvic floor structures, it can also be applied to other structures or organs without large shape variatio