Multimodal T2w and DWI Prostate Gland Automated Registration

Multiparametric magnetic resonance imaging (mpMRI) is emerging as a promising tool in the clinical pathway of prostate cancer (PCa). The registration between a structural and a functional imaging modality, such as T2-weighted (T2w) and diffusion-weighted imaging (DWI) is fundamental in the development of a mpMRI-based computer aided diagnosis (CAD) system for PCa. Here, we propose an automated method to register the prostate gland in T2w and DWI image sequences by a landmark-based affine registration and a non-parametric diffeomorphic registration. An expert operator manually segmented the prostate gland in both modalities on a dataset of 20 patients. Target registration error and Jaccard index, which measures the overlap between masks, were evaluated pre-and post-registration resulting in an improvement of 44% and 21%, respectively. In the future, the proposed method could be useful in the framework of a CAD system for PCa detection and characterization in mpMRI

Semiautomated Multimodal Breast Image Registration

Consideration of information from multiple modalities has been shown to have increased diagnostic power in breast imaging. As a result, new techniques such as microwave imaging continue to be developed. Interpreting these novel image modalities is a challenge, requiring comparison to established techniques such as the gold standard X-ray mammography. However, due to the highly deformable nature of breast tissues, comparison of 3D and 2D modalities is a challenge. To enable this comparison, a registration technique was developed to map features from 2D mammograms to locations in the 3D image space. This technique was developed and tested using magnetic resonance (MR) images as a reference 3D modality, as MR breast imaging is an established technique in clinical practice. The algorithm was validated using a numerical phantom then successfully tested on twenty-four image pairs. Dice's coefficient was used to measure the external goodness of fit, resulting in an excellent overall average of 0.94. Internal agreement was evaluated by examining internal features in consultation with a radiologist, and subjective assessment concludes that reasonable alignment was achieved

Affine Registration of label maps in Label Space

Two key aspects of coupled multi-object shape\ud analysis and atlas generation are the choice of representation\ud and subsequent registration methods used to align the sample\ud set. For example, a typical brain image can be labeled into\ud three structures: grey matter, white matter and cerebrospinal\ud fluid. Many manipulations such as interpolation, transformation,\ud smoothing, or registration need to be performed on these images\ud before they can be used in further analysis. Current techniques\ud for such analysis tend to trade off performance between the two\ud tasks, performing well for one task but developing problems when\ud used for the other.\ud This article proposes to use a representation that is both\ud flexible and well suited for both tasks. We propose to map object\ud labels to vertices of a regular simplex, e.g. the unit interval for\ud two labels, a triangle for three labels, a tetrahedron for four\ud labels, etc. This representation, which is routinely used in fuzzy\ud classification, is ideally suited for representing and registering\ud multiple shapes. On closer examination, this representation\ud reveals several desirable properties: algebraic operations may\ud be done directly, label uncertainty is expressed as a weighted\ud mixture of labels (probabilistic interpretation), interpolation is\ud unbiased toward any label or the background, and registration\ud may be performed directly.\ud We demonstrate these properties by using label space in a gradient\ud descent based registration scheme to obtain a probabilistic\ud atlas. While straightforward, this iterative method is very slow,\ud could get stuck in local minima, and depends heavily on the initial\ud conditions. To address these issues, two fast methods are proposed\ud which serve as coarse registration schemes following which the\ud iterative descent method can be used to refine the results. Further,\ud we derive an analytical formulation for direct computation of the\ud "group mean" from the parameters of pairwise registration of all\ud the images in the sample set. We show results on richly labeled\ud 2D and 3D data sets

Landmark Localization, Feature Matching and Biomarker Discovery from Magnetic Resonance Images

The work presented in this thesis proposes several methods that can be roughly divided into three different categories: I) landmark localization in medical images, II) feature matching for image registration, and III) biomarker discovery in neuroimaging. The first part deals with the identification of anatomical landmarks. The motivation stems from the fact that the manual identification and labeling of these landmarks is very time consuming and prone to observer errors, especially when large datasets must be analyzed. In this thesis we present three methods to tackle this challenge: A landmark descriptor based on local self-similarities (SS), a subspace building framework based on manifold learning and a sparse coding landmark descriptor based on data-specific learned dictionary basis. The second part of this thesis deals with finding matching features between a pair of images. These matches can be used to perform a registration between them. Registration is a powerful tool that allows mapping images in a common space in order to aid in their analysis. Accurate registration can be challenging to achieve using intensity based registration algorithms. Here, a framework is proposed for learning correspondences in pairs of images by matching SS features and random sample and consensus (RANSAC) is employed as a robust model estimator to learn a deformation model based on feature matches. Finally, the third part of the thesis deals with biomarker discovery using machine learning. In this section a framework for feature extraction from learned low-dimensional subspaces that represent inter-subject variability is proposed. The manifold subspace is built using data-driven regions of interest (ROI). These regions are learned via sparse regression, with stability selection. Also, probabilistic distribution models for different stages in the disease trajectory are estimated for different class populations in the low-dimensional manifold and used to construct a probabilistic scoring function.Open Acces

A Hybrid Similarity Measure Framework for Multimodal Medical Image Registration

Medical imaging is widely used today to facilitate both disease diagnosis and treatment planning practice, with a key prerequisite being the systematic process of medical image registration (MIR) to align either mono or multimodal images of different anatomical parts of the human body. MIR utilises a similarity measure (SM) to quantify the level of spatial alignment and is particularly demanding due to the presence of inherent modality characteristics like intensity non-uniformities (INU) in magnetic resonance images and large homogeneous non-vascular regions in retinal images. While various intensity and feature-based SMs exist for MIR, mutual information (MI) has become established because of its computational efficiency and ability to register multimodal images. It is however, very sensitive to interpolation artefacts in the presence of INU with noise and can be compromised when overlapping areas are small. Recently MI-based hybrid variants which combine regional features with intensity have emerged, though these incur high dimensionality and large computational overheads. To address these challenges and secure accurate, efficient and robust registration of images containing high INU, noise and large homogeneous regions, this thesis presents a new hybrid SM framework for 2D multimodal rigid MIR. The framework consistently provides superior quantitative and qualitative performance, while offering a uniquely flexible design trade-off between registration accuracy and computational time. It makes three significant technical contributions to the field: i) An expectation maximisation-based principal component analysis with mutual information (EMPCA-MI) framework incorporating neighbourhood feature information; ii) Two innovative enhancements to reduce information redundancy and improve MI computational efficiency; and iii) an adaptive algorithm to select the most significant principal components for feature selection. The thesis findings conclusively confirm the hybrid SM framework offers an accurate and robust 2D registration solution for challenging multimodal medical imaging datasets, while its inherent flexibility means it can also be extended to the 3D registration domain

Standardized Platform for Coregistration of Noncurrent Diffuse Optical and Magnetic Resonance Breast Images Obtained in Different Geometries

We present a novel methodology for combining breast image data obtained at different times, in different geometries, and by different techniques. We combine data based on diffuse optical tomography (DOT) and magnetic resonance imaging (MRI). The software platform integrates advanced multimodal registration and segmentation algorithms, requires minimal user experience, and employs computationally efficient techniques. The resulting superposed 3-D tomographs facilitate tissue analyses based on structural and functional data derived from both modalities, and readily permit enhancement of DOT data reconstruction using MRI-derived a-priori structural information. We demonstrate the multimodal registration method using a simulated phantom, and we present initial patient studies that confirm that tumorous regions in a patient breast found by both imaging modalities exhibit significantly higher total hemoglobin concentration (THC) than surrounding normal tissues. The average THC in the tumorous regions is one to three standard deviations larger than the overall breast average THC for all patients

Analysis of cardiac motion using MRI and nonrigid image registration

Imperial Users onl

Quantitation in MRI : application to ageing and epilepsy

Multi-atlas propagation and label fusion techniques have recently been developed for segmenting the human brain into multiple anatomical regions. In this thesis, I investigate possible adaptations of these current state-of-the-art methods. The aim is to study ageing on the one hand, and on the other hand temporal lobe epilepsy as an example for a neurological disease. Overall effects are a confounding factor in such anatomical analyses. Intracranial volume (ICV) is often preferred to normalize for global effects as it allows to normalize for estimated maximum brain size and is hence independent of global brain volume loss, as seen in ageing and disease. I describe systematic differences in ICV measures obtained at 1.5T versus 3T, and present an automated method of measuring intracranial volume, Reverse MNI Brain Masking (RBM), based on tissue probability maps in MNI standard space. I show that this is comparable to manual measurements and robust against field strength differences. Correct and robust segmentation of target brains which show gross abnormalities, such as ventriculomegaly, is important for the study of ageing and disease. We achieved this with incorporating tissue classification information into the image registration process. The best results in elderly subjects, patients with TLE and healthy controls were achieved using a new approach using multi-atlas propagation with enhanced registration (MAPER). I then applied MAPER to the problem of automatically distinguishing patients with TLE with (TLE-HA) and without (TLE-N) hippocampal atrophy on MRI from controls, and determine the side of seizure onset. MAPER-derived structural volumes were used for a classification step consisting of selecting a set of discriminatory structures and applying support vector machine on the structural volumes as well as morphological similarity information such as volume difference obtained with spectral analysis. Acccuracies were 91-100 %, indicating that the method might be clinically useful. Finally, I used the methods developed in the previous chapters to investigate brain regional volume changes across the human lifespan in over 500 healthy subjects between 20 to 90 years of age, using data from three different scanners (2x 1.5T, 1x 3T), using the IXI database. We were able to confirm several known changes, indicating the veracity of the method. In addition, we describe the first multi-region, whole-brain database of normal ageing