14,218 research outputs found
Quicksilver: Fast Predictive Image Registration - a Deep Learning Approach
This paper introduces Quicksilver, a fast deformable image registration
method. Quicksilver registration for image-pairs works by patch-wise prediction
of a deformation model based directly on image appearance. A deep
encoder-decoder network is used as the prediction model. While the prediction
strategy is general, we focus on predictions for the Large Deformation
Diffeomorphic Metric Mapping (LDDMM) model. Specifically, we predict the
momentum-parameterization of LDDMM, which facilitates a patch-wise prediction
strategy while maintaining the theoretical properties of LDDMM, such as
guaranteed diffeomorphic mappings for sufficiently strong regularization. We
also provide a probabilistic version of our prediction network which can be
sampled during the testing time to calculate uncertainties in the predicted
deformations. Finally, we introduce a new correction network which greatly
increases the prediction accuracy of an already existing prediction network. We
show experimental results for uni-modal atlas-to-image as well as uni- / multi-
modal image-to-image registrations. These experiments demonstrate that our
method accurately predicts registrations obtained by numerical optimization, is
very fast, achieves state-of-the-art registration results on four standard
validation datasets, and can jointly learn an image similarity measure.
Quicksilver is freely available as an open-source software.Comment: Add new discussion
Development of Efficient Intensity Based Registration Techniques for Multi-modal Brain Images
Recent advances in medical imaging have resulted in the development of many imaging techniques that capture various aspects of the patients anatomy and metabolism. These are accomplished with image registration: the task of transforming images on a common anatomical coordinate space. Image registration is one of the important task for multi-modal brain images, which has paramount importance in clinical diagnosis, leads to treatment of brain diseases. In many other applications, image registration characterizes anatomical variability, to detect changes in disease state over time, and by mapping functional information into anatomical space. This thesis is focused to explore intensity-based registration techniques to accomplish precise information with accurate transformation for multi-modal brain images. In this view, we addressed mainly three important issues of image registration both in the rigid and non-rigid framework, i.e. i) information theoretic based similarity measure for alignment measurement, ii) free form deformation (FFD) based transformation, and iii) evolutionary technique based optimization of the cost function. Mutual information (MI) is a widely used information theoretic similarity measure criterion for multi-modal brain image registration. MI only dense the quantitative aspects of information based on the probability of events. For rustication of the information of events, qualitative aspect i.e. utility or saliency is a necessitate factor for consideration. In this work, a novel similarity measure is proposed, which incorporates the utility information into mutual Information, known as Enhanced Mutual Information(EMI).It is found that the maximum information gain using EMI is higher as compared to that of other state of arts. The utility or saliency employed in EMI is a scale invariant parameter, and hence it may fail to register in case of projective and perspective transformations. To overcome this bottleneck, salient region (SR) based Enhance Mutual Information (SR-EMI)is proposed, a new similarity measure for robust and accurate registration. The proposed SR-EMI based registration technique is robust to register the multi-modal brain images at a faster rate with better alignment
Towards ultra-high resolution 3D reconstruction of a whole rat brain from 3D-PLI data
3D reconstruction of the fiber connectivity of the rat brain at microscopic
scale enables gaining detailed insight about the complex structural
organization of the brain. We introduce a new method for registration and 3D
reconstruction of high- and ultra-high resolution (64 m and 1.3 m
pixel size) histological images of a Wistar rat brain acquired by 3D polarized
light imaging (3D-PLI). Our method exploits multi-scale and multi-modal 3D-PLI
data up to cellular resolution. We propose a new feature transform-based
similarity measure and a weighted regularization scheme for accurate and robust
non-rigid registration. To transform the 1.3 m ultra-high resolution data
to the reference blockface images a feature-based registration method followed
by a non-rigid registration is proposed. Our approach has been successfully
applied to 278 histological sections of a rat brain and the performance has
been quantitatively evaluated using manually placed landmarks by an expert.Comment: 9 pages, Accepted at 2nd International Workshop on Connectomics in
NeuroImaging (CNI), MICCAI'201
Fast Predictive Multimodal Image Registration
We introduce a deep encoder-decoder architecture for image deformation
prediction from multimodal images. Specifically, we design an image-patch-based
deep network that jointly (i) learns an image similarity measure and (ii) the
relationship between image patches and deformation parameters. While our method
can be applied to general image registration formulations, we focus on the
Large Deformation Diffeomorphic Metric Mapping (LDDMM) registration model. By
predicting the initial momentum of the shooting formulation of LDDMM, we
preserve its mathematical properties and drastically reduce the computation
time, compared to optimization-based approaches. Furthermore, we create a
Bayesian probabilistic version of the network that allows evaluation of
registration uncertainty via sampling of the network at test time. We evaluate
our method on a 3D brain MRI dataset using both T1- and T2-weighted images. Our
experiments show that our method generates accurate predictions and that
learning the similarity measure leads to more consistent registrations than
relying on generic multimodal image similarity measures, such as mutual
information. Our approach is an order of magnitude faster than
optimization-based LDDMM.Comment: Accepted as a conference paper for ISBI 201
Diffeomorphic demons using normalized mutual information, evaluation on multimodal brain MR images
The demons algorithm is a fast non-parametric non-rigid registration method. In recent years great efforts have been made to improve the approach; the state of the art version yields symmetric inverse-consistent largedeformation diffeomorphisms. However, only limited work has explored inter-modal similarity metrics, with no practical evaluation on multi-modality data. We present a diffeomorphic demons implementation using the analytical gradient of Normalised Mutual Information (NMI) in a conjugate gradient optimiser. We report the first qualitative and quantitative assessment of the demons for inter-modal registration. Experiments to spatially normalise real MR images, and to recover simulated deformation fields, demonstrate (i) similar accuracy from NMI-demons and classical demons when the latter may be used, and (ii) similar accuracy for NMI-demons on T1w-T1w and T1w-T2w registration, demonstrating its potential in multi-modal scenarios
Diffeomorphic Demons using Normalised Mutual Information, Evaluation on Multi-Modal Brain MR Images
The demons algorithm is a fast non-parametric non-rigid registration method. In recent years great efforts have been made to improve the approach; the state of the art version yields symmetric inverse-consistent large-deformation diffeomorphisms. However, only limited work has explored inter-modal similarity metrics, with no practical evaluation on multi-modality data. We present a diffeomorphic demons implementation using the analytical gradient of Normalised Mutual Information (NMI) in a conjugate gradient optimiser. We report the first qualitative and quantitative assessment of the demons for inter-modal registration. Experiments to spatially normalise real MR images, and to recover simulated deformation fields, demonstrate (i) similar accuracy from NMI-demons and classical demons when the latter may be used, and (ii) similar accuracy for NMI-demons on T1w-T1w and T1w-T2w registration, demonstrating its potential in multi-modal scenarios
- …