2,165 research outputs found
Fast Predictive Multimodal Image Registration
We introduce a deep encoder-decoder architecture for image deformation
prediction from multimodal images. Specifically, we design an image-patch-based
deep network that jointly (i) learns an image similarity measure and (ii) the
relationship between image patches and deformation parameters. While our method
can be applied to general image registration formulations, we focus on the
Large Deformation Diffeomorphic Metric Mapping (LDDMM) registration model. By
predicting the initial momentum of the shooting formulation of LDDMM, we
preserve its mathematical properties and drastically reduce the computation
time, compared to optimization-based approaches. Furthermore, we create a
Bayesian probabilistic version of the network that allows evaluation of
registration uncertainty via sampling of the network at test time. We evaluate
our method on a 3D brain MRI dataset using both T1- and T2-weighted images. Our
experiments show that our method generates accurate predictions and that
learning the similarity measure leads to more consistent registrations than
relying on generic multimodal image similarity measures, such as mutual
information. Our approach is an order of magnitude faster than
optimization-based LDDMM.Comment: Accepted as a conference paper for ISBI 201
Diffeomorphic demons using normalized mutual information, evaluation on multimodal brain MR images
The demons algorithm is a fast non-parametric non-rigid registration method. In recent years great efforts have been made to improve the approach; the state of the art version yields symmetric inverse-consistent largedeformation diffeomorphisms. However, only limited work has explored inter-modal similarity metrics, with no practical evaluation on multi-modality data. We present a diffeomorphic demons implementation using the analytical gradient of Normalised Mutual Information (NMI) in a conjugate gradient optimiser. We report the first qualitative and quantitative assessment of the demons for inter-modal registration. Experiments to spatially normalise real MR images, and to recover simulated deformation fields, demonstrate (i) similar accuracy from NMI-demons and classical demons when the latter may be used, and (ii) similar accuracy for NMI-demons on T1w-T1w and T1w-T2w registration, demonstrating its potential in multi-modal scenarios
Diffeomorphic Demons using Normalised Mutual Information, Evaluation on Multi-Modal Brain MR Images
The demons algorithm is a fast non-parametric non-rigid registration method. In recent years great efforts have been made to improve the approach; the state of the art version yields symmetric inverse-consistent large-deformation diffeomorphisms. However, only limited work has explored inter-modal similarity metrics, with no practical evaluation on multi-modality data. We present a diffeomorphic demons implementation using the analytical gradient of Normalised Mutual Information (NMI) in a conjugate gradient optimiser. We report the first qualitative and quantitative assessment of the demons for inter-modal registration. Experiments to spatially normalise real MR images, and to recover simulated deformation fields, demonstrate (i) similar accuracy from NMI-demons and classical demons when the latter may be used, and (ii) similar accuracy for NMI-demons on T1w-T1w and T1w-T2w registration, demonstrating its potential in multi-modal scenarios
Direct inverse deformation field approach to pelvic-area symmetric image registration
This paper presents a novel technique for a consistent symmetric deformable image registration based on an accurate method for a direct inversion of a large motion model deformation field. The proposed image registration algorithm maintains one-to-one mapping between registered images by symmetrically warping them to another image. This makes the final estimation of forward and backward deformation fields anatomically plausible and applicable to adaptive prostate radiotherapy. The quantitative validation of the method is performed on magnetic resonance data obtained for pelvis area. The experiments demonstrate the improved robustness in terms of inverse consistency error and estimation accuracy of prostate position in comparison to the previously proposed methods
Prostate Biopsy Assistance System with Gland Deformation Estimation for Enhanced Precision
Computer-assisted prostate biopsies became a very active research area during
the last years. Prostate tracking makes it possi- ble to overcome several
drawbacks of the current standard transrectal ultrasound (TRUS) biopsy
procedure, namely the insufficient targeting accuracy which may lead to a
biopsy distribution of poor quality, the very approximate knowledge about the
actual location of the sampled tissues which makes it difficult to implement
focal therapy strategies based on biopsy results, and finally the difficulty to
precisely reach non-ultrasound (US) targets stemming from different modalities,
statistical atlases or previous biopsy series. The prostate tracking systems
presented so far are limited to rigid transformation tracking. However, the
gland can get considerably deformed during the intervention because of US probe
pres- sure and patient movements. We propose to use 3D US combined with
image-based elastic registration to estimate these deformations. A fast elastic
registration algorithm that copes with the frequently occurring US shadows is
presented. A patient cohort study was performed, which yielded a statistically
significant in-vivo accuracy of 0.83+-0.54mm.Comment: This version of the paper integrates a correction concerning the
local similarity measure w.r.t. the proceedings (this typing error could not
be corrected before editing the proceedings
Quicksilver: Fast Predictive Image Registration - a Deep Learning Approach
This paper introduces Quicksilver, a fast deformable image registration
method. Quicksilver registration for image-pairs works by patch-wise prediction
of a deformation model based directly on image appearance. A deep
encoder-decoder network is used as the prediction model. While the prediction
strategy is general, we focus on predictions for the Large Deformation
Diffeomorphic Metric Mapping (LDDMM) model. Specifically, we predict the
momentum-parameterization of LDDMM, which facilitates a patch-wise prediction
strategy while maintaining the theoretical properties of LDDMM, such as
guaranteed diffeomorphic mappings for sufficiently strong regularization. We
also provide a probabilistic version of our prediction network which can be
sampled during the testing time to calculate uncertainties in the predicted
deformations. Finally, we introduce a new correction network which greatly
increases the prediction accuracy of an already existing prediction network. We
show experimental results for uni-modal atlas-to-image as well as uni- / multi-
modal image-to-image registrations. These experiments demonstrate that our
method accurately predicts registrations obtained by numerical optimization, is
very fast, achieves state-of-the-art registration results on four standard
validation datasets, and can jointly learn an image similarity measure.
Quicksilver is freely available as an open-source software.Comment: Add new discussion
Fast Predictive Image Registration
We present a method to predict image deformations based on patch-wise image
appearance. Specifically, we design a patch-based deep encoder-decoder network
which learns the pixel/voxel-wise mapping between image appearance and
registration parameters. Our approach can predict general deformation
parameterizations, however, we focus on the large deformation diffeomorphic
metric mapping (LDDMM) registration model. By predicting the LDDMM
momentum-parameterization we retain the desirable theoretical properties of
LDDMM, while reducing computation time by orders of magnitude: combined with
patch pruning, we achieve a 1500x/66x speed up compared to GPU-based
optimization for 2D/3D image registration. Our approach has better prediction
accuracy than predicting deformation or velocity fields and results in
diffeomorphic transformations. Additionally, we create a Bayesian probabilistic
version of our network, which allows evaluation of deformation field
uncertainty through Monte Carlo sampling using dropout at test time. We show
that deformation uncertainty highlights areas of ambiguous deformations. We
test our method on the OASIS brain image dataset in 2D and 3D
- …