A Simple Penalty that Encourages Local Invertibility and Considers Sliding Effects for Respiratory Motion

Nonrigid image registration is a key tool in medical imaging. Because of high degrees of freedom in nonrigid transforms, there have been many efforts to regularize the deformation based on some reasonable assumptions. Especially, motion invertibility and local tissue rigidity have been investigated as reasonable priors in image registration. There have been several papers on exploiting each constraint separately. These constraints are reasonable in respiratory motion estimation because breathing motion is invertible and there are some rigid structures such as bones. Using both constraints seems very attractive in respiratory motion registration since using invertibility prior alone usually causes bone warping in ribs. Using rigidity prior seems natural and straightforward. However, the “sliding effect” near the interface between rib cage and diaphragm makes problem harder because it is not locally invertible. In this area, invertibility and rigidity priors have opposite forces. Recently, we proposed a simple piecewise quadratic penalty that encourages the local invertibility of motions. In this work we relax this penalty function by using a Geman-type function that allows the deformation to be piecewise smooth instead of globally smooth. This allows the deformation to be discontinuous in the area of the interface between rib cage and diaphragm. With some small sacrifice of regularity, we could achieve more realistic discontinuous motion near diaphragm, better data fitting error as well as less bone warping. We applied this Geman-type function penalty only to the x- and y-direction partial derivatives of the z-direction deformation to address the sliding effect. 192 × 128 × 128 3D CT inhale and exhale images of a real patient were used to show the benefits of this new penalty method.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/85922/1/Fessler238.pd

A Simple Regularizer for B-spline Nonrigid Image Registration That Encourages Local Invertibility

Nonrigid image registration is an important task for many medical imaging applications. In particular, for radiation oncology it is desirable to track respiratory motion for thoracic cancer treatment. B-splines are convenient for modeling nonrigid deformations, but ensuring invertibility can be a challenge. This paper describes sufficient conditions for local invertibility of deformations based on B-spline bases. These sufficient conditions can be used with constrained optimization to enforce local invertibility. We also incorporate these conditions into nonrigid image registration methods based on a simple penalty approach that encourages diffeomorphic deformations. Traditional Jacobian penalty methods penalize negative Jacobian determinant values only at grid points. In contrast, our new method enforces a sufficient condition for invertibility directly on the deformation coefficients to encourage invertibility globally over a 3-D continuous domain. The proposed penalty approach requires substantially less compute time than Jacobian penalties per iteration.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/85951/1/Fessler21.pd

DEFORM'06 - Proceedings of the Workshop on Image Registration in Deformable Environments

Preface These are the proceedings of DEFORM'06, the Workshop on Image Registration in Deformable Environments, associated to BMVC'06, the 17th British Machine Vision Conference, held in Edinburgh, UK, in September 2006. The goal of DEFORM'06 was to bring together people from different domains having interests in deformable image registration. In response to our Call for Papers, we received 17 submissions and selected 8 for oral presentation at the workshop. In addition to the regular papers, Andrew Fitzgibbon from Microsoft Research Cambridge gave an invited talk at the workshop. The conference website including online proceedings remains open, see http://comsee.univ-bpclermont.fr/events/DEFORM06. We would like to thank the BMVC'06 co-chairs, Mike Chantler, Manuel Trucco and especially Bob Fisher for is great help in the local arrangements, Andrew Fitzgibbon, and the Programme Committee members who provided insightful reviews of the submitted papers. Special thanks go to Marc Richetin, head of the CNRS Research Federation TIMS, which sponsored the workshop. August 2006 Adrien Bartoli Nassir Navab Vincent Lepeti

Regularized Methods for Topology-Preserving Smooth Nonrigid Image Registration Using B-Spline Basis

B-splines are a convenient tool for nonrigid registration, but ensuring invertibility can be challenge. This paper describes a new penalty method that is devised to enforce a sufficient condition for local invertibility and smoothness of nth order B-spline based deformations. Traditional direct Jacobian penalty methods penalize negative Jacobian determinant values only at grid points. In contrast, our new penalty method enforces the sufficient condition for invertibility directly on the B-spline coefficients by using a modified quadratic penalty function so that it enforces invertibility globally over a 3D continuous domain. This approach also saves computation time and memory compared to using Jacobian determinant values. We apply this method to 3D CT images of a thorax at inhale and exhale.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/85874/1/Fessler232.pd

Nonrigid Registration Using Regularization that Accomodates Local Tissue Rigidity

Regularized nonrigid medical image registration algorithms usually estimate the deformation by minimizing a cost function, consisting of a similarity measure and a penalty term that discourages “unreasonable” deformations. Conventional regularization methods enforce homogeneous smoothness properties of the deformation field; less work has been done to incorporate tissue-type-specific elasticity information. Yet ignoring the elasticity differences between tissue types can result in non-physical results, such as bone warping. Bone structures should move rigidly (locally), unlike the more elastic deformation of soft issues. Existing solutions for this problem either treat different regions of an image independently, which requires precise segmentation and incurs boundary issues; or use an empirical spatial varying “filter” to “correct” the deformation field, which requires the knowledge of a stiffness map and departs from the cost-function formulation. We propose a new approach to incorporate tissue rigidity information into the nonrigid registration problem, by developing a space variant regularization function that encourages the local Jacobian of the deformation to be a nearly orthogonal matrix in rigid image regions, while allowing more elastic deformations elsewhere. For the case of X-ray CT data, we use a simple monotonic increasing function of the CT numbers (in HU) as a “rigidity index” since bones typically have the highest CT numbers. Unlike segmentation-based methods, this approach is flexible enough to account for partial volume effects. Results using a B-spline deformation parameterization illustrate that the proposed approach improves registration accuracy in inhale-exhale CT scans with minimal computational penalty.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/85935/1/Fessler216.pd

An inexact Newton-Krylov algorithm for constrained diffeomorphic image registration

We propose numerical algorithms for solving large deformation diffeomorphic image registration problems. We formulate the nonrigid image registration problem as a problem of optimal control. This leads to an infinite-dimensional partial differential equation (PDE) constrained optimization problem. The PDE constraint consists, in its simplest form, of a hyperbolic transport equation for the evolution of the image intensity. The control variable is the velocity field. Tikhonov regularization on the control ensures well-posedness. We consider standard smoothness regularization based on $H^1$- or $H^2$-seminorms. We augment this regularization scheme with a constraint on the divergence of the velocity field rendering the deformation incompressible and thus ensuring that the determinant of the deformation gradient is equal to one, up to the numerical error. We use a Fourier pseudospectral discretization in space and a Chebyshev pseudospectral discretization in time. We use a preconditioned, globalized, matrix-free, inexact Newton-Krylov method for numerical optimization. A parameter continuation is designed to estimate an optimal regularization parameter. Regularity is ensured by controlling the geometric properties of the deformation field. Overall, we arrive at a black-box solver. We study spectral properties of the Hessian, grid convergence, numerical accuracy, computational efficiency, and deformation regularity of our scheme. We compare the designed Newton-Krylov methods with a globalized preconditioned gradient descent. We study the influence of a varying number of unknowns in time. The reported results demonstrate excellent numerical accuracy, guaranteed local deformation regularity, and computational efficiency with an optional control on local mass conservation. The Newton-Krylov methods clearly outperform the Picard method if high accuracy of the inversion is required.Comment: 32 pages; 10 figures; 9 table

Automated diffeomorphic registration of anatomical structures with rigid parts: application to dynamic cervical MRI.

International audienceWe propose an iterative two-step method to compute a diffeomorphic non-rigid transformation between images of anatomical structures with rigid parts, without any user intervention or prior knowledge on the image intensities. First we compute spatially sparse, locally optimal rigid transformations between the two images using a new block matching strategy and an efficient numerical optimiser (BOBYQA). Then we derive a dense, regularised velocity field based on these local transformations using matrix logarithms and M-smoothing. These two steps are iterated until convergence and the final diffeomorphic transformation is defined as the exponential of the accumulated velocity field. We show our algorithm to outperform the state-of-the-art log-domain diffeomorphic demons method on dynamic cervical MRI data

Intrinsic Dynamic Shape Prior for Fast, Sequential and Dense Non-Rigid Structure from Motion with Detection of Temporally-Disjoint Rigidity

While dense non-rigid structure from motion (NRSfM) has been extensively studied from the perspective of the reconstructability problem over the recent years, almost no attempts have been undertaken to bring it into the practical realm. The reasons for the slow dissemination are the severe ill-posedness, high sensitivity to motion and deformation cues and the difficulty to obtain reliable point tracks in the vast majority of practical scenarios. To fill this gap, we propose a hybrid approach that extracts prior shape knowledge from an input sequence with NRSfM and uses it as a dynamic shape prior for sequential surface recovery in scenarios with recurrence. Our Dynamic Shape Prior Reconstruction (DSPR) method can be combined with existing dense NRSfM techniques while its energy functional is optimised with stochastic gradient descent at real-time rates for new incoming point tracks. The proposed versatile framework with a new core NRSfM approach outperforms several other methods in the ability to handle inaccurate and noisy point tracks, provided we have access to a representative (in terms of the deformation variety) image sequence. Comprehensive experiments highlight convergence properties and the accuracy of DSPR under different disturbing effects. We also perform a joint study of tracking and reconstruction and show applications to shape compression and heart reconstruction under occlusions. We achieve state-of-the-art metrics (accuracy and compression ratios) in different scenarios