135 research outputs found
Locally Orderless Registration
Image registration is an important tool for medical image analysis and is
used to bring images into the same reference frame by warping the coordinate
field of one image, such that some similarity measure is minimized. We study
similarity in image registration in the context of Locally Orderless Images
(LOI), which is the natural way to study density estimates and reveals the 3
fundamental scales: the measurement scale, the intensity scale, and the
integration scale.
This paper has three main contributions: Firstly, we rephrase a large set of
popular similarity measures into a common framework, which we refer to as
Locally Orderless Registration, and which makes full use of the features of
local histograms. Secondly, we extend the theoretical understanding of the
local histograms. Thirdly, we use our framework to compare two state-of-the-art
intensity density estimators for image registration: The Parzen Window (PW) and
the Generalized Partial Volume (GPV), and we demonstrate their differences on a
popular similarity measure, Normalized Mutual Information (NMI).
We conclude, that complicated similarity measures such as NMI may be
evaluated almost as fast as simple measures such as Sum of Squared Distances
(SSD) regardless of the choice of PW and GPV. Also, GPV is an asymmetric
measure, and PW is our preferred choice.Comment: submitte
Information-Theoretic Registration with Explicit Reorientation of Diffusion-Weighted Images
We present an information-theoretic approach to the registration of images
with directional information, and especially for diffusion-Weighted Images
(DWI), with explicit optimization over the directional scale. We call it
Locally Orderless Registration with Directions (LORD). We focus on normalized
mutual information as a robust information-theoretic similarity measure for
DWI. The framework is an extension of the LOR-DWI density-based hierarchical
scale-space model that varies and optimizes the integration, spatial,
directional, and intensity scales. As affine transformations are insufficient
for inter-subject registration, we extend the model to non-rigid deformations.
We illustrate that the proposed model deforms orientation distribution
functions (ODFs) correctly and is capable of handling the classic complex
challenges in DWI-registrations, such as the registration of fiber-crossings
along with kissing, fanning, and interleaving fibers. Our experimental results
clearly illustrate a novel promising regularizing effect, that comes from the
nonlinear orientation-based cost function. We show the properties of the
different image scales and, we show that including orientational information in
our model makes the model better at retrieving deformations in contrast to
standard scalar-based registration.Comment: 16 pages, 19 figure
Locally orderless tensor networks for classifying two- and three-dimensional medical images
Tensor networks are factorisations of high rank tensors into networks of
lower rank tensors and have primarily been used to analyse quantum many-body
problems. Tensor networks have seen a recent surge of interest in relation to
supervised learning tasks with a focus on image classification. In this work,
we improve upon the matrix product state (MPS) tensor networks that can operate
on one-dimensional vectors to be useful for working with 2D and 3D medical
images. We treat small image regions as orderless, squeeze their spatial
information into feature dimensions and then perform MPS operations on these
locally orderless regions. These local representations are then aggregated in a
hierarchical manner to retain global structure. The proposed locally orderless
tensor network (LoTeNet) is compared with relevant methods on three datasets.
The architecture of LoTeNet is fixed in all experiments and we show it requires
lesser computational resources to attain performance on par or superior to the
compared methods.Comment: Accepted for publication at the Journal of Machine Learning for
Biomedical Imaging (MELBA) (see https://melba-journal.org). Source code at
https://github.com/raghavian/LoTeNet_pytorch
- …