135 research outputs found
Locally Adaptive Frames in the Roto-Translation Group and their Applications in Medical Imaging
Locally adaptive differential frames (gauge frames) are a well-known
effective tool in image analysis, used in differential invariants and
PDE-flows. However, at complex structures such as crossings or junctions, these
frames are not well-defined. Therefore, we generalize the notion of gauge
frames on images to gauge frames on data representations defined on the extended space of positions and
orientations, which we relate to data on the roto-translation group ,
. This allows to define multiple frames per position, one per
orientation. We compute these frames via exponential curve fits in the extended
data representations in . These curve fits minimize first or second
order variational problems which are solved by spectral decomposition of,
respectively, a structure tensor or Hessian of data on . We include
these gauge frames in differential invariants and crossing preserving PDE-flows
acting on extended data representation and we show their advantage compared
to the standard left-invariant frame on . Applications include
crossing-preserving filtering and improved segmentations of the vascular tree
in retinal images, and new 3D extensions of coherence-enhancing diffusion via
invertible orientation scores
Invertible Orientation Scores of 3D Images
The enhancement and detection of elongated structures in noisy image data is
relevant for many biomedical applications. To handle complex crossing
structures in 2D images, 2D orientation scores were introduced, which already
showed their use in a variety of applications. Here we extend this work to 3D
orientation scores. First, we construct the orientation score from a given
dataset, which is achieved by an invertible coherent state type of transform.
For this transformation we introduce 3D versions of the 2D cake-wavelets, which
are complex wavelets that can simultaneously detect oriented structures and
oriented edges. For efficient implementation of the different steps in the
wavelet creation we use a spherical harmonic transform. Finally, we show some
first results of practical applications of 3D orientation scores.Comment: ssvm 2015 published version in LNCS contains a mistake (a switch
notation spherical angles) that is corrected in this arxiv versio
Left-invariant evolutions of wavelet transforms on the Similitude Group
Enhancement of multiple-scale elongated structures in noisy image data is
relevant for many biomedical applications but commonly used PDE-based
enhancement techniques often fail at crossings in an image. To get an overview
of how an image is composed of local multiple-scale elongated structures we
construct a multiple scale orientation score, which is a continuous wavelet
transform on the similitude group, SIM(2). Our unitary transform maps the space
of images onto a reproducing kernel space defined on SIM(2), allowing us to
robustly relate Euclidean (and scaling) invariant operators on images to
left-invariant operators on the corresponding continuous wavelet transform.
Rather than often used wavelet (soft-)thresholding techniques, we employ the
group structure in the wavelet domain to arrive at left-invariant evolutions
and flows (diffusion), for contextual crossing preserving enhancement of
multiple scale elongated structures in noisy images. We present experiments
that display benefits of our work compared to recent PDE techniques acting
directly on the images and to our previous work on left-invariant diffusions on
orientation scores defined on Euclidean motion group.Comment: 40 page
Total Variation and Mean Curvature PDEs on
Total variation regularization and total variation flows (TVF) have been
widely applied for image enhancement and denoising. To include a generic
preservation of crossing curvilinear structures in TVF we lift images to the
homogeneous space of positions and
orientations as a Lie group quotient in SE(d). For d = 2 this is called 'total
roto-translation variation' by Chambolle & Pock. We extend this to d = 3, by a
PDE-approach with a limiting procedure for which we prove convergence. We also
include a Mean Curvature Flow (MCF) in our PDE model on M. This was first
proposed for d = 2 by Citti et al. and we extend this to d = 3. Furthermore,
for d = 2 we take advantage of locally optimal differential frames in
invertible orientation scores (OS). We apply our TVF and MCF in the
denoising/enhancement of crossing fiber bundles in DW-MRI. In comparison to
data-driven diffusions, we see a better preservation of bundle boundaries and
angular sharpness in fiber orientation densities at crossings. We support this
by error comparisons on a noisy DW-MRI phantom. We also apply our TVF and MCF
in enhancement of crossing elongated structures in 2D images via OS, and
compare the results to nonlinear diffusions (CED-OS) via OS.Comment: Submission to the Seventh International Conference on Scale Space and
Variational Methods in Computer Vision (SSVM 2019). (v2) Typo correction in
lemma 1. (v3) Typo correction last paragraph page
Improving Fiber Alignment in HARDI by Combining Contextual PDE Flow with Constrained Spherical Deconvolution
We propose two strategies to improve the quality of tractography results
computed from diffusion weighted magnetic resonance imaging (DW-MRI) data. Both
methods are based on the same PDE framework, defined in the coupled space of
positions and orientations, associated with a stochastic process describing the
enhancement of elongated structures while preserving crossing structures. In
the first method we use the enhancement PDE for contextual regularization of a
fiber orientation distribution (FOD) that is obtained on individual voxels from
high angular resolution diffusion imaging (HARDI) data via constrained
spherical deconvolution (CSD). Thereby we improve the FOD as input for
subsequent tractography. Secondly, we introduce the fiber to bundle coherence
(FBC), a measure for quantification of fiber alignment. The FBC is computed
from a tractography result using the same PDE framework and provides a
criterion for removing the spurious fibers. We validate the proposed
combination of CSD and enhancement on phantom data and on human data, acquired
with different scanning protocols. On the phantom data we find that PDE
enhancements improve both local metrics and global metrics of tractography
results, compared to CSD without enhancements. On the human data we show that
the enhancements allow for a better reconstruction of crossing fiber bundles
and they reduce the variability of the tractography output with respect to the
acquisition parameters. Finally, we show that both the enhancement of the FODs
and the use of the FBC measure on the tractography improve the stability with
respect to different stochastic realizations of probabilistic tractography.
This is shown in a clinical application: the reconstruction of the optic
radiation for epilepsy surgery planning
Diffusion on the 3D Euclidean motion group for enhancement of HARDI data
In previous work we studied linear and nonlinear left-invariant diffusion equations on the 2D Euclidean motion group SE(2), for the purpose of crossing-preserving coherence-enhancing diffusion on 2D images. In this paper we study left-invariant diffusion on the 3D Euclidean motion group SE(3), which is useful for processing three-dimensional data. In particular, it is useful for the processing of High Angular Resolution Diffusion Imaging (HARDI) data, since these data can be considered as orientation scores directly, without the need to transform the HARDI data to a different form. In principle, all theory of the 2D case can be mapped to the 3D case. However, one of the complicating factors is that all practical 3D orientation scores are not functions on the entire group SE(3), but rather on a coset space of the group. We will show how we can still conceptually apply processing on the entire group by requiring the operations to preserve the introduced notion of alpha-right-invariance of such functions on SE(3). We introduce left-invariant derivatives and describe how to estimate tangent vectors that locally fit best to the elongated structures in the 3D orientation score. We propose generally applicable techniques for smoothing and enhancing functions on SE(3) using left-invariant diffusion on the group. Finally, we will discuss implementational issues and show a number of results for linear diffusion on artificial HARDI data
Numerical Approaches for Linear Left-invariant Diffusions on SE(2), their Comparison to Exact Solutions, and their Applications in Retinal Imaging
Left-invariant PDE-evolutions on the roto-translation group (and
their resolvent equations) have been widely studied in the fields of cortical
modeling and image analysis. They include hypo-elliptic diffusion (for contour
enhancement) proposed by Citti & Sarti, and Petitot, and they include the
direction process (for contour completion) proposed by Mumford. This paper
presents a thorough study and comparison of the many numerical approaches,
which, remarkably, is missing in the literature. Existing numerical approaches
can be classified into 3 categories: Finite difference methods, Fourier based
methods (equivalent to -Fourier methods), and stochastic methods (Monte
Carlo simulations). There are also 3 types of exact solutions to the
PDE-evolutions that were derived explicitly (in the spatial Fourier domain) in
previous works by Duits and van Almsick in 2005. Here we provide an overview of
these 3 types of exact solutions and explain how they relate to each of the 3
numerical approaches. We compute relative errors of all numerical approaches to
the exact solutions, and the Fourier based methods show us the best performance
with smallest relative errors. We also provide an improvement of Mathematica
algorithms for evaluating Mathieu-functions, crucial in implementations of the
exact solutions. Furthermore, we include an asymptotical analysis of the
singularities within the kernels and we propose a probabilistic extension of
underlying stochastic processes that overcomes the singular behavior in the
origin of time-integrated kernels. Finally, we show retinal imaging
applications of combining left-invariant PDE-evolutions with invertible
orientation scores.Comment: A final and corrected version of the manuscript is Published in
Numerical Mathematics: Theory, Methods and Applications (NM-TMA), vol. (9),
p.1-50, 201
Left-Invariant Diffusion on the Motion Group in terms of the Irreducible Representations of SO(3)
In this work we study the formulation of convection/diffusion equations on
the 3D motion group SE(3) in terms of the irreducible representations of SO(3).
Therefore, the left-invariant vector-fields on SE(3) are expressed as linear
operators, that are differential forms in the translation coordinate and
algebraic in the rotation. In the context of 3D image processing this approach
avoids the explicit discretization of SO(3) or , respectively. This is
particular important for SO(3), where a direct discretization is infeasible due
to the enormous memory consumption. We show two applications of the framework:
one in the context of diffusion-weighted magnetic resonance imaging and one in
the context of object detection
- …