Inferring Preoperative Reconstructed Spine Models to Volumetric CT Data through High-Order MRFs

In this paper, we introduce a novel approach based on higher order energy functions which have the ability to encode global structural dependencies to infer articulated 3D spine models to CT volume data. A personalized geometrical model is reconstructed from biplanar X-rays before spinal surgery in order to create a spinal column representation which is modeled by a series of intervertebral transformations based on rotation and translation parameters. The shape transformation between the standing and lying poses is then achieved through a Markov Random Field optimization graph, where the unknown variables are the deformations applied to the intervertebral transformations. Singleton and pairwise potentials measure the support from the data and geometrical dependencies between neighboring vertebrae respectively, while higher order cliques are introduced to integrate consistency in regional curves. Optimization of model parameters in a multi-modal context is achieved using efficient linear programming and duality. A qualitative evaluation of the vertebra model alignment obtained from the proposed method gave promising results while the quantitative comparison to expert identification yields an accuracy of 1.8 +/- 0.7mm based on the localization of surgical landmarks

MRF-based Diffeomorphic Population Deformable Registration & Segmentation

In this report, we present a novel framework to deform mutually a population of n-examples based on an optimality criterion. The optimality criterion comprises three terms, one that aims to impose local smoothness, a second that aims to minimize the individual distances between all possible pairs of images, while the last one is a global statistical measurement based on "compactness" criteria. The problem is reformulated using a discrete MRF, where the above constraints are encoded in singleton (global) and pair-wise potentials (smoothness (intra-layer costs) and pair-alignments (inter-layer costs)). Furthermore, we propose a novel grid-based deformation scheme, that guarantees the diffeomorphism of the deformation while being computationally favorable compared to standard deformation methods. Towards addressing important deformations we propose a compositional approach where the deformations are recovered through the sub-optimal solutions of successive discrete MRFs. The resulting paradigm is optimized using efficient linear programming. The proposed framework for the mutual deformation of the images is applied to the group-wise registration problem as well as to an atlas-based population segmentation problem. Both articially generated data with known deformations and real data of medical studies were used for the validation of the method. Promising results demonstrate the potential of our method

A Kernel-based Approach to Diffusion Tensor and Fiber Clustering in the Human Skeletal Muscle

In this report, we present a kernel-based approach to the clustering of diffusion tensors in images of the human skeletal muscle. Based on the physical intuition of tensors as a means to represent the uncertainty of the position of water protons in the tissues, we propose a Mercer (i.e. positive definite) kernel over the tensor space where both spatial and diffusion information are taken into account. This kernel highlights implicitly the connectivity along fiber tracts. We show that using this kernel in a kernel-PCA setting compounded with a landmark-Isomap embedding and k-means clustering provides a tractable framework for tensor clustering. We extend this kernel to deal with fiber tracts as input using the multi-instance kernel by considering the fiber as set of tensors centered in the sampled points of the tract. The obtained kernel reflects not only interactions between points along fiber tracts, but also the interactions between diffusion tensors. We give an interpretation of the obtained kernel as a comparison of soft fiber representations and show that it amounts to a generalization of the Gaussian kernel Correlation. As in the tensor case, we use the kernel-PCA setting and k-means for grouping of fiber tracts. This unsupervised method is further extended by way of an atlas-based registration of diffusion-free images, followed by a classification of fibers based on non-linear kernel Support Vector Machines (SVMs) and kernel diffusion. The experimental results on a dataset of diffusion tensor images of the calf muscle of 25 patients (of which 5 affected by myopathies, i.e. neuromuscular diseases) show the potential of our method in segmenting the calf in anatomically relevant regions both at the tensor and fiber level

Manifold-driven Grouping of Skeletal Muscle Fibers

In this report, we present a manifold clustering method for the classification of fibers obtained from diffusion tensor images (DTI) of the human skeletal muscle. To this end, we propose the use of angular Hilbertian metrics between multivariate normal distributions to define a family of distances between tensors that we generalize to fibers. The obtained metrics between fiber tracts encompasses both diffusion and localization information. As far as clustering is concerned, we use two methods. The first approach is based on diffusion maps and k-means clustering in the spectral embedding space. The second approach uses a linear programming formulation of prototype-based clustering. This formulation allows for classification over manifolds without the necessity to embed the data in low dimensional spaces and determines automatically the number of clusters. The experimental validation of the proposed framework is done using a manually annotated significant dataset of DTI of the calf muscle for healthy and diseased subjects

Local Appearance Knowledge and Shape Variation Models for Muscle Segmentation

In this report, we present a novel prior knowledge representation of shape variation using diffusion wavelets and applied for medical image segmentation. One of the major advantage of our approach is that it can reflect arbitrary and continuous interdependencies in the training data. In contrast to state-of-the-art methods our framework during the learning stage optimizes the coefficients as well as the number and the position of landmarks using geometric (reconstructed surface) constraints. Saliency is encoded in the model and segmentation is expressed through the extraction of the corresponding features in a new data-set. The resulting paradigm supports hierarchies both in the model and the search space, can encode complex geometric and photometric dependencies of the structure of interest, and can deal with arbitrary topologies. In another hand, our report deals with a different model search methodology where we apply an approach related to active feature models; the location of landmarks is updated iteratively, using local features, and the canonical correlation analysis. We report promising results on two challenging medical data sets, that illustrate the potential of our method

Manifold-driven Grouping of Skeletal Muscle Fibers

In this report, we present a manifold clustering method for the classification of fibers obtained from diffusion tensor images (DTI) of the human skeletal muscle. To this end, we propose the use of angular Hilbertian metrics between multivariate normal distributions to define a family of distances between tensors that we generalize to fibers. The obtained metrics between fiber tracts encompasses both diffusion and localization information. As far as clustering is concerned, we use two methods. The first approach is based on diffusion maps and k-means clustering in the spectral embedding space. The second approach uses a linear programming formulation of prototype-based clustering. This formulation allows for classification over manifolds without the necessity to embed the data in low dimensional spaces and determines automatically the number of clusters. The experimental validation of the proposed framework is done using a manually annotated significant dataset of DTI of the calf muscle for healthy and diseased subjects

Towards Shape Constellation Inference through Higher-Order MRF Optimization in Nonlinear Embeddings

This paper introduces a novel approach for inferring articulated shape models from images. A low-dimensional manifold embedding is created from a training set of prior mesh models to establish the patterns of global shape variations. Local appearance is captured from neighborhoods in the manifold once the overall representation converges. Inference with respect to the manifold and shape parameters is performed using a Markov Random Field (MRF). Singleton and pairwise potentials measure the support from the data and shape coherence from neighboring models respectively, while higher-order cliques encode geometrical modes of variation in localized shape models. Optimization of model parameters is achieved using efficient linear programming and duality. The resulting model is geometrically intuitive, captures the statistical distribution of the underlying manifold and respects image support in the spatial domain. Experimental results on articulated bodies such as spinal column geometry estimation demonstrate the potentials of our approach

Inferring Preoperative Reconstructed Spine Models to Volumetric CT Data through High-Order MRFs

In this paper, we introduce a novel approach based on higher order energy functions which have the ability to encode global structural dependencies to infer articulated 3D spine models to CT volume data. A personalized geometrical model is reconstructed from biplanar X-rays before spinal surgery in order to create a spinal column representation which is modeled by a series of intervertebral transformations based on rotation and translation parameters. The shape transformation between the standing and lying poses is then achieved through a Markov Random Field optimization graph, where the unknown variables are the deformations applied to the intervertebral transformations. Singleton and pairwise potentials measure the support from the data and geometrical dependencies between neighboring vertebrae respectively, while higher order cliques are introduced to integrate consistency in regional curves. Optimization of model parameters in a multi-modal context is achieved using efficient linear programming and duality. A qualitative evaluation of the vertebra model alignment obtained from the proposed method gave promising results while the quantitative comparison to expert identification yields an accuracy of 1.8 +/- 0.7mm based on the localization of surgical landmarks