Multiple Shape Registration using Constrained Optimal Control

Lagrangian particle formulations of the large deformation diffeomorphic metric mapping algorithm (LDDMM) only allow for the study of a single shape. In this paper, we introduce and discuss both a theoretical and practical setting for the simultaneous study of multiple shapes that are either stitched to one another or slide along a submanifold. The method is described within the optimal control formalism, and optimality conditions are given, together with the equations that are needed to implement augmented Lagrangian methods. Experimental results are provided for stitched and sliding surfaces

Higher-order Graph Principles towards Non-rigid Surface Registration

This report casts surface registration as the problem of finding a set of discrete correspondences through the minimization of an energy function, which is composed of geometric and appearance matching costs, as well as higher-order deformation priors. Two higher-order graph-based formulations are proposed under different deformation assumptions. The first formulation encodes isometric deformations using conformal geometry in a higher-order graph matching problem, which is solved through dual-decomposition and is able to handle partial matching. Despite the isometry assumption, this approach is able to robustly match sparse feature point sets on surfaces undergoing highly anisometric deformations. Nevertheless, its performance degrades significantly when addressing anisometric registration for a set of densely sampled points. This issue is rigorously addressed subsequently through a novel deformation model that is able to handle arbitrary diffeomorphisms between two surfaces. Such a deformation model is introduced into a higher-order Markov Random Field for dense surface registration, and is inferred using a new parallel and memory efficient algorithm. To deal with the prohibitive search space, we design an efficient way to select a number of matching candidates for each point of the source surface based on the matching results of a sparse set of points. A series of experiments demonstrate the accuracy and the efficiency of the proposed framework, notably in challenging cases of large and/or anisometric deformations, or surfaces that are partially occluded.Ce rapport formalise le problème du recalage de surfaces 3D comme la recherche d’un ensemble de correspondances discrètes par la minimisation d’une fonction d’énergie, qui est composée de fonctions de coûts mesurant des similitudes géométriques et d’apparence, et des à priori d’ordre élevé sur la déformation. Deux formulations à base de graphes d’ordre élevé sont proposées sous différentes hypothèses de déformation. La première formulation encode la déformation isométrique, à partir de géométrie conforme, dans un problème d’appariement de graphes d’ordre élevé, qui est résolu par décomposition duale et est capable de gérer les cas de correspondance partielle. Malgré l’hypothèse d’isométrie, cette approche est capable de mettre en correspondance de manière robuste deux ensembles clairsemés de points sur deux surfaces, y compris lorsque celles-ci subissent une déformation fortement anisométrique. Cependant, sa performance se dégrade de manière significative lorsqu’elle est étendue au recalage anisométrique d’un ensemble de points à forte densité. Ce problème est rigoureusement traité par la suite à travers un nouveau modèle de déformation capable de gérer des difféomorphismes arbitraires entre deux surfaces. Ce modèle de déformation est introduit dans une formulation MRF d’ordre élevé pour le recalage dense de surfaces, et être inféré en utilisant un nouvel algorithme parallèle et efficace en termes de mémoire. Pour traiter l’espace de recherche prohibitif, nous concevons une méthode efficace pour sélectionner un ensemble de correspondants potentiels pour chaque point appartenant à la surface source. Cette méthode est basée sur les résultats d’appariement d’un ensemble clairsemé de points. Notre méthode est validée au moyen d’une série d’expériences qui démontrent sa précision et son efficacité, notamment dans les cas difficiles où des déformations importantes et/ou anisométriques sont présentes, ou lorsque les maillages sont partiellement cachés

Shape Matching Based on Diffusion Embedding and on Mutual Isometric Consistency

International audienceWe address the problem of matching two 3D shapes by representing them using the eigenvalues and eigenvectors of the discrete diffusion operator. This provides a representation framework useful for both scale-space shape descriptors and shape comparisons. We formally introduce a canonical diffusion embedding based on the combinatorial Laplacian; we reveal some interesting properties and we propose a unit hypersphere normalization of this embedding. We also propose a practical algorithm that seeks the largest set of mutually consistent point-to-point matches between two shapes based on isometric consistency between the two embeddings. We illustrate our method with several examples of matching shapes at various scales

3D Shape Registration Using Spectral Graph Embedding and Probabilistic Matching

International audienceIn this book chapter we address the problem of 3D shape registration and we propose a novel technique based on spectral graph theory and probabilistic matching. Recent advancement in shape acquisition technology has led to the capture of large amounts of 3D data. Existing real-time multi-camera 3D acquisition methods provide a frame-wise reliable visual-hull or mesh representations for real 3D animation sequences The task of 3D shape analysis involves tracking, recognition, registration, etc. Analyzing 3D data in a single framework is still a challenging task considering the large variability of the data gathered with different acquisition devices. 3D shape registration is one such challenging shape analysis task. The main contribution of this chapter is to extend the spectral graph matching methods to very large graphs by combining spectral graph matching with Laplacian embedding. Since the embedded representation of a graph is obtained by dimensionality reduction we claim that the existing spectral-based methods are not easily applicable. We discuss solutions for the exact and inexact graph isomorphism problems and recall the main spectral properties of the combinatorial graph Laplacian; We provide a novel analysis of the commute-time embedding that allows us to interpret the latter in terms of the PCA of a graph, and to select the appropriate dimension of the associated embedded metric space; We derive a unit hyper-sphere normalization for the commute-time embedding that allows us to register two shapes with different samplings; We propose a novel method to find the eigenvalue-eigenvector ordering and the eigenvector sign using the eigensignature (histogram) which is invariant to the isometric shape deformations and fits well in the spectral graph matching framework, and we present a probabilistic shape matching formulation using an expectation maximization point registration algorithm which alternates between aligning the eigenbases and finding a vertex-to-vertex assignment

Courbure discrète : théorie et applications

International audienceThe present volume contains the proceedings of the 2013 Meeting on discrete curvature, held at CIRM, Luminy, France. The aim of this meeting was to bring together researchers from various backgrounds, ranging from mathematics to computer science, with a focus on both theory and applications. With 27 invited talks and 8 posters, the conference attracted 70 researchers from all over the world. The challenge of finding a common ground on the topic of discrete curvature was met with success, and these proceedings are a testimony of this wor

Conformal Wasserstein distances: comparing surfaces in polynomial time

We present a constructive approach to surface comparison realizable by a polynomial-time algorithm. We determine the "similarity" of two given surfaces by solving a mass-transportation problem between their conformal densities. This mass transportation problem differs from the standard case in that we require the solution to be invariant under global M\"{o}bius transformations. We present in detail the case where the surfaces to compare are disk-like; we also sketch how the approach can be generalized to other types of surfaces.Comment: 23 pages, 3 figure

Structural Surface Mapping for Shape Analysis

Natural surfaces are usually associated with feature graphs, such as the cortical surface with anatomical atlas structure. Such a feature graph subdivides the whole surface into meaningful sub-regions. Existing brain mapping and registration methods did not integrate anatomical atlas structures. As a result, with existing brain mappings, it is difficult to visualize and compare the atlas structures. And also existing brain registration methods can not guarantee the best possible alignment of the cortical regions which can help computing more accurate shape similarity metrics for neurodegenerative disease analysis, e.g., Alzheimer’s disease (AD) classification. Also, not much attention has been paid to tackle surface parameterization and registration with graph constraints in a rigorous way which have many applications in graphics, e.g., surface and image morphing. This dissertation explores structural mappings for shape analysis of surfaces using the feature graphs as constraints. (1) First, we propose structural brain mapping which maps the brain cortical surface onto a planar convex domain using Tutte embedding of a novel atlas graph and harmonic map with atlas graph constraints to facilitate visualization and comparison between the atlas structures. (2) Next, we propose a novel brain registration technique based on an intrinsic atlas-constrained harmonic map which provides the best possible alignment of the cortical regions. (3) After that, the proposed brain registration technique has been applied to compute shape similarity metrics for AD classification. (4) Finally, we propose techniques to compute intrinsic graph-constrained parameterization and registration for general genus-0 surfaces which have been used in surface and image morphing applications