Monocular Pose Estimation Based on Global and Local Features

The presented thesis work deals with several mathematical and practical aspects of the monocular pose estimation problem. Pose estimation means to estimate the position and orientation of a model object with respect to a camera used as a sensor element. Three main aspects of the pose estimation problem are considered. These are the model representations, correspondence search and pose computation. Free-form contours and surfaces are considered for the approaches presented in this work. The pose estimation problem and the global representation of free-form contours and surfaces are defined in the mathematical framework of the conformal geometric algebra (CGA), which allows a compact and linear modeling of the monocular pose estimation scenario. Additionally, a new local representation of these entities is presented which is also defined in CGA. Furthermore, it allows the extraction of local feature information of these models in 3D space and in the image plane. This local information is combined with the global contour information obtained from the global representations in order to improve the pose estimation algorithms. The main contribution of this work is the introduction of new variants of the iterative closest point (ICP) algorithm based on the combination of local and global features. Sets of compatible model and image features are obtained from the proposed local model representation of free-form contours. This allows to translate the correspondence search problem onto the image plane and to use the feature information to develop new correspondence search criteria. The structural ICP algorithm is defined as a variant of the classical ICP algorithm with additional model and image structural constraints. Initially, this new variant is applied to planar 3D free-form contours. Then, the feature extraction process is adapted to the case of free-form surfaces. This allows to define the correlation ICP algorithm for free-form surfaces. In this case, the minimal Euclidean distance criterion is replaced by a feature correlation measure. The addition of structural information in the search process results in better conditioned correspondences and therefore in a better computed pose. Furthermore, global information (position and orientation) is used in combination with the correlation ICP to simplify and improve the pre-alignment approaches for the monocular pose estimation. Finally, all the presented approaches are combined to handle the pose estimation of surfaces when partial occlusions are present in the image. Experiments made on synthetic and real data are presented to demonstrate the robustness and behavior of the new ICP variants in comparison with standard approaches

Pattern Recognition

Pattern recognition is a very wide research field. It involves factors as diverse as sensors, feature extraction, pattern classification, decision fusion, applications and others. The signals processed are commonly one, two or three dimensional, the processing is done in real- time or takes hours and days, some systems look for one narrow object class, others search huge databases for entries with at least a small amount of similarity. No single person can claim expertise across the whole field, which develops rapidly, updates its paradigms and comprehends several philosophical approaches. This book reflects this diversity by presenting a selection of recent developments within the area of pattern recognition and related fields. It covers theoretical advances in classification and feature extraction as well as application-oriented works. Authors of these 25 works present and advocate recent achievements of their research related to the field of pattern recognition

A Short Survey of Noncommutative Geometry

We give a survey of selected topics in noncommutative geometry, with some emphasis on those directly related to physics, including our recent work with Dirk Kreimer on renormalization and the Riemann-Hilbert problem. We discuss at length two issues. The first is the relevance of the paradigm of geometric space, based on spectral considerations, which is central in the theory. As a simple illustration of the spectral formulation of geometry in the ordinary commutative case, we give a polynomial equation for geometries on the four dimensional sphere with fixed volume. The equation involves an idempotent e, playing the role of the instanton, and the Dirac operator D. It expresses the gamma five matrix as the pairing between the operator theoretic chern characters of e and D. It is of degree five in the idempotent and four in the Dirac operator which only appears through its commutant with the idempotent. It determines both the sphere and all its metrics with fixed volume form. We also show using the noncommutative analogue of the Polyakov action, how to obtain the noncommutative metric (in spectral form) on the noncommutative tori from the formal naive metric. We conclude on some questions related to string theory.Comment: Invited lecture for JMP 2000, 45

Monocular pose estimation based on global and local features

The presented thesis work deals with several mathematical and practical aspects of the monocular pose estimation problem. Pose estimation means to estimate the position and orientation of a model object with respect to a camera used as a sensor element. Threemain aspects of the pose estimation problem are considered. These are themodel representations, correspondence search and pose computation. Free-form contours and surfaces are considered for the approaches presented in this work. The pose estimation problem and the global representation of free-form contours and surfaces are defined in the mathematical framework of the conformal geometric algebra (CGA), which allows a compact and linear modeling of the monocular pose estimation scenario. Additionally, a new local representation of these entities is presented which is also defined in CGA. Furthermore, it allows the extraction of local feature information of these models in 3D space and in the image plane. This local information is combined with the global contour information obtained from the global representations in order to improve the pose estimation algorithms. The main contribution of this work is the introduction of new variants of the iterative closest point (ICP) algorithm based on the combination of local and global features. Sets of compatible model and image features are obtained from the proposed local model representation of free-form contours. This allows to translate the correspondence search problem onto the image plane and to use the feature information to develop new correspondence search criteria. The structural ICP algorithm is defined as a variant of the classical ICP algorithm with additional model and image structural constraints. Initially, this new variant is applied to planar 3D free-form contours. Then, the feature extraction process is adapted to the case of free-form surfaces. This allows to define the correlation ICP algorithm for free-form surfaces. In this case, the minimal Euclidean distance criterion is replaced by a feature correlation measure. The addition of structural information in the search process results in better conditioned correspondences and therefore in a better computed pose. Furthermore, global information (position and orientation) is used in combination with the correlation ICP to simplify and improve the pre-alignment approaches for the monocular pose estimation. Finally, all the presented approaches are combined to handle the pose estimation of surfaces when partial occlusions are present in the image. Experiments made on synthetic and real data are presented to demonstrate the robustness and behavior of the new ICP variants in comparison with standard approaches

Distribution Free Prediction Intervals for Multiple Functional Regression

My research aims to establish a method of constructing prediction intervals for a scalar response of interest when predictors are functional data, with minimal distributional and modeling assumptions. To accommodate flexible regression relationships, we integrated nonparametric functional regression based on functional principal component analysis into our conformal prediction method, and we developed nonparametric functional regression approaches based on the signature method, which is a mathematical tool to represent the information contained in the functions by a collection of iterated integrals. The prediction intervals constructed by the conformal method have guaranteed coverage (confidence) without the heavy restrictions on the error distribution and on the regression function, while the efficiency (implied by the length of the intervals) will depend on the representation and information compression of the functional predictors. Conditions necessary for efficiency and contiguity of the prediction set are discussed. Finally, our methods are illustrated using simulated and real data examples

Diskrete Spin-Geometrie für Flächen

This thesis proposes a discrete framework for spin geometry of surfaces. Specifically, we discretize the basic notions in spin geometry, such as the spin structure, spin connection and Dirac operator. In this framework, two types of Dirac operators are closely related as in smooth case. Moreover, they both induce the discrete conformal immersion with prescribed mean curvature half-density.In dieser Arbeit wird ein diskreter Zugang zur Spin-Geometrie vorgestellt. Insbesondere diskretisieren wir die grundlegende Begriffe, wie zum Beispiel die Spin-Struktur, den Spin-Zusammenhang und den Dirac Operator. In diesem Rahmen sind zwei Varianten für den Dirac Operator eng verwandt wie in der glatten Theorie. Darüber hinaus induzieren beide die diskret-konforme Immersion mit vorgeschriebener Halbdichte der mittleren Krümmung

Fault Diagnosis of Supervision and Homogenization Distance Based on Local Linear Embedding Algorithm

In view of the problems of uneven distribution of reality fault samples and dimension reduction effect of locally linear embedding (LLE) algorithm which is easily affected by neighboring points, an improved local linear embedding algorithm of homogenization distance (HLLE) is developed. The method makes the overall distribution of sample points tend to be homogenization and reduces the influence of neighboring points using homogenization distance instead of the traditional Euclidean distance. It is helpful to choose effective neighboring points to construct weight matrix for dimension reduction. Because the fault recognition performance improvement of HLLE is limited and unstable, the paper further proposes a new local linear embedding algorithm of supervision and homogenization distance (SHLLE) by adding the supervised learning mechanism. On the basis of homogenization distance, supervised learning increases the category information of sample points so that the same category of sample points will be gathered and the heterogeneous category of sample points will be scattered. It effectively improves the performance of fault diagnosis and maintains stability at the same time. A comparison of the methods mentioned above was made by simulation experiment with rotor system fault diagnosis, and the results show that SHLLE algorithm has superior fault recognition performance

Constructing Desirable Scalar Fields for Morse Analysis on Meshes

Morse theory is a powerful mathematical tool that uses the local differential properties of a manifold to make conclusions about global topological aspects of the manifold. Morse theory has been proven to be a very useful tool in computer graphics, geometric data processing and understanding. This work is divided into two parts. The first part is concerned with constructing geometry and symmetry aware scalar functions on a triangulated $2$-manifold. To effectively apply Morse theory to discrete manifolds, one needs to design scalar functions on them with certain properties such as respecting the symmetry and the geometry of the surface and having the critical points of the scalar function coincide with feature or symmetry points on the surface. In this work, we study multiple methods that were suggested in the literature to construct such functions such as isometry invariant scalar functions, Poisson fields and discrete conformal factors. We suggest multiple refinements to each family of these functions and we propose new methods to construct geometry and symmetry-aware scalar functions using mainly the theory of the Laplace-Beltrami operator. Our proposed methods are general and can be applied in many areas such as parametrization, shape analysis, symmetry detection and segmentation. In the second part of the thesis we utilize Morse theory to give topologically consistent segmentation algorithms