Finite element surface registration incorporating curvature, volume preservation, and statistical model information

We present a novel method for nonrigid registration of 3D surfaces and images. The method can be used to register surfaces by means of their distance images, or to register medical images directly. It is formulated as a minimization problem of a sum of several terms representing the desired properties of a registration result: smoothness, volume preservation, matching of the surface, its curvature, and possible other feature images, as well as consistency with previous registration results of similar objects, represented by a statistical deformation model. While most of these concepts are already known, we present a coherent continuous formulation of these constraints, including the statistical deformation model. This continuous formulation renders the registration method independent of its discretization. The finite element discretization we present is, while independent of the registration functional, the second main contribution of this paper. The local discontinuous Galerkin method has not previously been used in image registration, and it provides an efficient and general framework to discretize each of the terms of our functional. Computational efficiency and modest memory consumption are achieved thanks to parallelization and locally adaptive mesh refinement. This allows for the first time the use of otherwise prohibitively large 3D statistical deformation models

Non-rigid registration by geometry-constrained diffusion.

. Assume that only partial knowledge about a non-rigid registration is given so that certain points, curves, or surfaces in one 3D image map to certain certain points, curves, or surfaces in another 3D image. We are facing the aperture problem because along the curves and surfaces, point correspondences are not given. We will advocate the viewpoint that the aperture and the 3D interpolation problem may be solved simultaneously by finding the simplest displacement field. This is obtained by a geometry-constrained diffusion which yields the simplest displacement field in a precise sense. The point registration obtained may be used for growth modelling, shape statistics, or kinematic interpolation. The algorithm applies to geometrical objects of any dimensionality. We may thus keep any number of fiducial points, curves, and/or surfaces fixed while finding the simplest registration. Examples of inferred point correspondences in a longitudinal growth study of the mandible are g..

3D shape matching and registration : a probabilistic perspective

Dense correspondence is a key area in computer vision and medical image analysis. It has applications in registration and shape analysis. In this thesis, we develop a technique to recover dense correspondences between the surfaces of neuroanatomical objects over heterogeneous populations of individuals. We recover dense correspondences based on 3D shape matching. In this thesis, the 3D shape matching problem is formulated under the framework of Markov Random Fields (MRFs). We represent the surfaces of neuroanatomical objects as genus zero voxel-based meshes. The surface meshes are projected into a Markov random field space. The projection carries both geometric and topological information in terms of Gaussian curvature and mesh neighbourhood from the original space to the random field space. Gaussian curvature is projected to the nodes of the MRF, and the mesh neighbourhood structure is projected to the edges. 3D shape matching between two surface meshes is then performed by solving an energy function minimisation problem formulated with MRFs. The outcome of the 3D shape matching is dense point-to-point correspondences. However, the minimisation of the energy function is NP hard. In this thesis, we use belief propagation to perform the probabilistic inference for 3D shape matching. A sparse update loopy belief propagation algorithm adapted to the 3D shape matching is proposed to obtain an approximate global solution for the 3D shape matching problem. The sparse update loopy belief propagation algorithm demonstrates significant efficiency gain compared to standard belief propagation. The computational complexity and convergence property analysis for the sparse update loopy belief propagation algorithm are also conducted in the thesis. We also investigate randomised algorithms to minimise the energy function. In order to enhance the shape matching rate and increase the inlier support set, we propose a novel clamping technique. The clamping technique is realized by combining the loopy belief propagation message updating rule with the feedback from 3D rigid body registration. By using this clamping technique, the correct shape matching rate is increased significantly. Finally, we investigate 3D shape registration techniques based on the 3D shape matching result. Based on the point-to-point dense correspondences obtained from the 3D shape matching, a three-point based transformation estimation technique is combined with the RANdom SAmple Consensus (RANSAC) algorithm to obtain the inlier support set. The global registration approach is purely dependent on point-wise correspondences between two meshed surfaces. It has the advantage that the need for orientation initialisation is eliminated and that all shapes of spherical topology. The comparison of our MRF based 3D registration approach with a state-of-the-art registration algorithm, the first order ellipsoid template, is conducted in the experiments. These show dense correspondence for pairs of hippocampi from two different data sets, each of around 20 60+ year old healthy individuals

Structured Light-Based 3D Reconstruction System for Plants.

Camera-based 3D reconstruction of physical objects is one of the most popular computer vision trends in recent years. Many systems have been built to model different real-world subjects, but there is lack of a completely robust system for plants. This paper presents a full 3D reconstruction system that incorporates both hardware structures (including the proposed structured light system to enhance textures on object surfaces) and software algorithms (including the proposed 3D point cloud registration and plant feature measurement). This paper demonstrates the ability to produce 3D models of whole plants created from multiple pairs of stereo images taken at different viewing angles, without the need to destructively cut away any parts of a plant. The ability to accurately predict phenotyping features, such as the number of leaves, plant height, leaf size and internode distances, is also demonstrated. Experimental results show that, for plants having a range of leaf sizes and a distance between leaves appropriate for the hardware design, the algorithms successfully predict phenotyping features in the target crops, with a recall of 0.97 and a precision of 0.89 for leaf detection and less than a 13-mm error for plant size, leaf size and internode distance

Co-registration of 3d point clouds by using an errors-in-variables model

Co-registration of point clouds of partially scanned objects is the first step of the 3D modeling workflow. The aim of co-registration is to merge the overlapping point clouds by estimating the spatial transformation parameters. In the literature, one of the most popular methods is the ICP (Iterative Closest Point) algorithm and its variants. There exist the 3D least squares (LS) matching methods as well. In most of the co-registration methods, the stochastic properties of the search surfaces are usually omitted. This omission is expected to be minor and does not disturb the solution vector significantly. However, the a posteriori covariance matrix will be affected by the neglected uncertainty of the function values. This causes deterioration in the realistic precision estimates. In order to overcome this limitation, we propose a new method where the stochastic properties of both (template and search) surfaces are considered under an errors-in-variables (EIV) model. The experiments have been carried out using a close range laser scanning data set and the results of the conventional and EIV types of the ICP matching methods have been compared.Publisher's Versio

3D mudeli koostamine Kinect v2 kaamera abil

Kinect is an easy to use and a ordable RGB-D acquisition device that provides both spatial and color information for captured pixels. That makes it an attractive alternative to regular 3D scanning devices that usually cost signi cantly more and do not provide color info. Second generation of Kinect (v2) provides even better quality depth and color images to user. This thesis describes and implements method for 3D reconstruction using Kinect v2. Method suitability for various objects is tested and analyzed. In most circumstances the method provided satisfactory reconstructions unless very high resolution is desired. However some limitation were observed. Reflective and transparent surfaces cause failure due to depth capturing technology in Kinect v2, symmetric objects cause problems for described frame registration algorithm. For better understanding, Kinect v2 depth measuring process is described

3D scanning of cultural heritage with consumer depth cameras

Three dimensional reconstruction of cultural heritage objects is an expensive and time-consuming process. Recent consumer real-time depth acquisition devices, like Microsoft Kinect, allow very fast and simple acquisition of 3D views. However 3D scanning with such devices is a challenging task due to the limited accuracy and reliability of the acquired data. This paper introduces a 3D reconstruction pipeline suited to use consumer depth cameras as hand-held scanners for cultural heritage objects. Several new contributions have been made to achieve this result. They include an ad-hoc filtering scheme that exploits the model of the error on the acquired data and a novel algorithm for the extraction of salient points exploiting both depth and color data. Then the salient points are used within a modified version of the ICP algorithm that exploits both geometry and color distances to precisely align the views even when geometry information is not sufficient to constrain the registration. The proposed method, although applicable to generic scenes, has been tuned to the acquisition of sculptures and in this connection its performance is rather interesting as the experimental results indicate