Scalable Dense Non-rigid Structure-from-Motion: A Grassmannian Perspective

This paper addresses the task of dense non-rigid structure-from-motion (NRSfM) using multiple images. State-of-the-art methods to this problem are often hurdled by scalability, expensive computations, and noisy measurements. Further, recent methods to NRSfM usually either assume a small number of sparse feature points or ignore local non-linearities of shape deformations, and thus cannot reliably model complex non-rigid deformations. To address these issues, in this paper, we propose a new approach for dense NRSfM by modeling the problem on a Grassmann manifold. Specifically, we assume the complex non-rigid deformations lie on a union of local linear subspaces both spatially and temporally. This naturally allows for a compact representation of the complex non-rigid deformation over frames. We provide experimental results on several synthetic and real benchmark datasets. The procured results clearly demonstrate that our method, apart from being scalable and more accurate than state-of-the-art methods, is also more robust to noise and generalizes to highly non-linear deformations.Comment: 10 pages, 7 figure, 4 tables. Accepted for publication in Conference on Computer Vision and Pattern Recognition (CVPR), 2018, typos fixed and acknowledgement adde

A factorization approach to inertial affine structure from motion

We consider the problem of reconstructing a 3-D scene from a moving camera with high frame rate using the affine projection model. This problem is traditionally known as Affine Structure from Motion (Affine SfM), and can be solved using an elegant low-rank factorization formulation. In this paper, we assume that an accelerometer and gyro are rigidly mounted with the camera, so that synchronized linear acceleration and angular velocity measurements are available together with the image measurements. We extend the standard Affine SfM algorithm to integrate these measurements through the use of image derivatives

A factorization approach to inertial affine structure from motion

We consider the problem of reconstructing a 3-D scene from a moving camera with high frame rate using the affine projection model. This problem is traditionally known as Affine Structure from Motion (Affine SfM), and can be solved using an elegant low-rank factorization formulation. In this paper, we assume that an accelerometer and gyro are rigidly mounted with the camera, so that synchronized linear acceleration and angular velocity measurements are available together with the image measurements. We extend the standard Affine SfM algorithm to integrate these measurements through the use of image derivatives

Lagrangian reduction of nonholonomic discrete mechanical systems

In this paper we propose a process of lagrangian reduction and reconstruction for nonholonomic discrete mechanical systems where the action of a continuous symmetry group makes the configuration space a principal bundle. The result of the reduction process is a discrete dynamical system that we call the discrete reduced system. We illustrate the techniques by analyzing two types of discrete symmetric systems where it is possible to go further and obtain (forced) discrete mechanical systems that determine the dynamics of the discrete reduced system.Comment: 44 pages, 1 figur

Optimal Control for Holonomic and Nonholonomic Mechanical Systems with Symmetry and Lagrangian Reduction

In this paper we establish necessary conditions for optimal control using the ideas of Lagrangian reduction in the sense of reduction under a symmetry group. The techniques developed here are designed for Lagrangian mechanical control systems with symmetry. The benefit of such an approach is that it makes use of the special structure of the system, especially its symmetry structure and thus it leads rather directly to the desired conclusions for such systems. Lagrangian reduction can do in one step what one can alternatively do by applying the Pontryagin Maximum Principle followed by an application of Poisson reduction. The idea of using Lagrangian reduction in the sense of symmetry reduction was also obtained by Bloch and Crouch [1995a,b] in a somewhat different context and the general idea is closely related to those in Montgomery [1990] and Vershik and Gershkovich [1994]. Here we develop this idea further and apply it to some known examples, such as optimal control on Lie groups and principal bundles (such as the ball and plate problem) and reorientation examples with zero angular momentum (such as the satellite with moveable masses). However, one of our main goals is to extend the method to the case of nonholonomic systems with a nontrivial momentum equation in the context of the work of Bloch, Krishnaprasad, Marsden and Murray [1995]. The snakeboard is used to illustrate the method