Sequential non-rigid structure from motion using physical priors

© 20xx IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.We propose a new approach to simultaneously recover camera pose and 3D shape of non-rigid and potentially extensible surfaces from a monocular image sequence. For this purpose, we make use of the Extended Kalman Filter based Simultaneous Localization And Mapping (EKF-SLAM) formulation, a Bayesian optimization framework traditionally used in mobile robotics for estimating camera pose and reconstructing rigid scenarios. In order to extend the problem to a deformable domain we represent the object's surface mechanics by means of Navier's equations, which are solved using a Finite Element Method (FEM). With these main ingredients, we can further model the material's stretching, allowing us to go a step further than most of current techniques, typically constrained to surfaces undergoing isometric deformations. We extensively validate our approach in both real and synthetic experiments, and demonstrate its advantages with respect to competing methods. More specifically, we show that besides simultaneously retrieving camera pose and non-rigid shape, our approach is adequate for both isometric and extensible surfaces, does not require neither batch processing all the frames nor tracking points over the whole sequence and runs at several frames per second.Peer ReviewedPostprint (author's final draft

Real-time 3D reconstruction of non-rigid shapes with a single moving camera

© . This manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0/This paper describes a real-time sequential method to simultaneously recover the camera motion and the 3D shape of deformable objects from a calibrated monocular video. For this purpose, we consider the Navier-Cauchy equations used in 3D linear elasticity and solved by finite elements, to model the time-varying shape per frame. These equations are embedded in an extended Kalman filter, resulting in sequential Bayesian estimation approach. We represent the shape, with unknown material properties, as a combination of elastic elements whose nodal points correspond to salient points in the image. The global rigidity of the shape is encoded by a stiffness matrix, computed after assembling each of these elements. With this piecewise model, we can linearly relate the 3D displacements with the 3D acting forces that cause the object deformation, assumed to be normally distributed. While standard finite-element-method techniques require imposing boundary conditions to solve the resulting linear system, in this work we eliminate this requirement by modeling the compliance matrix with a generalized pseudoinverse that enforces a pre-fixed rank. Our framework also ensures surface continuity without the need for a post-processing step to stitch all the piecewise reconstructions into a global smooth shape. We present experimental results using both synthetic and real videos for different scenarios ranging from isometric to elastic deformations. We also show the consistency of the estimation with respect to 3D ground truth data, include several experiments assessing robustness against artifacts and finally, provide an experimental validation of our performance in real time at frame rate for small mapsPeer ReviewedPostprint (author's final draft

Voltage-Induced Friction with Application to Electrovibration

Due to the growing interest in robotic and haptic applications, voltage-induced friction has rapidly gained in importance in recent years. However, despite extensive experimental investigations, the underlying principles are still not sufficiently understood, which complicates reliable modeling. We present a macroscopic model for solving electroadhesive frictional contacts which exploits the close analogy to classical adhesion theories, like Johnson-Kendall-Roberts (JKR) and Maugis, valid for electrically neutral bodies. For this purpose, we recalculate the adhesion force per unit area and the relative surface energy from electrostatics. Under the assumption of Coulomb friction in the contact interface, a closed form equation for the friction force is derived. As an application, we consider the frictional contact between the fingertip and touchscreen under electrovibration in more detail. The results obtained with the new model agree well with available experimental data of the recent literature. The strengths and limitations of the model are clearly discussed.TU Berlin, Open-Access-Mittel – 201

A Review of Prosthetic Interface Stress Investigations

Over the last decade, numerous experimental and numerical analyses have been conducted to investigate the stress distribution between the residual limb and prosthetic socket of persons with lower limb amputation. The objectives of these analyses have been to improve our understanding of the residual limb/prosthetic socket system, to evaluate the influence of prosthetic design parameters and alignment variations on the interface stress distribution, and to evaluate prosthetic fit. The purpose of this paper is to summarize these experimental investigations and identify associated limitations. In addition, this paper presents an overview of various computer models used to investigate the residual limb interface, and discusses the differences and potential ramifications of the various modeling formulations. Finally, the potential and future applications of these experimental and numerical analyses in prosthetic design are presented