Minimizing the Multi-view Stereo Reprojection Error for Triangular Surface Meshes

International audienceThis article proposes a variational multi-view stereo vision method based on meshes for recovering 3D scenes (shape and radiance) from images. Our method is based on generative models and minimizes the reprojection error (difference between the observed images and the images synthesized from the reconstruction). Our contributions are twofold. 1) For the first time, we rigorously compute the gradient of the reprojection error for non smooth surfaces defined by discrete triangular meshes. The gradient correctly takes into account the visibility changes that occur when a surface moves; this forces the contours generated by the reconstructed surface to perfectly match with the apparent contours in the input images. 2) We propose an original modification of the Lambertian model to take into account deviations from the constant brightness assumption without explicitly modelling the reflectance properties of the scene or other photometric phenomena involved by the camera model. Our method is thus able to recover the shape and the diffuse radiance of non Lambertian scenes

Geometric Surface Processing and Virtual Modeling

In this work we focus on two main topics "Geometric Surface Processing" and "Virtual Modeling". The inspiration and coordination for most of the research work contained in the thesis has been driven by the project New Interactive and Innovative Technologies for CAD (NIIT4CAD), funded by the European Eurostars Programme. NIIT4CAD has the ambitious aim of overcoming the limitations of the traditional approach to surface modeling of current 3D CAD systems by introducing new methodologies and technologies based on subdivision surfaces in a new virtual modeling framework. These innovations will allow designers and engineers to transform quickly and intuitively an idea of shape in a high-quality geometrical model suited for engineering and manufacturing purposes. One of the objective of the thesis is indeed the reconstruction and modeling of surfaces, representing arbitrary topology objects, starting from 3D irregular curve networks acquired through an ad-hoc smart-pen device. The thesis is organized in two main parts: "Geometric Surface Processing" and "Virtual Modeling". During the development of the geometric pipeline in our Virtual Modeling system, we faced many challenges that captured our interest and opened new areas of research and experimentation. In the first part, we present these theories and some applications to Geometric Surface Processing. This allowed us to better formalize and give a broader understanding on some of the techniques used in our latest advancements on virtual modeling and surface reconstruction. The research on both topics led to important results that have been published and presented in articles and conferences of international relevance

ShapeWright--finite element based free-form shape design

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Mechanical Engineering, 1990.Includes bibliographical references (p. 179-192).by George Celniker.Ph.D

Mini-Workshop: Analytical and Numerical Methods in Image and Surface Processing

The workshop successfully brought together researchers from mathematical analysis, numerical mathematics, computer graphics and image processing. The focus was on variational methods in image and surface processing such as active contour models, Mumford-Shah type functionals, image and surface denoising based on geometric evolution problems in image and surface fairing, physical modeling of surfaces, the restoration of images and surfaces using higher order variational formulations

Generation, Estimation and Tracking of Faces

This thesis describes techniques for the construction of face models for both computer graphics and computer vision applications. It also details model-based computer vision methods for extracting and combining data with the model. Our face models respect the measurements of populations described by face anthropometry studies. In computer graphics, the anthropometric measurements permit the automatic generation of varied geometric models of human faces. This is accomplished by producing a random set of face measurements generated according to anthropometric statistics. A face fitting these measurements is realized using variational modeling. In computer vision, anthropometric data biases face shape estimation towards more plausible individuals. Having such a detailed model encourages the use of model-based techniques—we use a physics-based deformable model framework. We derive and solve a dynamic system which accounts for edges in the image and incorporates optical flow as a motion constraint on the model. Our solution ensures this constraint remains satisfied when edge information is used, which helps prevent tracking drift. This method is extended using the residuals from the optical flow solution. The extracted structure of the model can be improved by determining small changes in the model that reduce this error residual. We present experiments in extracting the shape and motion of a face from image sequences which exhibit the generality of our technique, as well as provide validation

Integration between Creativity and Engineering in Industrial Design

The objective of the paper is to illustrate which are the key issues today in the industrial design workflow, paying particular attention to the most creative part of the workflow, highlighting those nodes which still make hard the styling activities and giving a brief survey of the researches aimed at smoothing the transfer of the design intent along the whole design cycle and at providing tools even more adhering at the mentality of creative people. Based on the experience gained working in two different European projects, through the collaboration with industrial designers in the automotive and the household supplies fields, a general industrial design workflow will be depicted, highlighting the main differences between the automotive and non-automotive sectors; the problems still present in the design activity will be also illustrated. The paper includes short surveys, in relation to the aesthetic design, in matter of research activities aimed at - identifying the links between shape characteristics of a product and the transmitted emotions - better supporting, in a digital way, the 2D sketching phase and the automatic interpretation and transfer of the 2D sketches into a 3D surface model - improving the 3D Modeling phase