3D facial merging for virtual human reconstruction

There is an increasing need of easy and affordable technologies to automatically generate virtual 3D models from their real counterparts. In particular, 3D human reconstruction has driven the creation of many clever techniques, most of them based on the visual hull (VH) concept. Such techniques do not require expensive hardware; however, they tend to yield 3D humanoids with realistic bodies but mediocre faces, since VH cannot handle concavities. On the other hand, structured light projectors allow to capture very accurate depth data, and thus to reconstruct realistic faces, but they are too expensive to use several of them. We have developed a technique to merge a VH-based 3D mesh of a reconstructed humanoid and the depth data of its face, captured by a single structured light projector. By combining the advantages of both systems in a simple setting, we are able to reconstruct realistic 3D human models with believable faces

Publicaciones, ponencias, patentes, registros y emprendimientos 2011

Este documento presenta la relación de publicaciones, ponencias, patentes, registros y emprendimientos realizados por la Universidad EAFIT en el año 2011. La información está organizada por Grupos de Investigación dentro de cada una de las Escuelas. En la parte final, de manera repetida, se indican los productos en los que han participado estudiantes tanto de posgrado como de pregrado. Estos autores se indican en subrayado. Cada contribución aparece en orden alfabético dentro de la correspondiente categoría de la siguiente secuencia: publicaciones internacionales, ublicaciones nacionales, ponencias internacionales, ponencias nacionales, patentes, registros y emprendimientos. En las publicaciones están comprendidos los libros, capítulos de libros y artículos de revista. Las ponencias relacionan las presentaciones en conferencias, congresos y eventos de divulgación. La mayoría de estas presentaciones figuran, tal como se indica en cada caso, publicadas como parte de las memorias del evento respectivo

Face Reconstruction with structured light

This article presents a methodology for reconstruction of 3D faces which is based on stereoscopic images of the scene using active and passive surface reconstruction -- A sequence of gray patterns is generated, which are projected onto the scene and their projection recorded by a pair of stereo cameras -- The images are rectified to make coincident their epipolar planes and so to generate a stereo map of the scene -- An algorithm for stereo matching is applied, whose result is a bijective mapping between subsets of the pixels of the images -- A particular connected subset of the images (e.g. the face) is selected by a segmentation algorithm -- The stereo mapping is applied to such a subset and enables the triangulation of the two image readings therefore rendering the (x;y; z) points of the face, which in turn allow the reconstruction of the triangular mesh of the face -- Since the surface might have holes, bilateral filters are applied to have the holes filled -- The algorithms are tested in real conditions and we evaluate their performance with virtual datasets -- Our results show a good reconstruction of the faces and an improvement of the results of passive system

Face reconstruction with structured light

This article presents a methodology for reconstruction of 3D faces which is based on stereoscopic images of the scene using active and passive surface reconstruction. A sequence of Gray patterns is generated, which are projected onto the scene and their projection recorded by a pair of stereo cameras. The images are rectified to make coincident their epipolar planes and so to generate a stereo map of the scene. An algorithm for stereo matching is applied, whose result is a bijective mapping between subsets of the pixels of the images. A particular connected subset of the images (e.g. the face) is selected by a segmentation algorithm. The stereo mapping is applied to such a subset and enables the triangulation of the two image readings therefore rendering the (x,y,z) points of the face, which in turn allow the reconstruction of the triangular mesh of the face. Since the surface might have holes, bilateral filters are applied to have the holes filled. The algorithms are tested in real conditions and we evaluate their performance with virtual datasets. Our results show a good reconstruction of the faces and an improvement of the results of passive systems