High-Quality Animatable Dynamic Garment Reconstruction from Monocular Videos

Much progress has been made in reconstructing garments from an image or a video. However, none of existing works meet the expectations of digitizing high-quality animatable dynamic garments that can be adjusted to various unseen poses. In this paper, we propose the first method to recover high-quality animatable dynamic garments from monocular videos without depending on scanned data. To generate reasonable deformations for various unseen poses, we propose a learnable garment deformation network that formulates the garment reconstruction task as a pose-driven deformation problem. To alleviate the ambiguity estimating 3D garments from monocular videos, we design a multi-hypothesis deformation module that learns spatial representations of multiple plausible deformations. Experimental results on several public datasets demonstrate that our method can reconstruct high-quality dynamic garments with coherent surface details, which can be easily animated under unseen poses. The code will be provided for research purposes

High-quality animatable dynamic garment reconstruction from monocular videos

Much progress has been made in reconstructing garments from an image or a video. However, none of existing works meet the expectations of digitizing high-quality animatable dynamic garments that can be adjusted to various unseen poses. In this paper, we propose the first method to recover high-quality animatable dynamic garments from monocular videos without depending on scanned data. To generate reasonable deformations for various unseen poses, we propose a learnable garment deformation network that formulates the garment reconstruction task as a pose-driven deformation problem. To alleviate the ambiguity estimating 3D garments from monocular videos, we design a multi-hypothesis deformation module that learns spatial representations of multiple plausible deformations. Experimental results on several public datasets demonstrate that our method can reconstruct high-quality dynamic garments with coherent surface details, which can be easily animated under unseen poses. The code will be provided for research purposes

3D human body modelling from range data

This thesis describes the design, implementation and application of an integrated and fully automated system for interpreting whole-body range data. The system is shown to be capable of generating complete surface models of human bodies, and robustly extracting anatomical features for anthropometry, with minimal intrusion on the subject. The ability to automate this process has enormous potential for personalised digital models in medicine, ergonomics, design and manufacture and for populating virtual environments. The techniques developed within this thesis now form the basis of a commercial product. However, the technical difficulties are considerable. Human bodies are highly varied and many of the features of interest are extremely subtle. The underlying range data is typically noisy and is sparse at occluded areas. In addressing these problems this thesis makes five main research contributions. Firstly, the thesis describes the design, implementation and testing of the whole integrated and automated system from scratch, starting at the image capture hardware. At each stage the tradeoffs between performance criteria are discussed, and experiments are described to test the processes developed. Secondly, a combined data-driven and model-based approach is described and implemented, for surface reconstruction from the raw data. This method addresses the whole body surface, including areas where body segments touch, and other occluded areas. The third contribution is a library of operators, designed specifically for shape description and measurement of the human body. The library provides high-level relational attributes, an "electronic tape measure" to extract linear and curvilinear measurements,as well as low-level shape information, such as curvature. Application of the library is demonstrated by building a large set of detectors to find anthropometric features, based on the ISO 8559 specification. Output is compared against traditional manual measurements and a detailed analysis is presented. The discrepancy between these sets of data is only a few per cent on most dimensions, and the system's reproducibility is shown to be similar to that of skilled manual measurers. The final contribution is that the mesh models and anthropometric features, produced by the system, have been used as a starting point to facilitate other research, Such as registration of multiple body images,draping clothing and advanced surface modelling techniques

Computer modeling, analysis, and synthesis of dressed humans

In this paper, we present computer vision techniques for building dressed human models using images, In the first part, me develop an algorithm for three-dimensional body reconstruction and texture mapping using contour, stereo, and texture information from several images and deformable superquadrics as the model parts. In the second part, we demonstrate a novel vision technique for analysis of cloth draping behavior, This technique allows for estimation of cloth model parameters, such as bending properties, but can also be used to estimate the contact points between the body and clothing in the range data of dressed humans. Combined with our body reconstruction algorithm and additional constraints on the articulation model, the detection of the garment-body contact points allows construction of a dressed human model in which even the geometry that was covered by clothing in the available data is reasonably well estimated

Computer Modeling, Analysis and Synthesis of Dressed Humans

1 In this paper we present a method for 3-D reconstruction of human bodies with application in CAD systems for garment design. The reconstruction scheme uses image information from several arbitrary views and deformable superquadrics as the models of the body parts. Two visual cues are used: occluding contours and stereo (possibly aided by projected patterns) . Our preliminary experiments show that the reconstruction is more complete than in purely stereo or structured light based methods and more precise than the reconstruction from occluding contours only. From the reconstructed human body, the body measurements can be taken automatically, and used in garment design. We give an example of draping of virtual garment over the photo-realistic 3D model of the imaged human. One can easily envision the use of the described algorithms in the development of custom-fit garment retail software over the Internet, which would include the possibility of trying the garment on in virtual reality. ..