DeepSketch2Face: A Deep Learning Based Sketching System for 3D Face and Caricature Modeling

Face modeling has been paid much attention in the field of visual computing. There exist many scenarios, including cartoon characters, avatars for social media, 3D face caricatures as well as face-related art and design, where low-cost interactive face modeling is a popular approach especially among amateur users. In this paper, we propose a deep learning based sketching system for 3D face and caricature modeling. This system has a labor-efficient sketching interface, that allows the user to draw freehand imprecise yet expressive 2D lines representing the contours of facial features. A novel CNN based deep regression network is designed for inferring 3D face models from 2D sketches. Our network fuses both CNN and shape based features of the input sketch, and has two independent branches of fully connected layers generating independent subsets of coefficients for a bilinear face representation. Our system also supports gesture based interactions for users to further manipulate initial face models. Both user studies and numerical results indicate that our sketching system can help users create face models quickly and effectively. A significantly expanded face database with diverse identities, expressions and levels of exaggeration is constructed to promote further research and evaluation of face modeling techniques.Comment: 12 pages, 16 figures, to appear in SIGGRAPH 201

Learning to Dress {3D} People in Generative Clothing

Three-dimensional human body models are widely used in the analysis of human pose and motion. Existing models, however, are learned from minimally-clothed 3D scans and thus do not generalize to the complexity of dressed people in common images and videos. Additionally, current models lack the expressive power needed to represent the complex non-linear geometry of pose-dependent clothing shapes. To address this, we learn a generative 3D mesh model of clothed people from 3D scans with varying pose and clothing. Specifically, we train a conditional Mesh-VAE-GAN to learn the clothing deformation from the SMPL body model, making clothing an additional term in SMPL. Our model is conditioned on both pose and clothing type, giving the ability to draw samples of clothing to dress different body shapes in a variety of styles and poses. To preserve wrinkle detail, our Mesh-VAE-GAN extends patchwise discriminators to 3D meshes. Our model, named CAPE, represents global shape and fine local structure, effectively extending the SMPL body model to clothing. To our knowledge, this is the first generative model that directly dresses 3D human body meshes and generalizes to different poses. The model, code and data are available for research purposes at https://cape.is.tue.mpg.de.Comment: CVPR-2020 camera ready. Code and data are available at https://cape.is.tue.mpg.d

Orthotropic rotation-free thin shell elements

A method to simulate orthotropic behaviour in thin shell finite elements is proposed. The approach is based on the transformation of shape function derivatives, resulting in a new orthogonal basis aligned to a specified preferred direction for all elements. This transformation is carried out solely in the undeformed state leaving minimal additional impact on the computational effort expended to simulate orthotropic materials compared to isotropic, resulting in a straightforward and highly efficient implementation. This method is implemented for rotation-free triangular shells using the finite element framework built on the Kirchhoff--Love theory employing subdivision surfaces. The accuracy of this approach is demonstrated using the deformation of a pinched hemispherical shell (with a 18{\deg} hole) standard benchmark. To showcase the efficiency of this implementation, the wrinkling of orthotropic sheets under shear displacement is analyzed. It is found that orthotropic subdivision shells are able to capture the wrinkling behavior of sheets accurately for coarse meshes without the use of an additional wrinkling model.Comment: 10 pages, 8 figure

Modelling the forming mechanics of engineering fabrics using a mutually constrained pantographic beam and membrane mesh

A method of combining 1-d and 2-d structural finite elements to capture the fundamental mechanical properties of engineering fabrics subject to finite strains is introduced. A mutually constrained pantographic beam and membrane mesh is presented and simple homogenisation theory is developed to relate the macro-scale properties of the mesh to the properties of the elements within the mesh. The theory shows that each of the macro-scale properties of the mesh can be independently controlled. An investigation into the performance of the technique is conducted using tensile, cantilever bending and uniaxial bias extension shear simulations. The simulations are first used to verify the accuracy of the homogenisation theory and then used to demonstrate the ability of the modelling approach in accurately predicting the shear force, shear kinematics and out-of-plane wrinkling behaviour of engineering fabrics

Modern concepts in non-surgical esthetics; a review

New non-surgical esthetics is the most dynamic field in contemporary medicine. At the same time, it is greatly influenced by our contemporary society. This paper reviews modern methods used in non-surgical esthetics, especially in Romania. From injectology and non-surgical face lifting to non-surgical body contouring, we analyzed all procedures performed by Romanian physicians, and we show the advantages and disadvantages of the advanced esthetic procedures. Injectology typically implies hyaluronic acid, botox and mesotherapy (for wrinkles and rejuvenation). Laser and radiofrequency treatment are used for wrinkles as well, with fewer unwanted adverse reactions and results exceeding those of injectables. Non-surgical lifting has gained more ground because it requires little recovery time and the results are very positive. Elective treatment for facial discoloration is the laser approach. For non-surgical body contouring, cryolipolisis, vacuum, radio frequency, and infrared systems have all revolutionized this part of esthetics, but each has limitations, and only after establishing the correct course of action, might we think of achieving favorable results and thus raising to the expectations of patients

Improvements on a simple muscle-based 3D face for realistic facial expressions

Facial expressions play an important role in face-to-face communication. With the development of personal computers capable of rendering high quality graphics, computer facial animation has produced more and more realistic facial expressions to enrich human-computer communication. In this paper, we present a simple muscle-based 3D face model that can produce realistic facial expressions in real time. We extend Waters' (1987) muscle model to generate bulges and wrinkles and to improve the combination of multiple muscle actions. In addition, we present techniques to reduce the computation burden on the muscle mode