Geometry-Aware Face Completion and Editing

Face completion is a challenging generation task because it requires generating visually pleasing new pixels that are semantically consistent with the unmasked face region. This paper proposes a geometry-aware Face Completion and Editing NETwork (FCENet) by systematically studying facial geometry from the unmasked region. Firstly, a facial geometry estimator is learned to estimate facial landmark heatmaps and parsing maps from the unmasked face image. Then, an encoder-decoder structure generator serves to complete a face image and disentangle its mask areas conditioned on both the masked face image and the estimated facial geometry images. Besides, since low-rank property exists in manually labeled masks, a low-rank regularization term is imposed on the disentangled masks, enforcing our completion network to manage occlusion area with various shape and size. Furthermore, our network can generate diverse results from the same masked input by modifying estimated facial geometry, which provides a flexible mean to edit the completed face appearance. Extensive experimental results qualitatively and quantitatively demonstrate that our network is able to generate visually pleasing face completion results and edit face attributes as well

Trends and Design Relating literature to industry practice

In a crowded market place, where technology and functionality are not enough to differentiate a product from its competitors, the product’s appearance is a major driver of consumer preference. But preferences change over time, and product forms need to reflect this in order to stay relevant. This paper addresses the usage of trends by designers to inform the design and evolution of their products. Published theory regarding trends in product form exists in the fashion and consumer behaviour domains, but not in direct relation to the design of consumer products. This paper is preceded by a synthesis of literature in adjacent fields and compares the literature understanding with real industrial practice. Interviews with 9 professionals in trend research, design consultancy, furniture, fashion and architecture, were undertaken to explore the value and usage of trends across a variety of creative fields. The interview data were used to corroborate and enhance the literature understanding. In addition, the study also provides some emerging comparisons between design disciplines. The product designers interviewed were unlikely to use formal trend research methods: inspiration, tacit knowledge and experience accounts for much of their creative output. However, trend consultancies have developed methods of identifying and using trends to develop products for 5-10 years in the future. The fashion industry also has established ways of to rapidly identify or predict trend information. Keywords: Product form; trends; fashion; foresight</p

Health literacy practices in social virtual worlds and the influence on health behaviour

This study explored how health information accessed via a 3D social virtual world and the representation of ‘self’ through the use of an avatar impact physical world health behaviour. In-depth interviews were conducted in a sample of 25 people, across 10 countries, who accessed health information in a virtual world (VW): 12 females and 13 males. Interviews were audio-recorded via private in-world voice chat or via private instant message. Thematic analysis was used to analyse the data. The social skills and practices evidenced demonstrate how the collective knowledge and skills of communities in VWs can influence improvements in individual and community health literacy through a distributed model. The findings offer support for moving away from the idea of health literacy as a set of skills which reside within an individual to a sociocultural model of health literacy. Social VWs can offer a place where people can access health information in multiple formats through the use of an avatar, which can influence changes in behaviour in the physical world and the VW. This can lead to an improvement in social skills and health literacy practices and represents a social model of health literacy

Social Norms in Virtual Worlds of Computer Games

Immersing in the virtual world of the Internet, information and communication technologies are changing the human being. In spite of the apparent similarity of on-line and off-line, social laws of their existence are different. According to the analysis of games, based on the violation of the accepted laws of the world off-line, their censoring, as well as the cheating, features of formation and violations of social norms in virtual worlds were formulated. Although the creators of the games have priority in the standardization of the virtual world, society as well as players can have impact on it to reduce the realism. The violation of the prescribed rules by a player is regarded as cheating. And it is subjected to sanctions, but the attitude toward it is ambiguous, sometimes positive. Some rules are formed as a result of the interaction between players

Designing Disambiguation Techniques for Pointing in the Physical World

International audienceSeveral ways for selecting physical objects exist, including touching and pointing at them. Allowing the user to interact at a distance by pointing at physical objects can be challenging when the environment contains a large number of interactive physical objects, possibly occluded by other everyday items. Previous pointing techniques highlighted the need for disambiguation techniques. Addressing this challenge, this paper contributes a design space that organizes along groups and axes a set of options for designers to relevantly (1) describe, (2) classify, and (3) design disambiguation techniques. First, we have not found techniques in the literature yet that our design space could not describe. Second, all the techniques show a different path along the axes of our design space. Third, it allows defining of several new paths/solutions that have not yet been explored. We illustrate this generative power with the example of such a designed technique, Physical Pointing Roll (P2Roll)

Calipso: Physics-based Image and Video Editing through CAD Model Proxies

We present Calipso, an interactive method for editing images and videos in a physically-coherent manner. Our main idea is to realize physics-based manipulations by running a full physics simulation on proxy geometries given by non-rigidly aligned CAD models. Running these simulations allows us to apply new, unseen forces to move or deform selected objects, change physical parameters such as mass or elasticity, or even add entire new objects that interact with the rest of the underlying scene. In Calipso, the user makes edits directly in 3D; these edits are processed by the simulation and then transfered to the target 2D content using shape-to-image correspondences in a photo-realistic rendering process. To align the CAD models, we introduce an efficient CAD-to-image alignment procedure that jointly minimizes for rigid and non-rigid alignment while preserving the high-level structure of the input shape. Moreover, the user can choose to exploit image flow to estimate scene motion, producing coherent physical behavior with ambient dynamics. We demonstrate Calipso's physics-based editing on a wide range of examples producing myriad physical behavior while preserving geometric and visual consistency.Comment: 11 page