SCUT-FBP5500: A Diverse Benchmark Dataset for Multi-Paradigm Facial Beauty Prediction

Facial beauty prediction (FBP) is a significant visual recognition problem to make assessment of facial attractiveness that is consistent to human perception. To tackle this problem, various data-driven models, especially state-of-the-art deep learning techniques, were introduced, and benchmark dataset become one of the essential elements to achieve FBP. Previous works have formulated the recognition of facial beauty as a specific supervised learning problem of classification, regression or ranking, which indicates that FBP is intrinsically a computation problem with multiple paradigms. However, most of FBP benchmark datasets were built under specific computation constrains, which limits the performance and flexibility of the computational model trained on the dataset. In this paper, we argue that FBP is a multi-paradigm computation problem, and propose a new diverse benchmark dataset, called SCUT-FBP5500, to achieve multi-paradigm facial beauty prediction. The SCUT-FBP5500 dataset has totally 5500 frontal faces with diverse properties (male/female, Asian/Caucasian, ages) and diverse labels (face landmarks, beauty scores within [1,~5], beauty score distribution), which allows different computational models with different FBP paradigms, such as appearance-based/shape-based facial beauty classification/regression model for male/female of Asian/Caucasian. We evaluated the SCUT-FBP5500 dataset for FBP using different combinations of feature and predictor, and various deep learning methods. The results indicates the improvement of FBP and the potential applications based on the SCUT-FBP5500.Comment: 6 pages, 14 figures, conference pape

The analysis of facial beauty: an emerging area of research in pattern analysis

Much research presented recently supports the idea that the human perception of attractiveness is data-driven and largely irrespective of the perceiver. This suggests using pattern analysis techniques for beauty analysis. Several scientific papers on this subject are appearing in image processing, computer vision and pattern analysis contexts, or use techniques of these areas. In this paper, we will survey the recent studies on automatic analysis of facial beauty, and discuss research lines and practical application

Multi-View Graph Fusion for Semi-Supervised Learning: Application to Image-Based Face Beauty Prediction

Facial Beauty Prediction (FBP) is an important visual recognition problem to evaluate the attractiveness of faces according to human perception. Most existing FBP methods are based on supervised solutions using geometric or deep features. Semi-supervised learning for FBP is an almost unexplored research area. In this work, we propose a graph-based semi-supervised method in which multiple graphs are constructed to find the appropriate graph representation of the face images (with and without scores). The proposed method combines both geometric and deep feature-based graphs to produce a high-level representation of face images instead of using a single face descriptor and also improves the discriminative ability of graph-based score propagation methods. In addition to the data graph, our proposed approach fuses an additional graph adaptively built on the predicted beauty values. Experimental results on the SCUTFBP-5500 facial beauty dataset demonstrate the superiority of the proposed algorithm compared to other state-of-the-art methods

The persuasiveness of humanlike computer interfaces varies more through narrative characterization than through the uncanny valley

Indiana University-Purdue University Indianapolis (IUPUI)Just as physical appearance affects persuasion and compliance in human communication, it may also bias the processing of information from avatars, computer-animated characters, and other computer interfaces with faces. Although the most persuasive of these interfaces are often the most humanlike, they incur the greatest risk of falling into the uncanny valley, the loss of empathy associated with eerily human characters. The uncanny valley could delay the acceptance of humanlike interfaces in everyday roles. To determine the extent to which the uncanny valley affects persuasion, two experiments were conducted online with undergraduates from Indiana University. The first experiment (N = 426) presented an ethical dilemma followed by the advice of an authority figure. The authority was manipulated in three ways: depiction (recorded or animated), motion quality (smooth or jerky), and recommendation (disclose or refrain from disclosing sensitive information). Of these, only the recommendation changed opinion about the dilemma, even though the animated depiction was eerier than the human depiction. These results indicate that compliance with an authority persists even when using a realistic computer-animated double. The second experiment (N = 311) assigned one of two different dilemmas in professional ethics involving the fate of a humanlike character. In addition to the dilemma, there were three manipulations of the character’s human realism: depiction (animated human or humanoid robot), voice (recorded or synthesized), and motion quality (smooth or jerky). In one dilemma, decreasing depiction realism or increasing voice realism increased eeriness. In the other dilemma, increasing depiction realism decreased perceived competence. However, in both dilemmas realism had no significant effect on whether to punish the character. Instead, the willingness to punish was predicted in both dilemmas by narratively characterized trustworthiness. Together, the experiments demonstrate both direct and indirect effects of narratives on responses to humanlike interfaces. The effects of human realism are inconsistent across different interactions, and the effects of the uncanny valley may be suppressed through narrative characterization

MODELING THE CONSUMER ACCEPTANCE OF RETAIL SERVICE ROBOTS

This study uses the Computers Are Social Actors (CASA) and domestication theories as the underlying framework of an acceptance model of retail service robots (RSRs). The model illustrates the relationships among facilitators, attitudes toward Human-Robot Interaction (HRI), anxiety toward robots, anticipated service quality, and the acceptance of RSRs. Specifically, the researcher investigates the extent to which the facilitators of usefulness, social capability, the appearance of RSRs, and the attitudes toward HRI affect acceptance and increase the anticipation of service quality. The researcher also tests the inhibiting role of pre-existing anxiety toward robots on the relationship between these facilitators and attitudes toward HRI. The study uses four methodological strategies: (1) incorporating a focus group and personal interviews, (2) using a presentation method of video clip stimuli, (3) empirical data collection and multigroup SEM analyses, and (4) applying three key product categories for the model’s generalization— fashion, technology (mobile phone), and food service (restaurant). The researcher conducts two pretests to check the survey items and to select the video clips. The researcher conducts the main test using an online survey of US consumer panelists (n = 1424) at a marketing agency. The results show that usefulness, social capability, and the appearance of a RSR positively influence the attitudes toward HRI. The attitudes toward HRI predict greater anticipation of service quality and the acceptance of the RSRs. The expected quality of service tends to enhance the acceptance. The relationship between social capability and attitudes toward HRI is weaker when the anxiety toward robots is higher. However, when the anxiety is higher, the relationship between appearance and the attitudes toward HRI is stronger than those with low anxiety. This study contributes to the literature on the CASA and domestication theories and to the human-computer interaction that involves robots or artificial intelligence. By considering social capability, humanness, intelligence, and the appearance of robots, this model of RSR acceptance can provide new insights into the psychological, social, and behavioral principles that guide the commercialization of robots. Further, this acceptance model could help retailers and marketers formulate strategies for effective HRI and RSR adoption in their businesses