Learning Social Relation Traits from Face Images

Social relation defines the association, e.g, warm, friendliness, and dominance, between two or more people. Motivated by psychological studies, we investigate if such fine-grained and high-level relation traits can be characterised and quantified from face images in the wild. To address this challenging problem we propose a deep model that learns a rich face representation to capture gender, expression, head pose, and age-related attributes, and then performs pairwise-face reasoning for relation prediction. To learn from heterogeneous attribute sources, we formulate a new network architecture with a bridging layer to leverage the inherent correspondences among these datasets. It can also cope with missing target attribute labels. Extensive experiments show that our approach is effective for fine-grained social relation learning in images and videos.Comment: To appear in International Conference on Computer Vision (ICCV) 201

First impressions: A survey on vision-based apparent personality trait analysis

© 2019 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.Personality analysis has been widely studied in psychology, neuropsychology, and signal processing fields, among others. From the past few years, it also became an attractive research area in visual computing. From the computational point of view, by far speech and text have been the most considered cues of information for analyzing personality. However, recently there has been an increasing interest from the computer vision community in analyzing personality from visual data. Recent computer vision approaches are able to accurately analyze human faces, body postures and behaviors, and use these information to infer apparent personality traits. Because of the overwhelming research interest in this topic, and of the potential impact that this sort of methods could have in society, we present in this paper an up-to-date review of existing vision-based approaches for apparent personality trait recognition. We describe seminal and cutting edge works on the subject, discussing and comparing their distinctive features and limitations. Future venues of research in the field are identified and discussed. Furthermore, aspects on the subjectivity in data labeling/evaluation, as well as current datasets and challenges organized to push the research on the field are reviewed.Peer ReviewedPostprint (author's final draft

Facial first impressions from another angle: How social judgements are influenced by changeable and invariant facial properties

Funding Information: Australian Research Council (ARC) Centre of Excellence in Cognition and its Disorders. Grant Number: CE110001021 ARC Discovery Outstanding Researcher Award. Grant Number: DP130102300Peer reviewedPostprin

How Nonverbal Behaviour and Game Context Alter Athletes Perceptions: A Study of Nonverbal Influence on Expectancy of Success and Impression Formation in Different Game Scenarios, Immediately After an Opponent’s Mistake

Nonverbal behaviour is a social cognition component of sport psychology. The purpose of this study was to determine the impact of non-verbal behaviour (NVB), and game scenarios immediately after a mistake was made. Participants (N = 103) were randomly assigned to one of six groups, comprised of one of two body languages, dominant (n = 51) and submissive (n = 52), and one of three game scenarios, winning (n = 34), tied (n = 34), and losing (n = 35). Due to a high internal consistency between factors of performance outcomes and psychological characteristics one composite variable was created for each variable. Results revealed that dominant NVB was rated significantly higher than submissive NVB in each category, while game situation did not show any significant differences for performance outcome or psychological characteristics. NVB can be a readily accessible resource that should utilized by athletes to gain an advantage over their opponent

Social attraction in video-mediated communication:The role of nonverbal affiliative behavior

The first aim of this study was to analyze video-mediated communication (VMC), in comparison to face-to-face (FTF) communication, and the effect it has on how communicators express nonverbal affiliative behaviors relevant for social attraction. Second, this study aimed to discover whether these nonverbal expressions relate to communicators’ social attraction. An experiment with 93 cross-sex dyads was conducted, with a get-acquainted exercise in a VMC or a FTF condition. Our findings revealed that communicators in VMC smiled more and spoke louder. In addition, VMC interactants displayed less facial touching than FTF interactants. Finally, more gaze aversion and a higher speech rate were found to influence social attraction. These findings have implications for research on cue-rich computer-mediated communication (CMC) and the way in which communicators nonverbally express themselves in comparison to copresent FTF communication. Additionally, this study has implications for social information processing theory which may be extended to include cue-rich forms of CMC

Facial expression of pain: an evolutionary account.

This paper proposes that human expression of pain in the presence or absence of caregivers, and the detection of pain by observers, arises from evolved propensities. The function of pain is to demand attention and prioritise escape, recovery, and healing; where others can help achieve these goals, effective communication of pain is required. Evidence is reviewed of a distinct and specific facial expression of pain from infancy to old age, consistent across stimuli, and recognizable as pain by observers. Voluntary control over amplitude is incomplete, and observers can better detect pain that the individual attempts to suppress rather than amplify or simulate. In many clinical and experimental settings, the facial expression of pain is incorporated with verbal and nonverbal vocal activity, posture, and movement in an overall category of pain behaviour. This is assumed by clinicians to be under operant control of social contingencies such as sympathy, caregiving, and practical help; thus, strong facial expression is presumed to constitute and attempt to manipulate these contingencies by amplification of the normal expression. Operant formulations support skepticism about the presence or extent of pain, judgments of malingering, and sometimes the withholding of caregiving and help. To the extent that pain expression is influenced by environmental contingencies, however, "amplification" could equally plausibly constitute the release of suppression according to evolved contingent propensities that guide behaviour. Pain has been largely neglected in the evolutionary literature and the literature on expression of emotion, but an evolutionary account can generate improved assessment of pain and reactions to it