Is it the real deal? Perception of virtual characters versus humans: an affective cognitive neuroscience perspective

Recent developments in neuroimaging research support the increased use of naturalistic stimulus material such as film, animations, or androids. These stimuli allow for a better understanding of how the brain processes information in complex situations while maintaining experimental control. While avatars and androids are well suited to study human cognition, they should not be equated to human stimuli. For example, the Uncanny Valley hypothesis theorizes that artificial agents with high human-likeness may evoke feelings of eeriness in the human observer. Here we review if, when, and how the perception of human-like avatars and androids differs from the perception of humans and consider how this influences their utilization as stimulus material in social and affective neuroimaging studies. First, we discuss how the appearance of virtual characters affects perception. When stimuli are morphed across categories from non-human to human, the most ambiguous stimuli, rather than the most human-like stimuli, show prolonged classification times and increased eeriness. Human-like to human stimuli show a positive linear relationship with familiarity. Secondly, we show that expressions of emotions in human-like avatars can be perceived similarly to human emotions, with corresponding behavioral, physiological and neuronal activations, with exception of physical dissimilarities. Subsequently, we consider if and when one perceives differences in action representation by artificial agents versus humans. Motor resonance and predictive coding models may account for empirical findings, such as an interference effect on action for observed human-like, natural moving characters. However, the expansion of these models to explain more complex behavior, such as empathy, still needs to be investigated in more detail. Finally, we broaden our outlook to social interaction, where virtual reality stimuli can be utilized to imitate complex social situations

Too real for comfort? Uncanny responses to computer generated faces

As virtual humans approach photorealistic perfection, they risk making real humans uncomfortable. This intriguing phenomenon, known as the uncanny valley, is well known but not well understood. In an effort to demystify the causes of the uncanny valley, this paper proposes several perceptual, cognitive, and social mechanisms that have already helped address riddles like empathy, mate selection, threat avoidance, cognitive dissonance, and psychological defenses. In the four studies described herein, a computer generated human character’s facial proportions, skin texture, and level of detail were varied to examine their effect on perceived eeriness, human likeness, and attractiveness. In Study I, texture photorealism and polygon count increased human likeness. In Study II, texture photorealism heightened the accuracy of human judgments of ideal facial proportions. In Study III, atypical facial proportions were shown to be more disturbing on photorealistic faces than on other faces. In Study IV, a mismatch in the size and texture of the eyes and face was especially prone to make a character eerie. These results contest the depiction of the uncanny valley as a simple relation between comfort level and human likeness. This paper concludes by introducing a set of design principles for bridging the uncanny valley

Familiarity and Overcoming of Uncanny Valley towards Computer-Generated Imagery Characters in Malaysian Film

Recently, the idea of the uncanny valley has drawn interest in robotics and other scientific circles and popular culture. Several scholars have discussed its implications and reactions towards human-like robots. However, only several previous studies examined overcoming the uncanny valley for realistic looking computer-generated actors in films and animation. This seeks to examine the familiarity of participants with the use of digital characters as actors. This paper explains how computer-generated imagery (CGI) was used to create actors in Malaysian films, the uncanny valley characteristics that may affect the audience’s attention. The researcher has chosen visual stimuli consisting of 1 genuine human character and 1 less humanlike subject. A self-administered survey (n = 127) with sample film footage and photos were delivered online via email and social networks to responders. Surprisingly, based on the data, the human resemblance of the humanlike characters was substantially higher than expected. This research concluded that the artificial CGI characters had higher perceived eeriness if the character was highly familiar to the audience. As a result, the digital actor’s replacement an impression of eeriness and disbelief, which confirms the uncanny valley theory

7 An Interactive Installation: Explorations In The Digital, The Spiritual, And The Uncanny

This thesis explores the application of digital technologies in the creation of visionary or transformative artwork. The installation emphasizes number, color, symmetry, and the human form to create symbolic compositions patterned after ancient archetypes. Background research was done to inform the work through studies of the principles of visionary and transformative artwork as practiced by Ernst Fuchs, De Es Schwertberger, and Alex Grey. Connections between art and spirituality as explained by Kandinsky were studied to augment these principles. The sequence of artwork within the installation is comprised of both digital paintings and interactive triptych panels. To convey a sense of the mystical or sacred, the Rothko Chapel was used to inform the installation and serve as an artistic precedent. As the interactive work is created using realistically-modeled, computer generated characters, special consideration was given to understanding the uncanny valley and its potential effect in the interpretation of the installation. Interactivity is achieved through the use of ultrasonic sensors and Arduino prototyping boards

Human or Robot?: Investigating voice, appearance and gesture motion realism of conversational social agents

Research on creation of virtual humans enables increasing automatization of their behavior, including synthesis of verbal and nonverbal behavior. As the achievable realism of different aspects of agent design evolves asynchronously, it is important to understand if and how divergence in realism between behavioral channels can elicit negative user responses. Specifically, in this work, we investigate the question of whether autonomous virtual agents relying on synthetic text-to-speech voices should portray a corresponding level of realism in the non-verbal channels of motion and visual appearance, or if, alternatively, the best available realism of each channel should be used. In two perceptual studies, we assess how realism of voice, motion, and appearance influence the perceived match of speech and gesture motion, as well as the agent\u27s likability and human-likeness. Our results suggest that maximizing realism of voice and motion is preferable even when this leads to realism mismatches, but for visual appearance, lower realism may be preferable. (A video abstract can be found at https://youtu.be/arfZZ-hxD1Y.

An Investigation into the uncanny: character design, behaviour and context.

Whilst there has been a substantial amount of research into the uncanny valley, defining research that contextualises a character as they would normally be viewed remains an unexplored area. Often previous research focused solely on realistic render styles giving characters an unfair basis that tended towards the realistic, thus facilitating only one mode of animation style: realism. Furthermore, characters were not contextualized because researchers often used footage from previous productions. These characters also differed in quality as various artists worked on different productions. This research considers characterisation as three key components, the aesthetic, the behaviour and the contextualisation. Attempts were made to develop a greater understanding of how these components contribute to the appeal of a character within the field of 3D computer animation. Research consisted of two experiments. Both experiments were conducted using an online survey method. The first experiment used five different characters ranging from realistic to abstract. Each character displayed three different behaviours and the characters were contextualized within a six panel narrative. Data obtained from the first experiment was used to refine the second experiment. A further experiment was conducted to further define how combinations of different behaviours and the context containing a character affected the subject’s perception. The second experiment used three different character types and the characters were contextualized within a video stimulus. Findings from the first experiment indicated a strong relationship between character type and context. Interest with the various characters changed depending on adaptions to either the behaviour of the said character or the contextualisation. Certain character types based on appearance where better suited to different contexts than others. An abstract character was more likely to be perceived positively by the subject in a surprising context stipulated by the behaviour of the character and form of the narrative sequence. Other characters such as one based around an inanimate object found a greater positive reception with the subjects under sad contextual constraints rather than happy or surprise. The first experiment took into account various independent variables obtained from the subject and aimed to draw parallels if found between these variables and the subjects perception of a given character be it positive or negative. However, these variables namely gender, nationality and age had no effect on the subject’s perception. In the second experiment, it was found that in order for the realistic human character to be perceived more positively, the behaviour needed to match the context. When a mismatch occurred the subjects began to perceive the character more negatively. The cartoon character was however not affected by the mismatch of behaviour and context. The experiment was further expanded when two different character types were compared committing negative actions and having negative actions inflicted upon them and what effect it had on the subjects perception. It was found that a cartoon character committing a negative action was perceived positively whilst a human character committing the same act was perceived negatively. However, when a negative action was inflicted on these same characters, subjects were more concerned for the human character than the cartoon character. Results from both experiments confirm the idea that various characters are perceived very differently by the viewers and come with predefined notions within the viewer of how they should behave. What is expected of one character type is not acceptable for another character type. Cartoon characters can get away with bizarre behaviour. A real human character may have some sort of novel unusual behaviour, whilst a realistic CG human character is assessed on how realistically (normally) it behaves. This research expands upon previous research into this area by offering a greater understanding of character types and emphasising the importance of contextualisation

The Uncanny Valley The Effect of Removing Blendshapes from Facial Animation

Ever since its introduction in 1970 by the roboticist Dr. Mori, the uncanny valley has become an integral part of facial animation. While most of the work on the uncanny valley is focused on finding a way to surpass the uncanny valley and how certain things could be designed to increase or decrease the uncanniness of an animation, this paper investigates how removing certain blendshapes from the facial animation changes our perception about the eeriness of that animation. The goal is to identify the “necessary” blendshapes which bring about a significant change the perceived uncanniness of the animation. For achieving this, participants undergo visual tests which entails observing short animated clips expressing different emotions and recording the human-likeness and uncanniness, as perceived by the observers. The results validate some of the existing theories about the uncanny valley and also identify the necessary blendshapes for every emotion. The results show that removing the blendshapes not only affects the eeriness but also the perceived human-likeness and may change our perception of the emotion expressed in the animation

Eight issues to consider when developing animated videos for the assessment of complex constructs

As part of the growing interest in the measurement of complex constructs in recent years, a body of research examining the extent to which videos are a useful alternative to written text in tests and assessments has emerged. Early attempts to replace written text with videos featured actors, but lately, animated videos have become more popular. However, the few studies that have examined the use of videos (animated or acted) in assessment have focused purely on reporting the results of these endeavors, with little to no information provided about the process of transforming a test from text to video format. With this in mind, the aim of this paper is to outline the key issues that need to be considered when developing animated videos in an assessment context. Various decisions that need to be made are discussed and suggestions for overcoming challenges that may be encountered are offered. These considerations are intended to help anyone interested in the use of animated videos to enhance the validity of decisions made on the basis of assessments, including, but not limited to, educators, certification and licensure test developers, and those involved in personnel selection

Investigating the Uncanny Valley Phenomenon Through the Temporal Dynamics of Neural Responses to Virtual Characters

The Uncanny Valley phenomenon refers to the feeling of unease that arises when interacting with characters that appear almost, but not quite, human-like. First theorised by Masahiro Mori in 1970, it has since been widely observed in different contexts from humanoid robots to video games, in which it can result in players feeling uncomfortable or disconnected from the game, leading to a lack of immersion and potentially reducing the overall enjoyment. The phenomenon has been observed and described mostly through behavioural studies based on self-reported scales of uncanny feeling: however, there is still no consensus on its cognitive and perceptual origins, which limits our understanding of its impact on player experience. In this paper, we present a study aimed at identifying the mechanisms that trigger the uncanny response by collecting and analysing both self-reported feedback and EEG data

The uncanny valley of a virtual animal.

Virtual robots, including virtual animals, are expected to play a major role within affective and aesthetic interfaces, serious games, video instruction, and the personalization of educational instruction. Their actual impact, however, will very much depend on user perception of virtual characters as the uncanny valley hypothesis has shown that the design of virtual characters determines user experiences. In this article, we investigated whether the uncanny valley effect, which has already been found for the human-like appearance of virtual characters, can also be found for animal-like appearances. We conducted an online study (N = 163) in which six different animal designs were evaluated in terms of the following properties: familiarity, commonality, naturalness, attractiveness, interestingness, and animateness. The study participants differed in age (under 10–60 years) and origin (Europe, Asia, North America, and South America). For the evaluation of the results, we ranked the animal-likeness of the character using both expert opinion and participant judgments. Next to that, we investigated the effect of movement and morbidity. The results confirm the existence of the uncanny valley effect for virtual animals, especially with respect to familiarity and commonality, for both still and moving images. The effect was particularly pronounced for morbid images. For naturalness and attractiveness, the effect was only present in the expert-based ranking, but not in the participant-based ranking. No uncanny valley effect was detected for interestingness and animateness. This investigation revealed that the appearance of virtual animals directly affects user perception and thus, presumably, impacts user experience when used in applied settings