The perception of emotion in artificial agents

Given recent technological developments in robotics, artificial intelligence and virtual reality, it is perhaps unsurprising that the arrival of emotionally expressive and reactive artificial agents is imminent. However, if such agents are to become integrated into our social milieu, it is imperative to establish an understanding of whether and how humans perceive emotion in artificial agents. In this review, we incorporate recent findings from social robotics, virtual reality, psychology, and neuroscience to examine how people recognize and respond to emotions displayed by artificial agents. First, we review how people perceive emotions expressed by an artificial agent, such as facial and bodily expressions and vocal tone. Second, we evaluate the similarities and differences in the consequences of perceived emotions in artificial compared to human agents. Besides accurately recognizing the emotional state of an artificial agent, it is critical to understand how humans respond to those emotions. Does interacting with an angry robot induce the same responses in people as interacting with an angry person? Similarly, does watching a robot rejoice when it wins a game elicit similar feelings of elation in the human observer? Here we provide an overview of the current state of emotion expression and perception in social robotics, as well as a clear articulation of the challenges and guiding principles to be addressed as we move ever closer to truly emotional artificial agents

Is it the real deal? Perception of virtual characters versus humans: an affective cognitive neuroscience perspective

Recent developments in neuroimaging research support the increased use of naturalistic stimulus material such as film, animations, or androids. These stimuli allow for a better understanding of how the brain processes information in complex situations while maintaining experimental control. While avatars and androids are well suited to study human cognition, they should not be equated to human stimuli. For example, the Uncanny Valley hypothesis theorizes that artificial agents with high human-likeness may evoke feelings of eeriness in the human observer. Here we review if, when, and how the perception of human-like avatars and androids differs from the perception of humans and consider how this influences their utilization as stimulus material in social and affective neuroimaging studies. First, we discuss how the appearance of virtual characters affects perception. When stimuli are morphed across categories from non-human to human, the most ambiguous stimuli, rather than the most human-like stimuli, show prolonged classification times and increased eeriness. Human-like to human stimuli show a positive linear relationship with familiarity. Secondly, we show that expressions of emotions in human-like avatars can be perceived similarly to human emotions, with corresponding behavioral, physiological and neuronal activations, with exception of physical dissimilarities. Subsequently, we consider if and when one perceives differences in action representation by artificial agents versus humans. Motor resonance and predictive coding models may account for empirical findings, such as an interference effect on action for observed human-like, natural moving characters. However, the expansion of these models to explain more complex behavior, such as empathy, still needs to be investigated in more detail. Finally, we broaden our outlook to social interaction, where virtual reality stimuli can be utilized to imitate complex social situations

The rhythm that unites: an empirical investigation into synchrony, ritual, and hierarchy

Synchrony, or rhythmic bodily unison activities such as drumming or cadence marching, has attracted growing scholarly interest. Among laboratory subjects, synchrony elicits prosocial responses, including altruism and empathy. In light of such findings, researchers in social psychology and the bio-cultural study of religion have suggested that synchrony played a role in humanity’s evolutionary history by engendering collectivistic commitments and social cohesion. These models propose that synchrony enhances cohesion by making people feel united. However, such models overlook the importance of differentiated social relations, such as hierarchies. This dissertation builds on this insight by drawing on neuroscience, coordination dynamics, social psychology, anthropology, and ritual studies to generate a complex model of synchrony, ritual, and social hierarchy, which is then tested in an experimental study. In the hypothesized model, shared motor unison suppresses the brain’s ability to distinguish cognitively between self-caused and exogenous motor acts, resulting in subjective self-other overlap. During synchrony each participant is dynamically entrained to a group mean rhythm; this “immanent authority” prevents any one participant from unilaterally dictating the rhythm, flattening relative hierarchy. As a ritualized behavior, synchrony therefore paradigmatically evokes shared ideals of equality and unity. However, when lab participants were assigned to either a synchrony or asynchrony manipulation and given a collaborative task requiring complex coordination, synchrony predicted a marginally lower degree of collaboration and significantly lower interpersonal satisfaction. These findings imply that unity and equality can undercut group cohesion if the collective agenda is a shared goal that requires interpersonal coordination. My results emphasize that, despite the inevitable tensions associated with social hierarchy, complementary roles and hierarchy are vital for certain aspects of social cohesion. Ritual and convention institute social boundaries that can be adroitly negotiated, even as egalitarian effervescence such as communitas (in the sense of Victor Turner) facilitates social unity and inspires affective commitments. These findings corroborate theories in ritual studies and sociology that caution both against excessive emphasis on inner emotive states (such as empathy) and against excessively rigid conventions or roles. An organic balance between unity and functional differentiation is vital for genuinely robust, long-term social cohesion.2018-06-21T00:00:00

The sound symbolism bootstrapping hypothesis for language acquisition and language evolution

Sound symbolism is a non-arbitrary relationship between speech sounds and meaning. We review evidence that, contrary to the traditional view in linguistics, sound symbolism is an important design feature of language, which affects online processing of language, and most importantly, language acquisition. We propose the sound symbolism bootstrapping hypothesis, claiming that (i) pre-verbal infants are sensitive to sound symbolism, due to a biologically endowed ability to map and integrate multi-modal input, (ii) sound symbolism helps infants gain referential insight for speech sounds, (iii) sound symbolism helps infants and toddlers associate speech sounds with their referents to establish a lexical representation and (iv) sound symbolism helps toddlers learn words by allowing them to focus on referents embedded in a complex scene, alleviating Quine's problem. We further explore the possibility that sound symbolism is deeply related to language evolution, drawing the parallel between historical development of language across generations and ontogenetic development within individuals. Finally, we suggest that sound symbolism bootstrapping is a part of a more general phenomenon of bootstrapping by means of iconic representations, drawing on similarities and close behavioural links between sound symbolism and speech-accompanying iconic gesture

Machine Performers: Agents in a Multiple Ontological State

In this thesis, the author explores and develops new attributes for machine performers and merges the trans-disciplinary fields of the performing arts and artificial intelligence. The main aim is to redefine the term “embodiment” for robots on the stage and to demonstrate that this term requires broadening in various fields of research. This redefining has required a multifaceted theoretical analysis of embodiment in the field of artificial intelligence (e.g. the uncanny valley), as well as the construction of new robots for the stage by the author. It is hoped that these practical experimental examples will generate more research by others in similar fields. Even though the historical lineage of robotics is engraved with theatrical strategies and dramaturgy, further application of constructive principles from the performing arts and evidence from psychology and neurology can shift the perception of robotic agents both on stage and in other cultural environments. In this light, the relation between representation, movement and behaviour of bodies has been further explored to establish links between constructed bodies (as in artificial intelligence) and perceived bodies (as performers on the theatrical stage). In the course of this research, several practical works have been designed and built, and subsequently presented to live audiences and research communities. Audience reactions have been analysed with surveys and discussions. Interviews have also been conducted with choreographers, curators and scientists about the value of machine performers. The main conclusions from this study are that fakery and mystification can be used as persuasive elements to enhance agency. Morphologies can also be applied that tightly couple brain and sensorimotor actions and lead to a stronger stage presence. In fact, if this lack of presence is left out of human replicants, it causes an “uncanny” lack of agency. Furthermore, the addition of stage presence leads to stronger identification from audiences, even for bodies dissimilar to their own. The author demonstrates that audience reactions are enhanced by building these effects into machine body structures: rather than identification through mimicry, this causes them to have more unambiguously biological associations. Alongside these traits, atmospheres such as those created by a cast of machine performers tend to cause even more intensely visceral responses. In this thesis, “embodiment” has emerged as a paradigm shift – as well as within this shift – and morphological computing has been explored as a method to deepen this visceral immersion. Therefore, this dissertation considers and builds machine performers as “true” performers for the stage, rather than mere objects with an aura. Their singular and customized embodiment can enable the development of non-anthropocentric performances that encompass the abstract and conceptual patterns in motion and generate – as from human performers – empathy, identification and experiential reactions in live audiences

ChimpanSee, ChimpanDo: A Review of the Significance of Social Contagion, and Exploration of Grooming and Play Contagion in Chimpanzees

The ability to catch behaviours from others, and share their emotional states, is fundamental to numerous aspects of human social functioning. This state-matching capacity is of great evolutionary importance and is widespread in the primate lineage. Studying which forms of contagion are present in different primate species, and when contagion is most pronounced, can help reveal the fundamental underpinnings and the context-specific facets of these processes, allowing us to understand the nature and significance of social contagion. In chapter 1, I critically review research on mimicry, behavioural contagion and emotional contagion in primates, highlighting which factors are important moderators, and the benefits that contagious processes afford individuals and the group. Research reveals notable difference in trends in positive and negative valenced contexts, although research is limited with regards to positive emotional and behavioural contagion. I emphasise the wide-reaching adaptive benefits of both positive and negative social contagion, and consider social contagion as a basis for social learning, allowing for a unified view of its significance. In chapter 2, I seek to advance the literature by addressing the research gap of positive social contagion. I conducted an observational study of 47 sanctuary living chimpanzees, to test whether chimpanzees catch grooming and play behaviours from each other, and what predicts this effect. Results reveal the first evidence for the contagion of affiliative behaviours in chimpanzees. The presence of grooming contagion was predicted by social closeness, and was more pronounced in females, whilst play contagion was more pronounced in younger individuals. It is evident that behavioural contagion is not confined to negative contexts, but is widespread and influenced by a multitude of factors, specific to species and behaviour

Categorical organization and machine perception of oscillatory motion patterns

Thesis (Ph.D.)--Massachusetts Institute of Technology, Dept. of Architecture, 2000.Includes bibliographical references (p. 126-132).Many animal behaviors consist of using special patterns of motion for communication, with certain types of movements appearing widely across animal species. Oscillatory motions in particular are quite prevalent, where many of these repetitive movements can be characterized by a simple sinusoidal model with very specific and limited parameter values. We develop a computational model of categorical perception of these motion patterns based on their inherent structural regularity. The model proposes the initial construction of a hierarchical ordering of the model parameters to partition them into sub-categorical specializations. This organization is then used to specify the types and layout of localized computations required for the corresponding visual recognition system. The goal here is to do away with ad hoc motion recognition methods of computer vision, and instead exploit the underlying structural description for a motion category as a motivating mechanism for recognition. We implement this framework and present an analysis of the approach with synthetic and real oscillatory motions, and demonstrate its applicability within an interactive artificial life environment. With this categorical foundation for the description and recognition of related motions, we gain insight into the basis and development of a machine vision system designed to recognize these patterns.by James W. Davis.Ph.D

HOT Emotions: Dissolving the Paradox of Fiction

This essay critiques two of the main theories in the philosophy of emotions, the pure-cognitive theory and the neo-Jamesian theory, through the paradox of fiction. After explaining the different kinds of emotions we experience when engaging with fictions, I argue that a middle-ground, hybrid theory more adequately accounts for current scientific research and the paradox of fiction than either of the previous two. I propose a “HOT” theory of emotions (higher-order thought) specifically to explain complex emotions about fictions