The perception of emotion in artificial agents

Given recent technological developments in robotics, artificial intelligence and virtual reality, it is perhaps unsurprising that the arrival of emotionally expressive and reactive artificial agents is imminent. However, if such agents are to become integrated into our social milieu, it is imperative to establish an understanding of whether and how humans perceive emotion in artificial agents. In this review, we incorporate recent findings from social robotics, virtual reality, psychology, and neuroscience to examine how people recognize and respond to emotions displayed by artificial agents. First, we review how people perceive emotions expressed by an artificial agent, such as facial and bodily expressions and vocal tone. Second, we evaluate the similarities and differences in the consequences of perceived emotions in artificial compared to human agents. Besides accurately recognizing the emotional state of an artificial agent, it is critical to understand how humans respond to those emotions. Does interacting with an angry robot induce the same responses in people as interacting with an angry person? Similarly, does watching a robot rejoice when it wins a game elicit similar feelings of elation in the human observer? Here we provide an overview of the current state of emotion expression and perception in social robotics, as well as a clear articulation of the challenges and guiding principles to be addressed as we move ever closer to truly emotional artificial agents

The effects of store atmosphere on shopping behaviour - A literature review.

This paper provides an insight into how the atmospherics of a retail environment influence shopping behaviour. Its objective is to support researchers and practitioners by summarizing the current state of knowledge and identifying gaps and avenues for future research. The scope covers studies in retail marketing and environmental psychology published during the last 35 years. It has been shown that environmental cues (music, scent etc.) have an effect on the emotional state of the consumer, which in turn causes behavioural changes, both positive (approach, buy more, stay longer etc.) and negative (not approach, buy less, leave earlier etc.). Most studies make reference to the PAD model, which proposes that the relevant emotions in this process can be measured along three dimensions Pleasure, Arousal and Dominance (Mehrabian, A. & Russell, J.A.,1974, An approach to environmental psychology, Cambridge, MA.: MIT Press). Since then, significant advances have been made to understand the effect of individual cues, their interaction, as well as the role of moderators, such as gender, age, or shopping motivation. However, there are a number of opportunities for further research. Too little is known about the moderating effects of Arousal and Dominance and how they interact with each other and with Pleasure dimension. Also a number of other moderators, such as gender and culture, should be integrated into the model

The sweet smell of success: Enhancing multimedia applications with olfaction

This is the Post-Print version of the Article. The official published version can be accessed from the link below - Copyright @ 2012 ACMOlfaction, or smell, is one of the last challenges which multimedia applications have to conquer. As far as computerized smell is concerned, there are several difficulties to overcome, particularly those associated with the ambient nature of smell. In this article, we present results from an empirical study exploring users' perception of olfaction-enhanced multimedia displays. Findings show that olfaction significantly adds to the user multimedia experience. Moreover, use of olfaction leads to an increased sense of reality and relevance. Our results also show that users are tolerant of the interference and distortion effects caused by olfactory effect in multimedia

Beyond cute: exploring user types and design opportunities of virtual reality pet games

Virtual pet games, such as handheld games like Tamagotchi or video games like Petz, provide players with artificial pet companions or entertaining pet-raising simulations. Prior research has found that virtual pets have the potential to promote learning, collaboration, and empathy among users. While virtual reality (VR) has become an increasingly popular game medium, litle is known about users' expectations regarding game avatars, gameplay, and environments for VR-enabled pet games. We surveyed 780 respondents in an online survey and interviewed 30 participants to understand users' motivation, preferences, and game behavior in pet games played on various medium, and their expectations for VR pet games. Based on our findings, we generated three user types that reflect users' preferences and gameplay styles in VR pet games. We use these types to highlight key design opportunities and recommendations for VR pet games

Towards Learning ‘Self’ and Emotional Knowledge in Social and Cultural Human-Agent Interactions

Original article can be found at: http://www.igi-global.com/articles/details.asp?ID=35052 Copyright IGI. Posted by permission of the publisher.This article presents research towards the development of a virtual learning environment (VLE) inhabited by intelligent virtual agents (IVAs) and modeling a scenario of inter-cultural interactions. The ultimate aim of this VLE is to allow users to reflect upon and learn about intercultural communication and collaboration. Rather than predefining the interactions among the virtual agents and scripting the possible interactions afforded by this environment, we pursue a bottomup approach whereby inter-cultural communication emerges from interactions with and among autonomous agents and the user(s). The intelligent virtual agents that are inhabiting this environment are expected to be able to broaden their knowledge about the world and other agents, which may be of different cultural backgrounds, through interactions. This work is part of a collaborative effort within a European research project called eCIRCUS. Specifically, this article focuses on our continuing research concerned with emotional knowledge learning in autobiographic social agents.Peer reviewe

Affective issues in learning technologies: emotional responses to technology and technology's role in supporting socio-emotional skills

This paper focuses on some of the author's research studies over the past thirty years and places these in a wider context to reflect on research into affective issues in learning technologies over this period, and to consider whether and how the issues uncovered by research have changed as technologies have developed over time. Three issues are given particular attention: firstly the reasons for learners' use or lack of use of technologies for their learning; secondly adult learners' attitudes towards using technology for learning and thirdly how technology might support socio-emotional development and expression in children. The discussion of these issues is framed by two of the author's research projects. For the first two issues this is an early study of students' perceptions and attitudes towards using computers for tutorial learning in 1980. The factors that influenced the students' use of the computer tutorials are discussed (including access, assessment and anxiety about using computers) and also the extent to which some of these factors persist for many learners using (or not using) technologies today. The discussion of the third issue draws on a series of studies conducted in the 1990s to investigate whether educational technology could support children and young people's emotional expression and communication and development of socio-emotional skills. Finally the paper considers how these kinds of issues have been taken forward and how they are represented in contemporary research and suggests that trust is an important factor in using learning technologies

Affective issues in learning technologies: emotional responses to technology and technology's role in supporting socio-emotional skills

This paper focuses on some of the author's research studies over the past thirty years and places these in a wider context to reflect on research into affective issues in learning technologies over this period, and to consider whether and how the issues uncovered by research have changed as technologies have developed over time. Three issues are given particular attention: firstly the reasons for learners' use or lack of use of technologies for their learning; secondly adult learners' attitudes towards using technology for learning and thirdly how technology might support socio-emotional development and expression in children. The discussion of these issues is framed by two of the author's research projects. For the first two issues this is an early study of students' perceptions and attitudes towards using computers for tutorial learning in 1980. The factors that influenced the students' use of the computer tutorials are discussed (including access, assessment and anxiety about using computers) and also the extent to which some of these factors persist for many learners using (or not using) technologies today. The discussion of the third issue draws on a series of studies conducted in the 1990s to investigate whether educational technology could support children and young people's emotional expression and communication and development of socio-emotional skills. Finally the paper considers how these kinds of issues have been taken forward and how they are represented in contemporary research and suggests that trust is an important factor in using learning technologies

Architectural experience: Clarifying its central components and their relation to core affect with a set of first-person-view videos

When studying architectural experience in the lab, it is of paramount importance to use a proxy as close to real-world experience as possible. Whilst still images visually describe real spaces, and virtual reality allows for dynamic movement, each medium lacks the alternative attribute. To merge these benefits, we created and validated a novel dataset of valenced videos of first-person-view travel through built environments. This dataset was then used to clarify the relationship of core affect (valence and arousal) and architectural experience. Specifically, we verified the relationship between valence and fascination, coherence, and hominess - three key psychological dimensions of architectural experience which have previously been shown to explain aesthetic ratings of built environments. We also found that arousal is only significantly correlated with fascination, and that both are embedded in a relationship with spatial complexity and unusualness. These results help to clarify the nature of fascination, and to distinguish it from coherence and hominess when it comes to core affect. Moreover, these results demonstrate the utility of a video dataset of affect-laden spaces for understanding architectural experience