The color of smiling: computational synaesthesia of facial expressions

This note gives a preliminary account of the transcoding or rechanneling problem between different stimuli as it is of interest for the natural interaction or affective computing fields. By the consideration of a simple example, namely the color response of an affective lamp to a sensed facial expression, we frame the problem within an information- theoretic perspective. A full justification in terms of the Information Bottleneck principle promotes a latent affective space, hitherto surmised as an appealing and intuitive solution, as a suitable mediator between the different stimuli.Comment: Submitted to: 18th International Conference on Image Analysis and Processing (ICIAP 2015), 7-11 September 2015, Genova, Ital

Modeling a social brain for interactive agents: integrating mirroring and mentalizing

Kahl S, Kopp S. Modeling a social brain for interactive agents: integrating mirroring and mentalizing. In: Brinkman WP, Broekens J, Heylen DKJ, eds. Intelligent Virtual Agents. Springer; 2015: 77-86

An Interaction Game Framework for the Investigation of Human–Agent Cooperation

Kulms P, Mattar N, Kopp S. An Interaction Game Framework for the Investigation of Human–Agent Cooperation. In: Brinkman WP, Broekens J, Heylen DKJ, eds. Intelligent Virtual Agents. Lecture Notes in Computer Science: Vol. 9238. Springer; 2015: 399-402.Success in human-agent interaction will to a large extent depend on the ability of the system to cooperate with humans over repeated tasks. It is not yet clear how cooperation between humans and virtual agents evolves and is interlinked with the attribution of qualities like trustworthiness or competence between the cooperation partners. To explore these questions, we present a new interaction game framework that is centered around a collaborative puzzle game and goes beyond commonly adopted scenarios like the Prisoner’s dilemma. First results are presented at the conference

Humanization of robots: is it really such a good idea?

The aim of this review was to examine the pros and cons of humanizing social robots following a psychological perspective. As such, we had six goals. First, we defined what social robots are. Second, we clarified the meaning of humanizing social robots. Third, we presented the theoretical backgrounds for promoting humanization. Fourth, we conducted a review of empirical results of the positive effects and the negative effects of humanization on human–robot interaction (HRI). Fifth, we presented some of the political and ethical problems raised by the humanization of social robots. Lastly, we discussed the overall effects of the humanization of robots in HRI and suggested new avenues of research and development.info:eu-repo/semantics/publishedVersio

Virtual Reflexes

Virtual Reality is used successfully to treat people for regular phobias. A new challenge is to develop Virtual Reality Exposure Training for social skills. Virtual actors in such systems have to show appropriate social behavior including emotions, gaze, and keeping distance. The behavior must be realistic and real-time. Current approaches consist of four steps: 1) trainee social signal detection, 2) cognitive-affective interpretation, 3) determination of the appropriate bodily responses, and 4) actuation. The "cognitive" detour of such approaches does not match the directness of human bodily reflexes and causes unrealistic responses and delay. Instead, we propose virtual reflexes as concurrent sensory-motor processes to control virtual actors. Here we present a virtual reflexes architecture, explain how emotion and cognitive modulation are embedded, detail its workings, and give an example description of an aggression training application

None in Three: The Design and Development of a Low-cost Violence Prevention Game for the Caribbean Region

Domestic violence is a persistent and universal problem occurring in every culture and social group, with lack of empathy identified as a contributing factor. On average, one in three women and girls in the Caribbean experience domestic violence in their lifetime. In this paper we demonstrate the techniques used during the creation of a low-cost, violence prevention game titled None in Three, targeted at enhancing empathy and awareness among young people in Barbados and Grenada. A research trip was undertaken to gather photographic reference and to meet with young people. Methods to measure the emotional state of players and awareness of characters in-game were explored. Cost-saving measures such as asset store purchases were evaluated. Custom tools were created in order to speed up production, including a bespoke event editor for multiple-choice dialogue sequences, and the use of motion capture libraries and auto-rigging tools to speed up character animation workflows

A cloud-based robot system for long-term interaction: principles, implementation, lessons learned

Making the transition to long-term interaction with social-robot systems has been identified as one of the main challenges in human-robot interaction. This article identifies four design principles to address this challenge and applies them in a real-world implementation: cloud-based robot control, a modular design, one common knowledge base for all applications, and hybrid artificial intelligence for decision making and reasoning. The control architecture for this robot includes a common Knowledge-base (ontologies), Data-base, “Hybrid Artificial Brain” (dialogue manager, action selection and explainable AI), Activities Centre (Timeline, Quiz, Break and Sort, Memory, Tip of the Day, ), Embodied Conversational Agent (ECA, i.e., robot and avatar), and Dashboards (for authoring and monitoring the interaction). Further, the ECA is integrated with an expandable set of (mobile) health applications. The resulting system is a Personal Assistant for a healthy Lifestyle (PAL), which supports diabetic children with self-management and educates them on health-related issues (48 children, aged 6–14, recruited via hospitals in the Netherlands and in Italy). It is capable of autonomous interaction “in the wild” for prolonged periods of time without the need for a “Wizard-of-Oz” (up until 6 months online). PAL is an exemplary system that provides personalised, stable and diverse, long-term human-robot interaction

Affective processes as network hubs

The practical problems of designing and coding a web-based flight simulator for teachers has led to a ‘three-tier plus environment’ model (COVE model) for a software agent’s cognition (C), psychologicsal (O), physical (V) processes and responses to tasks and interpersonal relationships within a learning environment (E). The purpose of this article is to introduce how some of the COVE model layers represent preconscious processing hubs in an AI human-agent’s representation of learning in a serious game, and how an application of the Five Factor Model of psychology in the O layer determines the scope of dimensions for a practical computational model of affective processes. The article illustrates the model with the classroom-learning context of the simSchool application (www.simschool.org); presents details of the COVE model of an agent’s reactions to academic tasks; discusses the theoretical foundations; and outlines the research-based real world impacts from external validation studies as well as new testable hypotheses of simSchool

Experiences of a motivational interview delivered by a robot: qualitative study

Background Motivational interviewing is an effective intervention for supporting behavior change but traditionally depends on face-to-face dialogue with a human counselor. This study addressed a key challenge for the goal of developing social robotic motivational interviewers: creating an interview protocol, within the constraints of current artificial intelligence, which participants will find engaging and helpful. Objective The aim of this study was to explore participants’ qualitative experiences of a motivational interview delivered by a social robot, including their evaluation of usability of the robot during the interaction and its impact on their motivation. Methods NAO robots are humanoid, child-sized social robots. We programmed a NAO robot with Choregraphe software to deliver a scripted motivational interview focused on increasing physical activity. The interview was designed to be comprehensible even without an empathetic response from the robot. Robot breathing and face-tracking functions were used to give an impression of attentiveness. A total of 20 participants took part in the robot-delivered motivational interview and evaluated it after 1 week by responding to a series of written open-ended questions. Each participant was left alone to speak aloud with the robot, advancing through a series of questions by tapping the robot’s head sensor. Evaluations were content-analyzed utilizing Boyatzis’ steps: (1) sampling and design, (2) developing themes and codes, and (3) validating and applying the codes. Results Themes focused on interaction with the robot, motivation, change in physical activity, and overall evaluation of the intervention. Participants found the instructions clear and the navigation easy to use. Most enjoyed the interaction but also found it was restricted by the lack of individualized response from the robot. Many positively appraised the nonjudgmental aspect of the interview and how it gave space to articulate their motivation for change. Some participants felt that the intervention increased their physical activity levels. Conclusions Social robots can achieve a fundamental objective of motivational interviewing, encouraging participants to articulate their goals and dilemmas aloud. Because they are perceived as nonjudgmental, robots may have advantages over more humanoid avatars for delivering virtual support for behavioral change