WoZ Pilot Experiment for Empathic Robotic Tutors: Opportunities and Challenges

We discuss the challenges and opportunities in building empathic robotic tutors based on a preliminary Wizard-of-Oz (WoZ) pilot study. From the data collected in this study, we identify situations where empathy in a robotic tutor could have helped the conversation between the learner and the tutor. The video presented with this paper captures these situations where two children participants are interacting with a map application and a robot tutor operated by a wizard

The interaction between voice and appearance in the embodiment of a robot tutor

Robot embodiment is, by its very nature, holistic and understanding how various aspects contribute to the user perception of the robot is non-trivial. A study is presented here that investigates whether there is an interaction effect between voice and other aspects of embodiment, such as movement and appearance, in a pedagogical setting. An on-line study was distributed to children aged 11–17 that uses a modified Godspeed questionnaire. We show an interaction effect between the robot embodiment and voice in terms of perceived lifelikeness of the robot. Politeness is a key strategy used in learning and teaching, and here an effect is also observed for perceived politeness. Interestingly, participants’ overall preference was for embodiment combinations that are deemed polite and more like a teacher, but are not necessarily the most lifelike. From these findings, we are able to inform the design of robotic tutors going forward

Effective Tutoring with Empathic Embodied Conversational Agents

This thesis examines the prospect of using empathy in an Embodied Tutoring System (ETS) that guides students through an online quiz (by providing feedback on student answers and responding to self-reported student emotion). The ETS seeks to imitate human behaviours successfully used in one-to-one human tutorial interactions. The main hypothesis is that the interaction with an empathic ETS results in greater learning gains than a neutral ETS, primarily by encouraging positive and reducing negative student emotions using empathic feedback. In a preparatory study we investigated different strategies for expressing emotion by the ETS. We established that a multimodal strategy achieves the best results regarding how accurately human participants can recognise the emotions. This approach was used in developing the feedback strategy for our empathic ETS. The preparatory study was followed by two studies in which we compared a neutral with an empathic ETS. The ETS in the second of these studies was developed using results from the first of these studies. In both studies, we found no statistically significant difference in learning gains between the neutral and empathic ETS. However, we did discover a number of interactions between the ETS system, learning gains and, in particular 1) student scores on an empathic tendency test and 2) student ability. We also analysed the subjective responses and the relation between self-reported emotions during the quiz and student learning gains. Based on our studies in a formal class room setting, we assess the prospects of using empathic agents in a classroom setting and describe a number of requirements for their effective use

A virtual diary companion

Chatbots and embodied conversational agents show turn based conversation behaviour. In current research we almost always assume that each utterance of a human conversational partner should be followed by an intelligent and/or empathetic reaction of chatbot or embodied agent. They are assumed to be alert, trying to please the user. There are other applications which have not yet received much attention and which require a more patient or relaxed attitude, waiting for the right moment to provide feedback to the human partner. Being able and willing to listen is one of the conditions for being successful. In this paper we have some observations on listening behaviour research and introduce one of our applications, the virtual diary companion

Dynamic Facial Expression of Emotion Made Easy

Facial emotion expression for virtual characters is used in a wide variety of areas. Often, the primary reason to use emotion expression is not to study emotion expression generation per se, but to use emotion expression in an application or research project. What is then needed is an easy to use and flexible, but also validated mechanism to do so. In this report we present such a mechanism. It enables developers to build virtual characters with dynamic affective facial expressions. The mechanism is based on Facial Action Coding. It is easy to implement, and code is available for download. To show the validity of the expressions generated with the mechanism we tested the recognition accuracy for 6 basic emotions (joy, anger, sadness, surprise, disgust, fear) and 4 blend emotions (enthusiastic, furious, frustrated, and evil). Additionally we investigated the effect of VC distance (z-coordinate), the effect of the VC's face morphology (male vs. female), the effect of a lateral versus a frontal presentation of the expression, and the effect of intensity of the expression. Participants (n=19, Western and Asian subjects) rated the intensity of each expression for each condition (within subject setup) in a non forced choice manner. All of the basic emotions were uniquely perceived as such. Further, the blends and confusion details of basic emotions are compatible with findings in psychology

Towards more humane machines: creating emotional social robots

Robots are now widely used in industrial settings, and today the world has woken up to the impact that they will have in our society. But robots have been limited to repetitive, industrial tasks. However, recent platforms are becoming more secure to operate amongst humans, and research in Human-Robot Interaction (HRI) is preparing robots for use in schools, public services and eventually everyone’s home. If we aim for a robot flexible enough to work around humans and decide autonomously how to act in complex situations, a notion of morality is needed for their decision making. In this chapter we argue that we can achieve some level of moral decision making in social robots if they are endowed with empathy capabilities. We then discuss how to build artificial empathy in robots, giving some concrete examples of how these implementations can guide the path to creating moral social robots in the future.info:eu-repo/semantics/acceptedVersio

Social robots in educational contexts: developing an application in enactive didactics

Due to advancements in sensor and actuator technology robots are becoming more and more common in everyday life. Many of the areas in which they are introduced demand close physical and social contact. In the last ten years the use of robots has also increasingly spread to the field of didactics, starting with their use as tools in STEM education. With the advancement of social robotics, the use of robots in didactics has been extended also to tutoring situations in which these \u201csocially aware\u201d robots interact with mainly children in, for example, language learning classes. In this paper we will give a brief overview of how robots have been used in this kind of settings until now. As a result it will become transparent that the majority of applications are not grounded in didactic theory. Recognizing this shortcoming, we propose a theory driven approach to the use of educational robots, centred on the idea that the combination of enactive didactics and social robotics holds great promises for a variety of tutoring activities in educational contexts. After defining our \u201cEnactive Robot Assisted Didactics\u201d approach, we will give an outlook on how the use of humanoid robots can advance it. On this basis, at the end of the paper, we will describe a concrete, currently on-going implementation of this approach, which we are realizing with the use of Softbank Robotics\u2019 Pepper robot during university lectures