A Review of Verbal and Non-Verbal Human-Robot Interactive Communication

In this paper, an overview of human-robot interactive communication is presented, covering verbal as well as non-verbal aspects of human-robot interaction. Following a historical introduction, and motivation towards fluid human-robot communication, ten desiderata are proposed, which provide an organizational axis both of recent as well as of future research on human-robot communication. Then, the ten desiderata are examined in detail, culminating to a unifying discussion, and a forward-looking conclusion

Study of the Importance of Adequacy to Robot Verbal and Non Verbal Communication in Human-Robot interaction

The Robadom project aims at creating a homecare robot that help and assist people in their daily life, either in doing task for the human or in managing day organization. A robot could have this kind of role only if it is accepted by humans. Before thinking about the robot appearance, we decided to evaluate the importance of the relation between verbal and nonverbal communication during a human-robot interaction in order to determine the situation where the robot is accepted. We realized two experiments in order to study this acceptance. The first experiment studied the importance of having robot nonverbal behavior in relation of its verbal behavior. The second experiment studied the capability of a robot to provide a correct human-robot interaction.Comment: the 43rd Symposium on Robotics - ISR 2012, Taipei : Taiwan, Province Of China (2012

A virtual diary companion

Chatbots and embodied conversational agents show turn based conversation behaviour. In current research we almost always assume that each utterance of a human conversational partner should be followed by an intelligent and/or empathetic reaction of chatbot or embodied agent. They are assumed to be alert, trying to please the user. There are other applications which have not yet received much attention and which require a more patient or relaxed attitude, waiting for the right moment to provide feedback to the human partner. Being able and willing to listen is one of the conditions for being successful. In this paper we have some observations on listening behaviour research and introduce one of our applications, the virtual diary companion

Artificial Intelligence: Robots, Avatars, and the Demise of the Human Mediator

Published in cooperation with the American Bar Association Section of Dispute Resolutio

Confirmation Report: Modelling Interlocutor Confusion in Situated Human Robot Interaction

Human-Robot Interaction (HRI) is an important but challenging field focused on improving the interaction between humans and robots such to make the interaction more intelligent and effective. However, building a natural conversational HRI is an interdisciplinary challenge for scholars, engineers, and designers. It is generally assumed that the pinnacle of human- robot interaction will be having fluid naturalistic conversational interaction that in important ways mimics that of how humans interact with each other. This of course is challenging at a number of levels, and in particular there are considerable difficulties when it comes to naturally monitoring and responding to the user’s mental state. On the topic of mental states, one field that has received little attention to date is moni- toring the user for possible confusion states. Confusion is a non-trivial mental state which can be seen as having at least two substates. There two confusion states can be thought of as being associated with either negative or positive emotions. In the former, when people are productively confused, they have a passion to solve any current difficulties. Meanwhile, people who are in unproductive confusion may lose their engagement and motivation to overcome those difficulties, which in turn may even lead them to drop the current conversation. While there has been some research on confusion monitoring and detection, it has been limited with the most focused on evaluating confusion states in online learning tasks. The central hypothesis of this research is that the monitoring and detection of confusion states in users is essential to fluid task-centric HRI and that it should be possible to detect such confusion and adjust policies to mitigate the confusion in users. In this report, I expand on this hypothesis and set out several research questions. I also provide a comprehensive literature review before outlining work done to date towards my research hypothesis, I also set out plans for future experimental work

Artificial Intelligence: Robots, Avatars, and the Demise of the Human Mediator

Published in cooperation with the American Bar Association Section of Dispute Resolutio

로봇의 신체 언어가 사회적 특성과 인간 유사성에 미치는 영향

학위논문 (석사) -- 서울대학교 대학원 : 사회과학대학 심리학과, 2021. 2. Sowon Hahn.The present study investigated the role of robots’ body language on perceptions of social qualities and human-likeness in robots. In experiment 1, videos of a robot’s body language varying in expansiveness were used to evaluate the two aspects. In experiment 2, videos of social interactions containing the body languages in experiment 1 were used to further examine the effects of robots’ body language on these aspects. Results suggest that a robot conveying open body language are evaluated higher on perceptions of social characteristics and human-likeness compared to a robot with closed body language. These effects were not found in videos of social interactions (experiment 2), which suggests that other features play significant roles in evaluations of a robot. Nonetheless, current research provides evidence of the importance of robots’ body language in judgments of social characteristics and human-likeness. While measures of social qualities and human-likeness favor robots that convey open body language, post-experiment interviews revealed that participants expect robots to alleviate feelings of loneliness and empathize with them, which require more diverse body language in addition to open body language. Thus, robotic designers are encouraged to develop robots capable of expressing a wider range of motion. By enabling complex movements, more natural communications between humans and robots are possible, which allows humans to consider robots as social partners.본 연구는 로봇의 신체 언어가 사회적 특성과 인간과의 유사성에 대한 인간의 인식에 미치는 영향을 탐색하였다. 실험 1에서는 로봇의 개방적 신체 언어가 묘사된 영상과 폐쇄적 신체 언어가 묘사된 영상을 통해 이러한 세 가지 측면을 살펴보았다. 실험 2에서는 실험 1의 신체 언어가 포함된 로봇과 사람 간의 상호작용 영상을 활용하여 로봇의 신체 언어가 위 두 가지 측면에 미치는 영향을 탐색하였다. 결과적으로, 사람들은 폐쇄적 신체 언어를 표현하는 로봇에 비해 개방적 신체 언어를 표현하는 로봇을 사회적 특성과 인간과의 유사성에 대한 인식 면에서 더 높게 평가한다는 것을 확인하였다. 그러나 사람과의 상호작용을 담은 영상을 통해서는 이러한 효과가 발견되지 않았으며, 이는 실험 2에 포함된 음성 등의 다른 특징이 로봇에 대한 평가에 중요한 역할을 한다는 것을 시사한다. 그럼에도 불구하고, 본 연구는 로봇의 신체 언어가 사회적 특성 및 인간과의 유사성에 대한 인식의 중요한 요인이 된다는 근거를 제공한다. 사회적 특성과 인간과의 유사성의 척도에서는 개방적 신체 언어를 표현하는 로봇이 더 높게 평가되었지만, 실험 후 인터뷰에서는 로봇이 외로운 감정을 완화하고 공감하기를 기대하는 것으로 나타나 이 상황들에 적절한 폐쇄적 신체 언어 또한 배제할 수 없다고 해석할 수 있다. 이에 따라 본 연구에서는 로봇 디자이너들이 더욱 다양한 범위의 움직임을 표현할 수 있는 로봇을 개발하도록 장려한다. 그렇다면 섬세한 움직임에 따른 자연스러운 의사소통을 통해 인간이 로봇을 사회적 동반자로 인식할 수 있을 것이다.Chapter 1. Introduction 1 1. Motivation 1 2. Theoretical Background and Previous Research 3 3. Purpose of Study 12 Chapter 2. Experiment 1 13 1. Objective and Hypotheses 13 2. Methods 13 3. Results 21 4. Discussion 31 Chapter 3. Experiment 2 34 1. Objective and Hypotheses 34 2. Methods 35 3. Results 38 4. Discussion 50 Chapter 4. Conclusion 52 Chapter 5. General Discussion 54 References 60 Appendix 70 국문초록 77Maste

Artificial Intelligence: Robots, Avatars and the Demise of the Human Mediator

As technology has advanced, many have wondered whether (or simply when) artificial intelligent devices will replace the humans who perform complex, interactive, interpersonal tasks such as dispute resolution. Has science now progressed to the point that artificial intelligence devices can replace human mediators, arbitrators, dispute resolvers and problem solvers? Can humanoid robots, attractive avatars and other relational agents create the requisite level of trust and elicit the truthful, perhaps intimate or painful, disclosures often necessary to resolve a dispute or solve a problem? This article will explore these questions. Regardless of whether the reader is convinced that the demise of the human mediator or arbitrator is imminent, one cannot deny that artificial intelligence now has the capability to assume many of the responsibilities currently being performed by alternative dispute resolution (ADR) practitioners. It is fascinating (and perhaps unsettling) to realize the complexity and seriousness of tasks currently delegated to avatars and robots. This article will review some of those delegations and suggest how the artificial intelligence developed to complete those assignments may be relevant to dispute resolution and problem solving. “Relational Agents,” which can have a physical presence such as a robot, be embodied in an avatar, or have no detectable form whatsoever and exist only as software, are able to create long term socio-economic relationships with users built on trust, rapport and therapeutic goals. Relational agents are interacting with humans in circumstances that have significant consequences in the physical world. These interactions provide insights as to how robots and avatars can participate productively in dispute resolution processes. Can human mediators and arbitrators be replaced by robots and avatars that not only physically resemble humans, but also act, think, and reason like humans? And to raise a particularly interesting question, can robots, avatars and other relational agents look, move, act, think, and reason even “better” than humans