Explorations in engagement for humans and robots

This paper explores the concept of engagement, the process by which individuals in an interaction start, maintain and end their perceived connection to one another. The paper reports on one aspect of engagement among human interactors--the effect of tracking faces during an interaction. It also describes the architecture of a robot that can participate in conversational, collaborative interactions with engagement gestures. Finally, the paper reports on findings of experiments with human participants who interacted with a robot when it either performed or did not perform engagement gestures. Results of the human-robot studies indicate that people become engaged with robots: they direct their attention to the robot more often in interactions where engagement gestures are present, and they find interactions more appropriate when engagement gestures are present than when they are not.Comment: 31 pages, 5 figures, 3 table

Evaluating Perceived Trust From Procedurally Animated Gaze

Adventure role playing games (RPGs) provide players with increasingly expansive worlds, compelling storylines, and meaningful fictional character interactions. Despite the fast-growing richness of these worlds, the majority of interactions between the player and non-player characters (NPCs) still remain scripted. In this paper we propose using an NPC’s animations to reflect how they feel towards the player and as a proof of concept, investigate the potential for a straightforward gaze model to convey trust. Through two perceptual experiments, we find that viewers can distinguish between high and low trust animations, that viewers associate the gaze differences specifically with trust and not with an unrelated attitude (aggression), and that the effect can hold for different facial expressions and scene contexts, even when viewed by participants for a short (five second) clip length. With an additional experiment, we explore the extent that trust is uniquely conveyed over other attitudes associated with gaze, such as interest, unfriendliness, and admiration

로봇의 고개를 움직이는 동작과 타이밍이 인간과 로봇의 상호작용에 미치는 효과

학위논문(석사) -- 서울대학교대학원 : 인문대학 협동과정 인지과학전공, 2023. 2. Sowon Hahn.In recent years, robots with artificial intelligence capabilities have become ubiquitous in our daily lives. As intelligent robots are interacting closely with humans, social abilities of robots are increasingly more important. In particular, nonverbal communication can enhance the efficient social interaction between human users and robots, but there are limitations of behavior expression. In this study, we investigated how minimal head movements of the robot influence human-robot interaction. We newly designed a robot which has a simple shaped body and minimal head movement mechanism. We conducted an experiment to examine participants' perception of robots different head movements and timing. Participants were randomly assigned to one of three movement conditions, head nodding (A), head shaking (B) and head tilting (C). Each movement condition included two timing variables, prior head movement of utterance and simultaneous head movement with utterance. For all head movement conditions, participants' perception of anthropomorphism, animacy, likeability and intelligence were higher compared to non-movement (utterance only) condition. In terms of timing, when the robot performed head movement prior to utterance, perceived naturalness was rated higher than simultaneous head movement with utterance. The findings demonstrated that head movements of the robot positively affects user perception of the robot, and head movement prior to utterance can make human-robot conversation more natural. By implementation of head movement and movement timing, simple shaped robots can have better social interaction with humans.최근 인공지능 로봇은 일상에서 흔하게 접할 수 있는 것이 되었다. 인간과의 교류가 늘어남에 따라 로봇의 사회적 능력은 더 중요해지고 있다. 인간과 로봇의 사회적 상호작용은 비언어적 커뮤니케이션을 통해 강화될 수 있다. 그러나 로봇은 비언어적 제스처의 표현에 제약을 갖는다. 또한 로봇의 응답 지연 문제는 인간이 불편한 침묵의 순간을 경험하게 한다. 본 연구를 통해 로봇의 고개 움직임이 인간과 로봇의 상호작용에 어떤 영향을 미치는지 알아보았다. 로봇의 고개 움직임을 탐구하기 위해 단순한 형상과 고개를 움직이는 구조를 가진 로봇을 새롭게 디자인하였다. 이 로봇을 활용하여 로봇의 머리 움직임과 타이밍이 참여자에게 어떻게 지각되는지 실험하였다. 참여자들은 3가지 움직임 조건인, 끄덕임 (A), 좌우로 저음 (B), 기울임 (C) 중 한 가지 조건에 무작위로 선정되었다. 각각의 고개 움직임 조건은 두 가지 타이밍(음성보다 앞선 고개 움직임, 음성과 동시에 일어나는 고개 움직임)의 변수를 갖는다. 모든 타입의 고개 움직임에서 움직임이 없는 조건과 비교하여 로봇의 인격화, 활동성, 호감도, 감지된 지능이 향상된 것을 관찰하였다. 타이밍은 로봇의 음성보다 고개 움직임이 앞설 때 자연스러움이 높게 지각되는 것으로 관찰되었다. 결과적으로, 로봇의 고개 움직임은 사용자의 지각에 긍정적인 영향을 주며, 앞선 타이밍의 고개 움직임이 자연스러움을 향상시키는 것을 확인하였다. 고개를 움직이는 동작과 타이밍을 통해 단순한 형상의 로봇과 인간의 상호작용이 향상될 수 있음을 본 연구를 통해 확인하였다.Chapter 1. Introduction 1 1.1. Motivation 1 1.2. Literature Review and Hypotheses 3 1.3. Purpose of Study 11 Chapter 2. Experiment 13 2.1. Methods 13 2.2. Results 22 2.3. Discussion 33 Chapter 3. Conclusion 35 Chapter 4. General Discussion 37 4.1. Theoretical Implications 37 4.2. Practical Implications 38 4.3. Limitations and Future work 39 References 41 Appendix 53 Abstract in Korean 55석

Incremental interpretation and prediction of utterance meaning for interactive dialogue

                                                                                                                We present techniques for the incremental interpretation and prediction of utterance meaning in dialogue systems. These techniques open possibilities for systems to initiate responsive overlap behaviors during user speech, such as interrupting, acknowledging, or completing a user's utterance while it is still in progress. In an implemented system, we show that relatively high accuracy can be achieved in understanding of spontaneous utterances before utterances are completed. Further, we present a method for determining when a system has reached a point of maximal understanding of an ongoing user utterance, and show that this determination can be made with high precision. Finally, we discuss a prototype implementation that shows how systems can use these abilities to strategically initiate system completions of user utterances. More broadly, this framework facilitates the implementation of a range of overlap behaviors that are common in human dialogue, but have been largely absent in dialogue systems