Controlling the Gaze of Conversational Agents

We report on a pilot experiment that investigated the effects of different eye gaze behaviours of a cartoon-like talking face on the quality of human-agent dialogues. We compared a version of the talking face that roughly implements some patterns of human-like behaviour with\ud two other versions. In one of the other versions the shifts in gaze were kept minimal and in the other version the shifts would occur randomly. The talking face has a number of restrictions. There is no speech recognition, so questions and replies have to be typed in by the users\ud of the systems. Despite this restriction we found that participants that conversed with the agent that behaved according to the human-like patterns appreciated the agent better than participants that conversed with the other agents. Conversations with the optimal version also\ud proceeded more efficiently. Participants needed less time to complete their task

Identifying Personality Traits Using Overlap Dynamics in Multiparty Dialogue

Research on human spoken language has shown that speech plays an important role in identifying speaker personality traits. In this work, we propose an approach for identifying speaker personality traits using overlap dynamics in multiparty spoken dialogues. We first define a set of novel features representing the overlap dynamics of each speaker. We then investigate the impact of speaker personality traits on these features using ANOVA tests. We find that features of overlap dynamics significantly vary for speakers with different levels of both Extraversion and Conscientiousness. Finally, we find that classifiers using only overlap dynamics features outperform random guessing in identifying Extraversion and Agreeableness, and that the improvements are statistically significant.Comment: Proceedings Interspeech 2019, Graz, Austria, Septembe

Detecting Low Rapport During Natural Interactions in Small Groups from Non-Verbal Behaviour

Rapport, the close and harmonious relationship in which interaction partners are "in sync" with each other, was shown to result in smoother social interactions, improved collaboration, and improved interpersonal outcomes. In this work, we are first to investigate automatic prediction of low rapport during natural interactions within small groups. This task is challenging given that rapport only manifests in subtle non-verbal signals that are, in addition, subject to influences of group dynamics as well as inter-personal idiosyncrasies. We record videos of unscripted discussions of three to four people using a multi-view camera system and microphones. We analyse a rich set of non-verbal signals for rapport detection, namely facial expressions, hand motion, gaze, speaker turns, and speech prosody. Using facial features, we can detect low rapport with an average precision of 0.7 (chance level at 0.25), while incorporating prior knowledge of participants' personalities can even achieve early prediction without a drop in performance. We further provide a detailed analysis of different feature sets and the amount of information contained in different temporal segments of the interactions.Comment: 12 pages, 6 figure

Leadership conversations: the impact on patient environments

Purpose – The aim of this study is to examine 15 NHS acute trusts in England that achieved high scores at all their hospitals in the first four national Patient Environment audits. No common external explanations were discernible. This paper seeks to examine whether the facilities managers responsible for the Patient Environment displayed a consistent leadership style. Design/methodology/approach – Overall, six of the 15 trusts gave permission for the research to take place and a series of unstructured interviews and observations were arranged with 22 facilities managers in these trusts. Responses were transcribed and categorised through multiple iteration. Findings – The research found common leadership and managerial behaviours, many of which could be identified from other literature. The research also identified managers deliberately devoting energy and time to creating networks of conversations. This creation of networks through managing conversation is behaviour less evident in mainstream leadership literature or in the current Department of Health and NHS leadership models. Practical implications – The findings of this study offer managers (particularly those in FM and managers across NHS) a unique insight into the potential impact of leaders giving an opportunity to re-model thinking on management and leadership and the related managerial development opportunities. It provides the leverage to move facilities management from the role of a commodity or support service, to a position as a true enabler of business. Originality/value – Original research is presented in a previously under-examined area. The paper illuminates how facilities management within trusts achieving high Patient Environment Action Team (PEAT) scores is led.</p

Experimenting with the Gaze of a Conversational Agent

We have carried out a pilot experiment to investigate the effects of different eye gaze behaviors of a cartoon-like talking face on the quality of human-agent dialogues. We compared a version of the talking face that roughly implements some patterns of humanlike behavior with two other versions. We called this the optimal version. In one of the other versions the shifts in gaze were kept minimal and in the other version the shifts would occur randomly. The talking face has a number of restrictions. There is no speech recognition, so questions and replies have to\ud be typed in by the users of the systems. Despite this restriction we found that participants that conversed with the optimal agent appreciated the agent more than participants that conversed with the other agents. Conversations with the optimal version proceeded more efficiently. Participants needed less time to complete their task