Experimenting with the Gaze of a Conversational Agent

We have carried out a pilot experiment to investigate the effects of different eye gaze behaviors of a cartoon-like talking face on the quality of human-agent dialogues. We compared a version of the talking face that roughly implements some patterns of humanlike behavior with two other versions. We called this the optimal version. In one of the other versions the shifts in gaze were kept minimal and in the other version the shifts would occur randomly. The talking face has a number of restrictions. There is no speech recognition, so questions and replies have to\ud be typed in by the users of the systems. Despite this restriction we found that participants that conversed with the optimal agent appreciated the agent more than participants that conversed with the other agents. Conversations with the optimal version proceeded more efficiently. Participants needed less time to complete their task

Two-person neuroscience and naturalistic social communication: The role of language and linguistic variables in brain-coupling research

Social cognitive neuroscience (SCN) seeks to understand the brain mechanisms through which we comprehend others? emotions and intentions in order to react accordingly. For decades, SCN has explored relevant domains by exposing individual participants to predesigned stimuli and asking them to judge their social (e.g., emotional) content. Subjects are thus reduced to detached observers of situations that they play no active role in. However, the core of our social experience is construed through real-time interactions requiring the active negotiation of information with other people. To gain more relevant insights into the workings of the social brain, the incipient field of two-person neuroscience (2PN) advocates the study of brain-to-brain coupling through multi-participant experiments. In this paper, we argue that the study of online language-based communication constitutes a cornerstone of 2PN. First, we review preliminary evidence illustrating how verbal interaction may shed light on the social brain. Second, we advance methodological recommendations to design experiments within language-based 2PN. Finally, we formulate outstanding questions for future research.Fil: García, Adolfo Martín. Universidad Nacional de Córdoba. Facultad de Lenguas; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Houssay. Instituto de Neurociencia Cognitiva. Fundación Favaloro. Instituto de Neurociencia Cognitiva; Argentina. Universidad Diego Portales; ChileFil: Ibanez Barassi, Agustin Mariano. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Houssay. Instituto de Neurociencia Cognitiva. Fundación Favaloro. Instituto de Neurociencia Cognitiva; Argentina. Universidad Diego Portales; Chile. Universidad Autónoma del Caribe; Colombia. Australian Research Council Centre of Excellence in Cognition and its Disorders; Australi

Investigating alterations of social interaction in psychiatric disorders with dual interactive eye tracking and virtual faces

This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY).Peer reviewedPublisher PD

Controlling the Gaze of Conversational Agents

We report on a pilot experiment that investigated the effects of different eye gaze behaviours of a cartoon-like talking face on the quality of human-agent dialogues. We compared a version of the talking face that roughly implements some patterns of human-like behaviour with\ud two other versions. In one of the other versions the shifts in gaze were kept minimal and in the other version the shifts would occur randomly. The talking face has a number of restrictions. There is no speech recognition, so questions and replies have to be typed in by the users\ud of the systems. Despite this restriction we found that participants that conversed with the agent that behaved according to the human-like patterns appreciated the agent better than participants that conversed with the other agents. Conversations with the optimal version also\ud proceeded more efficiently. Participants needed less time to complete their task

Eyes on the mind : investigating the influence of gaze dynamics on the perception of others in real-time social interaction

ACKNOWLEDGMENTS This study was partially supported by a grant of the Köln Fortune Program of the Medical Faculty at the University of Cologne to Leonhard Schilbach and by a grant “Other Minds” of the German Ministry of Research and Education to Kai Vogeley. The authors would like to thank Stephanie Alexius and Leonhard Engels for their assistance in data collection.Peer reviewedPublisher PD

De-Roling from Experiences and Identities in Virtual Worlds

Within dramatherapy and psychodrama, the term ‘de-roling’ indicates a set of activities that assist the subjects of therapy in ‘disrobing’ themselves from their fictional characters. Starting from the psychological needs and the therapeutic goals that ‘de-roling’ techniques address in dramatherapy and psychodrama, this text provides a broader understanding of procedures and exercises that define and ease transitional experiences across cultural practices such as religious rituals and spatial design. After this introductory section, we propose a tentative answer as to why game studies and virtual world research largely ignored processes of ‘roling’ and ‘de-roling’ that separate the lived experience of role-play from our everyday sense of the self. The concluding sections argue that de-roling techniques are likely to become more relevant, both academically and in terms of their practical applications, with the growing diffusion of virtual technologies in social practices. The relationships we can establish with ourselves and with our surroundings in digital virtual worlds are, we argue, only partially comparable with similar occurrences in pre-digital practices of subjectification. We propose a perspective according to which the accessibility and immersive phenomenological richness of virtual reality technologies are likely to exacerbate the potentially dissociative effects of virtual reality applications. This text constitutes an initial step towards framing specific socio-technical concerns and starting a timely conversation that binds together dramatherapy, psychodrama, game studies, and the design of digital virtual worlds

Video gaming as practical accomplishment: ethnomethodology, conversation analysis and play

Accounts of video game play developed from an ethnomethodological and conversation analytic (EMCA) perspective remain relatively scarce. This paper collects together an emerging, if scattered, body of research which focusses on the material, practical ‘work’ of video game players. The paper offers an example-driven explication of an EMCA perspective on video game play phenomena. The materials are arranged as a ‘tactical zoom’. We start very much ‘outside’ the game, beginning with a wide view of how massive-multiplayer online games are played within dedicated gaming spaces; here we find multiple players, machines and many different sorts of activities going on (besides playing the game). Still remaining somewhat distanced from the play of the game itself, we then take a closer look at the players themselves by examining a notionally simpler setting involving pairs taking part in a football game at a games console. As we draw closer to the technical details of play, we narrow our focus further still to examine a player and spectator situated ‘at the screen’ but jointly analysing play as the player competes in an online first-person shooter. Finally we go ‘inside’ the game entirely and look at the conduct of avatars on-screen via screen recordings of a massively multiplayer online game. Having worked through specific examples, we provide an elaboration of a selection of core topics of ethnomethodology and conversation analysis that are used to situate some of the unstated orientations in the presentation of data fragments. In this way, recurrent issues raised in the fragments are shown as coherent, interconnected phenomena. In closing, we suggest caution regarding the way game play phenomena have been analysed in the paper, while remarking on challenges present for the development of further EMCA oriented research on video game play

Toward a second-person neuroscience

LS & BT : equal contributions (shared first-authorship)Peer reviewedPreprin

Virtual Worlds: Social Interactions Among Online Gamers Through Voice Chat

Online gaming scholarship has rarely focused on the micro sociological aspects of virtual worlds as much of the research on online games is undertaken by psychologists and scholars in other fields. When a sociological lens is employed in analyzing social interactions that occur in virtual worlds, new understandings of social phenomena in virtual worlds can come to light. My research draws upon multiple sociological theories to make sense of data collect via in-depth interviews and participant observations in an attempt to understand how voice chat influences relationship formation and maintenance, gender relations among online gamers, and how online gamers use the label noob to regulate gamer masculinity in virtual worlds. Findings indicate the voice chat has a both a positive and negative impact on the social interactions of online gamers

Video gaming as practical accomplishment: ethnomethodology, conversation analysis, and play

Accounts of video game play developed from an ethnomethodological and conversation analytic (EMCA) perspective remain relatively scarce. This study collects together an emerging, if scattered, body of research which focuses on the material, practical "work" of video game players. The study offers an example-driven explication of an EMCA perspective on video game play phenomena. The materials are arranged as a "tactical zoom." We start very much "outside" the game, beginning with a wide view of how massive-multiplayer online games are played within dedicated gaming spaces; here, we find multiple players, machines, and many different sorts of activities going on (besides playing the game). Still remaining somewhat distanced from the play of the game itself, we then take a closer look at the players themselves by examining a notionally simpler setting involving pairs taking part in a football game at a games console. As we draw closer to the technical details of play, we narrow our focus further still to examine a player and spectator situated "at the screen" but jointly analyzing play as the player competes in an online first-person shooter. Finally, we go "inside" the game entirely and look at the conduct of avatars on-screen via screen recordings of a massively multiplayer online game. Having worked through specific examples, we provide an elaboration of a selection of core topics of ethnomethodology and conversation analysis that is used to situate some of the unstated orientations in the presentation of data fragments. In this way, recurrent issues raised in the fragments are shown as coherent, interconnected phenomena. In closing, we suggest caution regarding the way game play phenomena have been analyzed in this study, while remarking on challenges present for the development of further EMCA-oriented research on video game play