Explorations in engagement for humans and robots

This paper explores the concept of engagement, the process by which individuals in an interaction start, maintain and end their perceived connection to one another. The paper reports on one aspect of engagement among human interactors--the effect of tracking faces during an interaction. It also describes the architecture of a robot that can participate in conversational, collaborative interactions with engagement gestures. Finally, the paper reports on findings of experiments with human participants who interacted with a robot when it either performed or did not perform engagement gestures. Results of the human-robot studies indicate that people become engaged with robots: they direct their attention to the robot more often in interactions where engagement gestures are present, and they find interactions more appropriate when engagement gestures are present than when they are not.Comment: 31 pages, 5 figures, 3 table

Co-Constructing Writing Knowledge: Students’ Collaborative Talk Across Contexts

Although compositionists recognize that student talk plays an important role in learning to write, there is limited understanding of how students use conversational moves to collaboratively build knowledge about writing across contexts. This article reports on a study of focus group conversations involving first-year students in a cohort program. Our analysis identified two patterns of group conversation among students: “co-telling” and “co-constructing,” with the latter leading to more complex writing knowledge. We also used Beaufort’s domains of writing knowledge to examine how co-constructing conversations supported students in abstracting knowledge beyond a single classroom context and in negotiating local constraints. Our findings suggest that co-constructing is a valuable process that invites students to do the necessary work of remaking their knowledge for local use. Ultimately, our analysis of the role of student conversation in the construction of writing knowledge contributes to our understanding of the myriad activities that surround transfer of learning

Some conversational challenges of talking with machines

A surge of interest in the capabilities of so-called 'conversational' technologies—both from research and industrial contexts—furnishes CSCW and HCI with opportunities to enrich and leverage its historic connection to conversation analysis (and relatedly, ethnomethodology) in novel ways. This paper explores a number of preliminary interactional troubles one might encounter when 'talking to' conversational agents, and in doing so sketches out possible routes forward in the empirical study of agents as collaborative technologies, as well as touching on further conceptual challenges that face research in this area

A Virtual Conversational Agent for Teens with Autism: Experimental Results and Design Lessons

We present the design of an online social skills development interface for teenagers with autism spectrum disorder (ASD). The interface is intended to enable private conversation practice anywhere, anytime using a web-browser. Users converse informally with a virtual agent, receiving feedback on nonverbal cues in real-time, and summary feedback. The prototype was developed in consultation with an expert UX designer, two psychologists, and a pediatrician. Using the data from 47 individuals, feedback and dialogue generation were automated using a hidden Markov model and a schema-driven dialogue manager capable of handling multi-topic conversations. We conducted a study with nine high-functioning ASD teenagers. Through a thematic analysis of post-experiment interviews, identified several key design considerations, notably: 1) Users should be fully briefed at the outset about the purpose and limitations of the system, to avoid unrealistic expectations. 2) An interface should incorporate positive acknowledgment of behavior change. 3) Realistic appearance of a virtual agent and responsiveness are important in engaging users. 4) Conversation personalization, for instance in prompting laconic users for more input and reciprocal questions, would help the teenagers engage for longer terms and increase the system's utility

Meetings and Meeting Modeling in Smart Environments

In this paper we survey our research on smart meeting rooms and its relevance for augmented reality meeting support and virtual reality generation of meetings in real time or off-line. The research reported here forms part of the European 5th and 6th framework programme projects multi-modal meeting manager (M4) and augmented multi-party interaction (AMI). Both projects aim at building a smart meeting environment that is able to collect multimodal captures of the activities and discussions in a meeting room, with the aim to use this information as input to tools that allow real-time support, browsing, retrieval and summarization of meetings. Our aim is to research (semantic) representations of what takes place during meetings in order to allow generation, e.g. in virtual reality, of meeting activities (discussions, presentations, voting, etc.). Being able to do so also allows us to look at tools that provide support during a meeting and at tools that allow those not able to be physically present during a meeting to take part in a virtual way. This may lead to situations where the differences between real meeting participants, human-controlled virtual participants and (semi-) autonomous virtual participants disappear

Group Inquiry

Group agents can act, they can have knowledge. How should we understand the species of collective action which aims at knowledge? In this paper, I present an account of group inquiry. This account faces two challenges: making sense of how large-scale distributed activities might be a kind of group action, and understanding the division of labour involved in group inquiry. In the first part of the paper, I argue that existing accounts of group action face problems dealing with large-scale group actions, and propose a minimal alternative account. In the second part of the paper, I draw on an analogy between inquiry and conversation, arguing that work by Robert Stalnaker and Craige Roberts helps us to think about the division of epistemic labour. In the final part of the paper I put the accounts of group action and inquiry together, and consider how to think about group knowledge, deep ignorance, and the different kinds of division of labour

No Grice: Computers that Lie, Deceive and Conceal

In the future our daily life interactions with other people, with computers, robots and smart environments will be recorded and interpreted by computers or embedded intelligence in environments, furniture, robots, displays, and wearables. These sensors record our activities, our behavior, and our interactions. Fusion of such information and reasoning about such information makes it possible, using computational models of human behavior and activities, to provide context- and person-aware interpretations of human behavior and activities, including determination of attitudes, moods, and emotions. Sensors include cameras, microphones, eye trackers, position and proximity sensors, tactile or smell sensors, et cetera. Sensors can be embedded in an environment, but they can also move around, for example, if they are part of a mobile social robot or if they are part of devices we carry around or are embedded in our clothes or body. \ud \ud Our daily life behavior and daily life interactions are recorded and interpreted. How can we use such environments and how can such environments use us? Do we always want to cooperate with these environments; do these environments always want to cooperate with us? In this paper we argue that there are many reasons that users or rather human partners of these environments do want to keep information about their intentions and their emotions hidden from these smart environments. On the other hand, their artificial interaction partner may have similar reasons to not give away all information they have or to treat their human partner as an opponent rather than someone that has to be supported by smart technology.\ud \ud This will be elaborated in this paper. We will survey examples of human-computer interactions where there is not necessarily a goal to be explicit about intentions and feelings. In subsequent sections we will look at (1) the computer as a conversational partner, (2) the computer as a butler or diary companion, (3) the computer as a teacher or a trainer, acting in a virtual training environment (a serious game), (4) sports applications (that are not necessarily different from serious game or education environments), and games and entertainment applications