Are you being addressed?: real-time addressee detection to support remote participants in hybrid meetings

A meeting assistant agent for (remote) participants in hybrid meetings has been developed. Its task is to monitor the meeting conversation and notify the user when he is being addressed. This paper presents the experiments that have been performed to develop machine classifiers to decide if “You are being addressed��? where “You��? refers to a fixed (remote) participant in a meeting. The experimental results back up the choices made regarding the selection of data, features, and classification methods. We discuss variations of the addressee classification problem that have been considered in the literature and how suitable they are for addressing detection in a system that plays a role in a live meeting

Feedback presentation for mobile personalised digital physical activity coaching platforms

User interface design and feedback are important in personalised behavior change support systems. This paper discusses two service platforms that monitor user’s physical activity through wearable sensors and that present the user personalised feedback. Important principles for effectiveness of such systems are personalisation or tailoring, context- awareness, feedback and interaction. We focus here on the presentation of feedback to the user. We present results of a number of short and long term user studies in which we compare different forms of feedback presentation: text, graphics and with or without an anthropomorphic graphical talking character. Results show that although some users like the talking character they don’t have a positive effect on adherence to the activity program. The outcomes of the user evaluations support our beliefs that personal motivation is of primary importance for the effectiveness of these systems. Technical challenges ahead are to support more personal and context-aware feedback, more variations as well as the possibility for more interaction with the coaching system

Computational models of social and emotional turn-taking for embodied conversational agents: a review

The emotional involvement of participants in a conversation not only shows in the words they speak and in the way they speak and gesture but also in their turn-taking behavior. This paper reviews research into computational models of embodied conversational agents. We focus on models for turn-taking management and (social) emotions. We are particularly interested in how in these models emotions of the agent itself and those of the others in uence the agent's turn-taking behavior and vice versa how turn-taking behavior of the partner is perceived by the agent itself. The system of turn-taking rules presented by Sacks, Schegloff and Jefferson (1974) is often a starting point for computational turn-taking models of conversational agents. But emotions have their own rules besides the "one-at-a-time" paradigm of the SSJ system. It turns out that almost without exception computational models of turn-taking behavior that allow "continuous interaction" and "natural turntaking" do not model the underlying psychological, affective, attentional and cognitive processes. They are restricted to rules in terms of a number of supercially observable cues. On the other hand computational models for virtual humans that are based on a functional theory of social emotion do not contain explicit rules on how social emotions affect turn-taking behavior or how the emotional state of the agent is affected by turn-taking behavior of its interlocutors. We conclude with some preliminary ideas on what an architecture for emotional turn-taking should look like and we discuss the challenges in building believable emotional turn-taking agents

Inter-usability and the Presentation of Multi-modal Feedback for Physical Activity and Diabetic Type II Patients

In the EU Artemis project Smarcos we developed a personal attentive system that supports users in attaining a healthy lifestyle. The system is a persuasive system. Persuasive systems, and especially behaviour change support systems (BCSS) are information systems designed to form, alter or reinforce attitudes, behaviours or an act of complying without using deception, coercion or inducements. BCSS support people in their daily life by providing support by means of a human or digital coach. These systems can support users in coping with chronic diseases like COPD and diabetics, but also to be more physical active

A corpus for studying addressing behaviour in multi-party dialogues

This paper describes a multi-modal corpus of hand-annotated meeting dialogues that was designed for studying addressing behaviour in face-to-face conversations. The corpus contains annotated dialogue acts, addressees, adjacency pairs and gaze direction. First, we describe the corpus design where we present the meetings collection, annotation scheme and annotation tools. Then, we present the\ud analysis of the reproducibility and stability of the annotation scheme

The influence of locative media on social information sharing: a review

Mobile phones and social media enable people to share information with others whenever they want, wherever they want. More recent developments allow people to augment their sharing experience by geo-tagging their information through GPS enabled phones. These 'locative media' can be used to facilitate navigation, way finding or to obtain information about a physical place or object. Other services let the users tag, rate public spaces and recommend them to other people. Furthermore, people can tell their stories by attaching their own context to a physical location. This report is a literature review in the field of locative media. In order to get a complete overview of the research that is done on location-based social networking, the most recent developments in the field are investigated. We also look at research methods used to test the user experience of this type of social media systems. Furthermore, we investigate the influence of location based media on the sharing habits and social practices of the users of these systems. The conclusions of this exploration in the field of locative media research lead to design guidelines and research methods that will be used in a user evaluation of a system for location based smart photo sharing

Virtual coaches for healthy lifestyle

Since the introduction of the idea of the software interface agent the question recurs whether these agents should be personified and graphically visualized in the interface. In this chapter we look at the use of virtual humans in the interface of healthy lifestyle coaching systems. Based on theory of persuasive communication we analyse the impact that the use of graphical interface agents may have on user experience and on the efficacy of this type of persuasive systems. We argue that research on the impact of a virtual human interface on the efficacy of these systems requires longitudinal field studies in addition to the controlled short-term user evaluations in the field of human computer interaction (HCI). We introduce Kristina, a mobile personal coaching system that monitors its user’s physical activity and that presents feedback messages to the user. We present results of field trials (N = 60, 7 weeks) in which we compare two interface conditions on a smartphone. In one condition feedback messages are presented by a virtual animated human, in the other condition they are displayed on the screen in text. Results of the field trials show that user motivation, use context and the type of device on which the feedback message is received influence the perception of the presentation format of feedback messages and the effect on compliance to the coaching regime