Understanding How Well You Understood – Context-sensitive Interpretation of Multimodal User Feedback

Buschmeier H, Kopp S. Understanding How Well You Understood – Context-sensitive Interpretation of Multimodal User Feedback. In: Proceedings of the 12th International Conference on Intelligent Virtual Agents. Santa Cruz, CA; 2012: 517-519

A first approach to understanding and measuring naturalness in driver-car interaction

With technology changing the nature of the driving task, qualitative methods can help designers understand and measure driver-car interaction naturalness. Fifteen drivers were interviewed at length in their own parked cars using ethnographically-inspired questions probing issues of interaction salience, expectation, feelings, desires and meanings. Thematic analysis and content analysis found five distinct components relating to 'rich physical' aspects of natural feeling interaction typified by richer physical, analogue, tactile styles of interaction and control. Further components relate to humanlike, intelligent, assistive, socially-aware 'perceived behaviours' of the car. The advantages and challenges of a naturalness-based approach are discussed and ten cognitive component constructs of driver-car naturalness are proposed. These may eventually be applied as a checklist in automotive interaction design.This research was fully funded by a research grant from Jaguar Land Rover, and partially funded by project n.220050/F11 granted by Research Council of Norway

Continuous Interaction with a Virtual Human

Attentive Speaking and Active Listening require that a Virtual Human be capable of simultaneous perception/interpretation and production of communicative behavior. A Virtual Human should be able to signal its attitude and attention while it is listening to its interaction partner, and be able to attend to its interaction partner while it is speaking – and modify its communicative behavior on-the-fly based on what it perceives from its partner. This report presents the results of a four week summer project that was part of eNTERFACE’10. The project resulted in progress on several aspects of continuous interaction such as scheduling and interrupting multimodal behavior, automatic classification of listener responses, generation of response eliciting behavior, and models for appropriate reactions to listener responses. A pilot user study was conducted with ten participants. In addition, the project yielded a number of deliverables that are released for public access

Mobile Agents for Mobile Tourists: A User Evaluation of Gulliver's Genie

How mobile computing applications and services may be best designed, implemented and deployed remains the subject of much research. One alternative approach to developing software for mobile users that is receiving increasing attention from the research community is that of one based on intelligent agents. Recent advances in mobile computing technology have made such an approach feasible. We present an overview of the design and implementation of an archetypical mobile computing application, namely that of an electronic tourist guide. This guide is unique in that it comprises a suite of intelligent agents that conform to the strong intentional stance. However, the focus of this paper is primarily concerned with the results of detailed user evaluations conducted on this system. Within the literature, comprehensive evaluations of mobile context-sensitive systems are sparse and therefore, this paper seeks, in part, to address this deficiency

The Making of Online Identity. The use of creative method to support young people in their reflection on age\ud and gender

In the .GTO.project our ambition is to study how young people (10 to 14 years old) in Estonia and Sweden construct and normalise gender and age, as markers of identity and identity development, in their online interactions. After\ud conducting interview studies on how young people experience on- and offline interactions, and their intertwining, as well as online ethnographic studies of online presentations, we went on with the third phase of the project: creative\ud workshops with young people. In these workshops, young people in groups of four were to create fictitious online characters. In the analysis of these, we focus on how power differentials and identity markers such as age and gender are constructed and negotiated.\u

Toward an affect-sensitive multimodal human-computer interaction

The ability to recognize affective states of a person... This paper argues that next-generation human-computer interaction (HCI) designs need to include the essence of emotional intelligence -- the ability to recognize a user's affective states -- in order to become more human-like, more effective, and more efficient. Affective arousal modulates all nonverbal communicative cues (facial expressions, body movements, and vocal and physiological reactions). In a face-to-face interaction, humans detect and interpret those interactive signals of their communicator with little or no effort. Yet design and development of an automated system that accomplishes these tasks is rather difficult. This paper surveys the past work in solving these problems by a computer and provides a set of recommendations for developing the first part of an intelligent multimodal HCI -- an automatic personalized analyzer of a user's nonverbal affective feedback