Modeling Embodied Feedback with Virtual Humans

Kopp S, Allwood J, Grammer K, Ahlsen E, Stocksmeier T. Modeling Embodied Feedback with Virtual Humans. In: Wachsmuth I, Knoblich G, eds. Modeling Communication With Robots And Virtual Humans. Second ZiF Research Group International Workshop on Embodied Communication in Humans and Machines, Bielefeld, Germany, April 5-8, 2006, Revised Selected Papers. Lecture Notes in Computer Science. Vol 4930. Berlin, Heidelberg: Springer; 2008: 18-37.In natural communication, both speakers and listeners are active most of the time. While a speaker contributes new information, a listener gives feedback by producing unobtrusive (usually short) vocal or non-vocal bodily expressions to indicate whether he/she is able and willing to communicate, perceive, and understand the information, and what emotions and attitudes are triggered by this information. The simulation of feedback behavior for artificial conversational agents poses big challenges such as the concurrent and integrated perception and production of multi-modal and multi-functional expressions. We present an approach on modeling feedback for and with virtual humans, based on an approach to study ``embodied feedback'' as a special case of a more general theoretical account of embodied communication. A realization of this approach with the virtual human Max is described and results are presented

Modeling Communication with Robots and Virtual Humans, Second ZiF Research Group International Workshop on Embodied Communication in Humans and Machines, Bielefeld, Germany, April 5-8, 2006, Revised Selected Papers

Wachsmuth I, Knoblich G, Zentrum für Interdisziplinäre Forschung, eds. Modeling Communication with Robots and Virtual Humans, Second ZiF Research Group International Workshop on Embodied Communication in Humans and Machines, Bielefeld, Germany, April 5-8, 2006, Revised Selected Papers. Lecture notes in computer science (LNAI). Vol 4930. Berlin : Springer; 2008.Two main types of embodied agents are playing an increasingly important role in cognitive interaction technology: virtual humans inhabiting simulated environments and humanoid robots inhabiting the real world. The need to develop an integrated perspective of embodiment in communication, establishing bridges between lower-level, sensorimotor functions and a range of higher-level, communicative functions involving language and bodily action has led to the exploration of how artificial agents can advance our understanding of key aspects of embodiment, cognition, and communication. The 17 articles in this state-of-the-art survey address artificial intelligence research on communicative agents and also provide an interdisciplinary perspective from linguistics, behavioral research, theoretical biology, philosophy, communication psychology, and computational neuroscience. The topics include studies on human multimodal communication; the modeling of feedback signals, facial expression, eye contact, and deception; the recognition and comprehension of hand gestures and head movements; communication interfaces for humanoid robots; the evolution of cognition and language; emotion and social appraisal in nonverbal communication; dialogue models and methodologies; theory of mind and intentionality; complex systems, dynamic field theory, and connectionist modeling