Entertainment, education and training are changing because of multi-party interaction technology. In the past we have seen the introduction of embodied agents and robots that take the role of a museum guide, a news presenter, a teacher, a receptionist, or someone who is trying to sell you insurances, houses or tickets. In all these cases the embodied agent needs to explain and describe. In this paper we contribute the design of a 3D virtual presenter that uses different output channels to present and explain. Speech and animation (posture, pointing and involuntary movements) are among these channels. The behavior is scripted and synchronized with the display of a 2D presentation with associated text and regions that can be pointed at (sheets, drawings, and paintings). In this paper the emphasis is on the interaction between 3D presenter and the 2D presentation

D. Tolani

E. André

F.C. Donders

J. Gratch

K. Perlin

T. Noma

Y. Rui

English

Crossref

Presenting in Virtual Worlds: Towards an Architecture for a 3D Presenter Explaining 2D-Presented Information

van Welbergen H, Nijholt A, Reidsma D, Zwiers J. Presenting in Virtual Worlds: An Architecture for a 3D Anthropomorphic Presenter. IEEE Intelligent Systems. 2006;21(5):47-53.Meeting and lecture room technology is a burgeoning field. Such technology can provide real-time support for physically present participants, for online remote participation, or for offline access to meetings or lectures. Capturing relevant information from meetings or lectures is necessary to provide this kind of support. Multimedia presentation of this captured information requires a lot of attention. In this article, we focus on models and associated algorithms that steer the virtual presenter's presentation animations. In our approach, we generate the presentations from a script describing the synchronization of speech, gestures, and movements. The script has also a channel devoted to presentation sheets (slides) and sheet changes, which we assume are an essential part of the presentation. To present and explain information, this 3D humanoid presenter uses output channels such as speech and animation of posture, painting, and involuntary movement

van Welbergen, Herwin

Nijholt, Anton

Reidsma, Dennis

Zwiers, Job

Publications at Bielefeld University

Presenting in Virtual Worlds: An Architecture for a 3D Anthropomorphic Presenter

van Welbergen, H.

Nijholt, Antinus

Zwiers, Jakob

University of Twente Research Information

Presenting in Virtual Worlds: Towards an Architecture for a 3D Presenter explaining 2D-Presented Information

Meeting and lecture room technology is a burgeoning field. Such technology can provide real-time support for physically present participants, for online remote participation, or for offline access to meetings or lectures. Capturing relevant information from meetings or lectures is necessary to provide this kind of support.Multimedia presentation of this captured information requires a lot of attention. Our previous research has looked at including in these multimedia presentations a regeneration of meeting events and interactions in virtual reality. We developed technology that translates captured meeting activities into a virtual-reality version that lets us add and manipulate information.1 In that research, our starting point was the human presenter or meeting participant. Here, it’s a semiautonomous virtual presenter that performs in a virtual- reality environment (see figure 1). The presenter’s audience might consist of humans, humans represented by embodied virtual agents, and autonomous agents that are visiting the virtual lecture room or have roles in it. In this article, we focus on models and associated algorithms that steer the virtual presenter’s presentation animations. In our approach, we generate the presentations from a script describing the synchronization of speech, gestures, and movements. The script has also a channel devoted to presentation sheets (slides) and sheet changes, which we assume are an essential part of the presentation. This channel can also present material other than sheets, such as annotated paintings or movies

An Agenda for Gesture Studies. The Semiotic Review of

An integrated multimedia approach to cultural heritage e-documents. In:

Annotating and Generating Posture from Discourse Structure in Embodied Conversational Agents. In:

BEAT: the Behavior Expression Animation Toolkit. In:

Beitr¨ age zur Lehre von den Bewegungen des menschlichen Auges.

Creating Interactive Virtual Humans: Some Assembly Required.

Design of a virtual human presenter.

Extending Fitts’ law to two-dimensional tasks. In: Proc. of the SIGCHI conf. on human factors in computing systems.

Introducing an Embodied Virtual Presenter Agent in a Virtual Meeting Room. In:

Lecture and presentation tracking in an intelligent meeting room. In:

MPML: a markup language for controlling the behavior of life-like characters.

R i s t ,T . ,M ¨ uller, J.: Webpersona: A life-like presentation agent for the world-wide web.

Real time responsive animation with personality.

Real-time inverse kinematics techniques for anthropomorphic limbs. Graph. Models Image Process.

the CHIL Project Consortium.: CHIL - computers in the human interaction loop. In: 5th Intern. Workshop on Image Analysis for Multimedia Interactive Services,

The eﬀects of speed variation on joint kinematics during multi-segment reaching movements.

Towards real-time body pose estimation for presenters in meeting environments. In:

Videography for telepresentations.

https://research.utwente.nl/en/publications/3f96ff7c-214e-4237-bc06-39848e3e4cf2

Presenting in Virtual Worlds: Towards an Architecture for a 3D Presenter explaining 2D-Presented Information

Abstract

Similar works

Full text

Available Versions

Crossref

Publications at Bielefeld University

University of Twente Research Information

University of Twente Research Information