Wachsmuth I. Multimodal interaction in virtual reality. In: Noldus LPJJ, ed. Proceedings 3rd International Conference on Methods and Techniques in Behavioral Research. Wageningen, The Netherlands: Noldus Information Technology;  2000: 343.This contribution reports work carried out in Bielefeld in the context of interacting with virtual reality environments

Noldus, L.P.J.J.

Wachsmuth, Ipke 

Publications at Bielefeld University

Abstract Nijmegen  Multimodal Interaction in Virtual Reality  Ipke Wachsmuth Faculty of Technology, University of Bielefeld  ipke@techfak.uni-bielefeld.de  August 2000, Uni Nijmegen  This contribution reports work carried out in Bielefeld in the context of  interacting with virtual reality environments. Three things are  important in our work toward incorporating gestures as a useful tool in  virtual reality:  - measuring gestures as articulated hand and body movements in the  context of speech  - interpreting them by way of classifying features and transducing them  to application commands via a symbolic notation inherited from sign  language  - timing gestures in the context of speech in order to establish  correspondence between accented behaviors in both speech and gesture  channels  The things we have learned from investigating these issues help us to  advance natural interaction with 3D stereographic scenes in a scenario of  virtual construction. In the first place we have dealt with pointing and  turning, etc. often classified as deictic and mimetic gestures. In the  DEIKON project, we have now started to investigate more sophisticated  forms of deictics in construction dialogues that include features  indicating shape or orientation, which leads us into iconic gesture.  Another issue in our work is the synthesis of lifelike gesture from  symbolic descriptions for an articulated virtual figure where natural  motion and timing are central aspects. 

Multimodal interaction in virtual reality

https://pub.uni-bielefeld.de/download/2678440/2680454

Multimodal interaction in virtual reality

Abstract

Similar works

Full text

Available Versions

Publications at Bielefeld University