The Wizard of Oz meets multimodal GUI interfaces: new challenges

Abstract

As part of our work in the Interactive Multimodal Information Management (IM2) project [6], we developed a multimodal dialogue-driven interface for browsing and searching recorded and annotated meeting data in a multimedia database. The challenge lay in creating an interface that was easy to use and which smoothly blended direct manipulation and natural language interaction (both voice and keyboard based)