QuickSet: A Multimodal Interface for Distributed Interactive Simulation

Abstract

Introduction We demonstrate QuickSet, a wireless, handheld, collaborative, system that can be used to control distributed interactive simulations based on the ModSAF simulator [3] and a 3-D terrain visualization system called CommandVu. Together with the CommandTalk spoken interaction component from SRI International [4] these form the LeatherNet system [1]. With QuickSet, users can formulate a military scenario by creating, positioning, and editing units, supplying them with behavior, specifying fortifications, objectives and other points, etc. In contrast to the original ModSAF GUI, users of QuickSet can employ multiple input modalities, including speech, gesture, and direct manipulation, to suit the task and situation at hand. QuickSet operates on a 3-lb. handheld 100MHz 486 PC (Fujitsu Stylistic 1000), as well as desktop PC's, employing wireless LAN communications, color screen, microphone, pen stylus, onboard speech recognition, gesture recognition, natural language processing,