ABSTRACT A Survey of Design Issues in Spatial Input

We present a survey of design issues for developing effec-tive free-space three-dimensional (3D) user interfaces. Our survey is based upon previous work in 3D interaction, our experience in developing free-space interfaces, and our informal observations of test users. We illustrate our design issues using examples drawn from instances of 3D interfaces. For example, our first issue suggests that users have difficulty understanding three-dimensional space. We offer a set of strategies which may help users to better perceive a 3D virtual environment, including the use of spatial references, relative gesture, two-handed interaction, multisensory feedback, physical constraints, and head tracking. We describe interfaces which employ these strategies. Our major contribution is the synthesis of many scattered results, observations, and examples into a common framework. This framework should serve as a guide to researchers or systems builders who may not be familiar with design issues in spatial input. Where appropriate, we also try to identify areas in free-space 3D interaction which we see as likely candidates for additional research. An extended and annotated version of the references list for this paper is available on-line through mosaic at addres

I!!la HumanFactors inComputing Systems Passive Real-World Interface Props for

We claim that physical manipulation of familiar real-world objects in the user’s real environment is an important technique for the design of three-dimensional user interfaces. These real-world passive inte~ace props are manipulated by the user to specify spatial relationships between interface objects. By unobtrusively embedding free-space position and orientation trackers within the props, we enable the computer to passively observe a natural user dialog in the real world, rather than forcing the user to engage in a contrived dialog in the computer-generated world. We present neurosurgical planning as a driving application and demonstrate the utility of a head viewing prop, a cutting-plane selection prop, and a trajectory selection prop in this domain. Using passive props in this interface exploits the surgeon’s existing skills, provides direct action-task correspondence, eliminates explicit modes for separate tools, facilitates natural two-handed interaction, and provides tactile and kinesthetic feedback for the user. Our informal evaluation sessions have shown that with a cursory introduction, neurosurgeons who have never seenthe interface can understand and use it without training. KEYWORDS three-dimensional interaction, gesture input, two-hande