Design and Evaluation of Menu Systems for Immersive Virtual Environments

Interfaces for system control tasks in virtual environments (VEs) have not been extensively studied. This paper focuses on various types of menu systems to be used in such environments. We describe the design of the TULIP menu, a menu system using Pinch Gloves™, and compare it to two common alternatives: floating menus and pen and tablet menus. These three menus were compared in an empirical evaluation. The pen and tablet menu was found to be significantly faster, while users had a preference for TULIP. Subjective discomfort levels were also higher with the floating menus and pen and tablet

Usability Evaluation in Virtual Environments: Classification and Comparison of Methods

Virtual environments (VEs) are a relatively new type of human-computer interface in which users perceive and act in a three-dimensional world. The designers of such systems cannot rely solely on design guidelines for traditional two-dimensional interfaces, so usability evaluation is crucial for VEs. We present an overview of VE usability evaluation. First, we discuss some of the issues that differentiate VE usability evaluation from evaluation of traditional user interfaces such as GUIs. We also present a review of VE evaluation methods currently in use, and discuss a simple classification space for VE usability evaluation methods. This classification space provides a structured means for comparing evaluation methods according to three key characteristics: involvement of representative users, context of evaluation, and types of results produced. To illustrate these concepts, we compare two existing evaluation approaches: testbed evaluation [Bowman, Johnson, & Hodges, 1999], and sequential evaluation [Gabbard, Hix, & Swan, 1999]. We conclude by presenting novel ways to effectively link these two approaches to VE usability evaluation

Exploring the Front Touch Interface for Virtual Reality Headsets

In this paper, we propose a new interface for virtual reality headset: a touchpad in front of the headset. To demonstrate the feasibility of the front touch interface, we built a prototype device, explored VR UI design space expansion, and performed various user studies. We started with preliminary tests to see how intuitively and accurately people can interact with the front touchpad. Then, we further experimented various user interfaces such as a binary selection, a typical menu layout, and a keyboard. Two-Finger and Drag-n-Tap were also explored to find the appropriate selection technique. As a low-cost, light-weight, and in low power budget technology, a touch sensor can make an ideal interface for mobile headset. Also, front touch area can be large enough to allow wide range of interaction types such as multi-finger interactions. With this novel front touch interface, we paved a way to new virtual reality interaction methods

Automated design analysis, assembly planning and motion study analysis using immersive virtual reality

Previous research work at Heriot-Watt University using immersive virtual reality (VR) for cable harness design showed that VR provided substantial productivity gains over traditional computer-aided design (CAD) systems. This follow-on work was aimed at understanding the degree to which aspects of this technology were contributed to these benefits and to determine if engineering design and planning processes could be analysed in detail by nonintrusively monitoring and logging engineering tasks. This involved using a CAD-equivalent VR system for cable harness routing design, harness assembly and installation planning that can be functionally evaluated using a set of creative design-tasks to measure the system and users' performance. A novel design task categorisation scheme was created and formalised which broke down the cable harness design process and associated activities. The system was also used to demonstrate the automatic generation of usable bulkhead connector, cable harness assembly and cable harness installation plans from non-intrusive user logging. Finally, the data generated from the user-logging allowed the automated activity categorisation of the user actions, automated generation of process flow diagrams and chronocyclegraphs

The Virtual Hawaiian Lo‘i: Applying Second Life to Cultural and Environmental Education

Ample evidence suggests that both experiential and theoretical learning is necessary for subject mastery and retention. However with traditional Hawaiian kalo (taro) farming instructional techniques there is often sufficient field time but a lack of formal environmental education that accompanies the place-based learning. The Virtual Lo‘i instructional design module is focused on providing an alternate learning space for the practice of kalo variety recall within a simulated three-dimensional lo‘i (wetland taro patch) environment. The modules’ educational setting is a hybrid of culturally based and immersive designed elements within Second Life to encourage user reference engagement and environmental literacy. Image driven immersive-based design and plant family grouping techniques were used as the design foundation for the instructional design module. The data was collected using pre- and post- recall testing and attitudinal surveys over a two-month period, consisting of fourteen participants across five age groups and three Hawaiian Islands. Preliminary testing results suggest that virtual environments could provide a space for environmental education and traditional knowledge transference

A Structured Approach for Designing Collaboration Experiences for Virtual Worlds

While 3D virtual worlds are more frequently being used as interactive environments for collaboration, there is still no structured approach developed specifically for the combined design of 3D virtual environments and the collaborative activities in them. We argue that formalizing both the structural elements of virtual worlds and aspects of collaborative work or collaborative learning helps to develop fruitful collaborative work and learning experiences. As such, we present the avatar-based collaboration framework (ABC framework). Based on semiotics theory, the framework puts the collaborating groups into the center of the design and emphasizes the use of distinct features of 3D virtual worlds for use in collaborative learning environments and activities. In developing the framework, we have drawn from best practices in instructional design and game design, research in HCI, and findings and observations from our own empirical research that investigates collaboration patterns in virtual worlds. Along with the framework, we present a case study of its first application for a global collaborative learning project. This paper particularly addresses virtual world designers, educators, meeting facilitators, and other practitioners by thoroughly describing the process of creating rich collaboration and collaborative learning experiences for virtual worlds with the ABC framework

Affordable immersive projection system for 3d interaction

This paper describes an affordable Virtual Reality system designed and developed by a group of researchers at the Polytechnic University of Catalunya (UPC). The system allows direct selection and manipulation of virtual 3D objects. The interaction is based on stereoscopic images projected over the user’s working space and on devices tracking the user’s natural movements. The system includes a screen being adjustable both in orientation and height, sensors tracking the head and hand movements, and a tactile device for the forefinger providing touch sense. A prototype of the system is currently exhibited at the Virtual Reality Center of Barcelona and it is being used in different application fields like architecture, medicine and industrial design.Peer ReviewedPostprint (published version

IMMERSIVE, INTEROPERABLE AND INTUITIVE MIXED REALITY FOR SERVICE IN INDUSTRIAL PLANTS

The authors propose an innovative Mixed Reality solution representing an immersive intuitive and interoperable environment to support service in industrial plants. These methodologies are related to concepts of Industry 4.0. Solutions based on a mix of VR and AR (Virtual and Augmented Reality ) with special attention to the maintenance of industrial machines; indeed the authors propose an overview of this approach and other synergistic techniques. Moreover, alternative instruments are presented and their specific advantages and disadvantages are described. Particularly, the approach is based on the SPIDER, an advanced interoperable interactive CAVE developed by the authors which supports cooperative work of several users involved in training, troubleshooting and supervision are proposed. Last but not least, an overview of projects using same techniques in other fields, such as construction, risk assessment, Virtual Prototyping and Simulation Based Design is presented

Combining Geometric Constraints With Physics Modeling for Virtual Assembly Using SHARP

This research combines physics-based and constraint-based approaches for virtual assembly simulations where geometric constraints are created or deleted within the virtual environment at runtime. In addition, this research provides a solution to low clearance assembly by utilizing B-Rep data representation of complex CAD models for accurate collision/physics results. These techniques are demonstrated in the SHARP software (System for Haptic Assembly and Realistic Prototyping). Combining physics-based and constraint-based techniques and operating on accurate B-rep data, SHARP can now assemble parts with 0.001% clearance and can accurately detect collision responses with 0.0001mm accuracy. Case studies are presented which can be used to identify the suitable combination of methods capable of best simulating intricate interactions and environment behavior during manual assembly