Improving Depth Perception in Immersive Media Devices by Addressing Vergence-Accommodation Conflict

: Recently, immersive media devices have seen a boost in popularity. However, many problems still remain. Depth perception is a crucial part of how humans behave and interact with their environment. Convergence and accommodation are two physiological mechanisms that provide important depth cues. However, when humans are immersed in virtual environments, they experience a mismatch between these cues. This mismatch causes users to feel discomfort while also hindering their ability to fully perceive object distances. To address the conflict, we have developed a technique that encompasses inverse blurring into immersive media devices. For the inverse blurring, we utilize the classical Wiener deconvolution approach by proposing a novel technique that is applied without the need for an eye-tracker and implemented in a commercial immersive media device. The technique's ability to compensate for the vergence-accommodation conflict was verified through two user studies aimed at reaching and spatial awareness, respectively. The two studies yielded a statistically significant 36% and 48% error reduction in user performance to estimate distances, respectively. Overall, the work done demonstrates how visual stimuli can be modified to allow users to achieve a more natural perception and interaction with the virtual environment

A Content-Analysis Approach for Exploring Usability Problems in a Collaborative Virtual Environment

As Virtual Reality (VR) products are becoming more widely available in the consumer market, improving the usability of these devices and environments is crucial. In this paper, we are going to introduce a framework for the usability evaluation of collaborative 3D virtual environments based on a large-scale usability study of a mixedmodality collaborative VR system. We first review previous literature about important usability issues related to collaborative 3D virtual environments, supplemented with our research in which we conducted 122 interviews after participants solved a collaborative virtual reality task. Then, building on the literature review and our results, we extend previous usability frameworks. We identified twelve different usability problems, and based on the causes of the problems, we grouped them into three main categories: VR environment-, device interaction-, and task-specific problems. The framework can be used to guide the usability evaluation of collaborative VR environments

Identifying immersive environments’ most relevant research topics: an instrument to query researchers and practitioners

This paper provides an instrument for ascertaining researchers’ perspectives on the relative relevance of technological challenges facing immersive environments in view of their adoption in learning contexts, along three dimensions: access, content production, and deployment. It described its theoretical grounding and expert-review process, from a set of previously-identified challenges and expert feedback cycles. The paper details the motivation, setup, and methods employed, as well as the issues detected in the cycles and how they were addressed while developing the instrument. As a research instrument, it aims to be employed across diverse communities of research and practice, helping direct research efforts and hence contribute to wider use of immersive environments in learning, and possibly contribute towards the development of news and more adequate systems.The work presented herein has been partially funded under the European H2020 program H2020-ICT-2015, BEACONING project, grant agreement nr. 687676.info:eu-repo/semantics/publishedVersio

Flexible virtual environments: Gamifying immersive learning

© Springer International Publishing AG 2017. The availability of Virtual Reality (VR) and Virtual Environment (VE) equipment - with the launch of domestic technologies such as the Oculus Rift, Microsoft Hololens and Sony Playstation VR) - offer new ways to enable interactive immersive experiences [16]. The opportunities these create in learning and training applications are immense: but create new challenges . Meanwhile, current virtual learning environments are typically web or app based technologies, sometimes perceived as having little value added from a user perspective beyond improved User Interfaces to access some content [6]. The challenge is how the human computer interaction features of such VE platforms may be used in education in a way that adds value, especially for computer mediated instruction. This paper will outline some of the issues, and opportunities, as well as some of the open questions about how such technologies can be used effectively in a higher education context, along with a proposed framework for embedding a learning engine within a virtual reality or environment system. Three-dimensional technologies: from work-walls, through CAVES to the latest headsets offer new ways to immerse users in computer generated environments. Immersive learning [1] is increasingly common in training applications, and is beginning to make inroads into formal education. The recent rise in such off-the-shelf technologies means that Augmented Learning becomes a realistic mainstream tool [13]. Much of this use is built in game environments using game engines, where these serious games provide learning effects as an intended consequence of playing

An Introduction to 3D User Interface Design

3D user interface design is a critical component of any virtual environment (VE) application. In this paper, we present a broad overview of three-dimensional (3D) interaction and user interfaces. We discuss the effect of common VE hardware devices on user interaction, as well as interaction techniques for generic 3D tasks and the use of traditional two-dimensional interaction styles in 3D environments. We divide most user interaction tasks into three categories: navigation, selection/manipulation, and system control. Throughout the paper, our focus is on presenting not only the available techniques, but also practical guidelines for 3D interaction design and widely held myths. Finally, we briefly discuss two approaches to 3D interaction design, and some example applications with complex 3D interaction requirements. We also present an annotated online bibliography as a reference companion to this article

Virtual assembly rapid prototyping of near net shapes

Virtual reality (VR) provides another dimension to many engineering applications. Its immersive and interactive nature allows an intuitive approach to study both cognitive activities and performance evaluation. Market competitiveness means having products meet form, fit and function quickly. Rapid Prototyping and Manufacturing (RP&M) technologies are increasingly being applied to produce functional prototypes and the direct manufacturing of small components. Despite its flexibility, these systems have common drawbacks such as slow build rates, a limited number of build axes (typically one) and the need for post processing. This paper presents a Virtual Assembly Rapid Prototyping (VARP) project which involves evaluating cognitive activities in assembly tasks based on the adoption of immersive virtual reality along with a novel non-layered rapid prototyping for near net shape (NNS) manufacturing of components. It is envisaged that this integrated project will facilitate a better understanding of design for manufacture and assembly by utilising equivalent scale digital and physical prototyping in one rapid prototyping system. The state of the art of the VARP project is also presented in this paper

Multiple viewers in projection-based multi-screen immersive environments

Projection-based immersive virtual environments are very powerful tools to work on engineering and scientific problems involving teams of researchers. These environments enable the development of virtual representations of a problem domain in which multiple users can simultaneously share a virtual experience, providing a unique infrastructure for team work. The current limitation for effective teamwork is that these systems support only a single viewpoint, usually corresponding to a user wearing a head tracking device. This thesis presents a hardware and software design to enable multiple simultaneous viewpoints in a multi-screen immersive environment. This system is designed to be flexible and easily scalable, preparing for future expansion to additional users when the underlying technologies allow it. The design extends the commonly used single user time-multiplexed stereo viewing model to multiple users. This research also extends existing development tools to support our multiple viewer virtual design. This work also focuses on extending existing applications to multiple viewer environments. A design and implementation of the system is presented in detail. This system enables two users viewing stereoscopic images or four users viewing monoscopic images to simultaneously view the correct images projected on the screen from their tracked viewpoint

The virtual playground: an educational virtual reality environment for evaluating interactivity and conceptual learning

The research presented in this paper aims at investigating user interaction in immersive virtual learning environments (VLEs), focusing on the role and the effect of interactivity on conceptual learning. The goal has been to examine if the learning of young users improves through interacting in (i.e. exploring, reacting to, and acting upon) an immersive virtual environment (VE) compared to non interactive or non-immersive environments. Empirical work was carried out with more than 55 primary school students between the ages of 8 and 12, in different between-group experiments: an exploratory study, a pilot study, and a large-scale experiment. The latter was conducted in a virtual environment designed to simulate a playground. In this ‘Virtual Playground’, each participant was asked to complete a set of tasks designed to address arithmetical ‘fractions’ problems. Three different conditions, two experimental virtual reality (VR) conditions and a non-VR condition, that varied the levels of activity and interactivity, were designed to evaluate how children accomplish the various tasks. Pre-tests, post-tests, interviews, video, audio, and log files were collected for each participant, and analyzed both quantitatively and qualitatively. This paper presents a selection of case studies extracted from the qualitative analysis, which illustrate the variety of approaches taken by children in the VEs in response to visual cues and system feedback. Results suggest that the fully interactive VE aided children in problem solving but did not provide as strong evidence of conceptual change as expected; rather, it was the passive VR environment, where activity was guided by a virtual robot, that seemed to support student reflection and recall, leading to indications of conceptual change

Collaborative virtual gaming worlds in higher education

There is growing interest in the use of virtual gaming worlds in education, supported by the increased use of multi‐user virtual environments (MUVEs) and massively multi‐player online role‐playing games (MMORPGs) for collaborative learning. However, this paper argues that collaborative gaming worlds have been in use much longer and are much wider in scope; it considers the range of collaborative gaming worlds that exist and discusses their potential for learning, with particular reference to higher education. The paper discusses virtual gaming worlds from a theoretical pedagogic perspective, exploring the educational benefits of gaming environments. Then practical considerations associated with the use of virtual gaming worlds in formal settings in higher education are considered. Finally, the paper considers development options that are open to educators, and discusses the potential of Alternate Reality Games (ARGs) for learning in higher education. In all, this paper hopes to provide a balanced overview of the range of virtual gaming worlds that exist, to examine some of the practical considerations associated with their use, and to consider their benefits and challenges in learning and teaching in the higher education context