A User-Centered Approach on Combining Realism and Interactivity in Virtual Environments

International audienceIn this paper we describe a project that adopts a usercentered approach in the design of virtual environments (VEs) with enhanced realism and interactivity, guided by real-world applications in the areas of urban planning/ architecture and cultural heritage education. In what concerns realism, we introduce an image-based 3D capture process, where realistic models are created from photographs and subsequently displayed in a VR system using a high-quality, view-dependent algorithm. The VE is further enhanced using advanced vegetation and shadow display algorithms as well as 3D sound. A high degree of interactivity is added, allowing users to build and manipulate elements of the VEs according to their needs, as specified through a user task analysis and scenario-based approach which is currently being evaluated. This work is developed as part of the EU-funded research project CREATE

Image-based Techniques for the Creation and Display of Photorealistic Interactive Virtual Environments

International audienceIn this paper we introduce an image-based 3D capture process for the creation and display of photorealistic virtual environments (VEs). The resulting VEs aim to realistically recreate existing real-world scenes that can be displayed in a range of immersive VR systems using a high-quality, view-dependent algorithm and further enhanced using advanced vegetation, shadow display algorithms and 3D sound. The scenes, an archaeological site and an urban environment, were chosen according to real-world applications in the areas of urban planning/architecture and cultural heritage education. The users in each case are able to reconstruct or manipulate elements of the VEs according to their needs, as these have been specified through a detailed user requirements survey. Furthermore, a user task analysis and scenario-based approach has been adopted for the design of the virtual prototypes and the evaluation, which is currently underway. This work is being developed in the context of the EU-funded research project CREATE and the first examples of the prototype system in use are described and demonstrated in this paper

Exploring how to use virtual tours to create an interactive customer remote experience

This paper investigates the use of Virtual Reality (VR) to develop virtual tour applications for marketing purposes. The aim is to explore how virtual technologies can support the creation of knowledge about a specific food product and the achievement of user engagement by a multi-sensory virtual tour of the real production site. The study provides design guidelines to create a valuable, multisensory experience by VR tours and demonstrate how the adoption of a user-driven approach, instead of a technology-driven approach, allows to achieve a positive intention to buy. The case study was represented by one of the excellences among Italian food products, the Parmigiano Reggiano (PR) cheese. The PR virtual tour was validated by a user testing campaign, involving more than 70 users: users' reactions and feedback were collected by human physiological data monitoring and questionnaires' administration. The research results demonstrated how virtual technologies could effectively help people to create a solid knowledge about a food product to support the marketing process and to form an intention to buy thanks to a better understanding of the quality of the local and traditional productions

Updating the art history curriculum: incorporating virtual and augmented reality technologies to improve interactivity and engagement

Master's Project (M.Ed.) University of Alaska Fairbanks, 2017This project investigates how the art history curricula in higher education can borrow from and incorporate emerging technologies currently being used in art museums. Many art museums are using augmented reality and virtual reality technologies to transform their visitors' experiences into experiences that are interactive and engaging. Art museums have historically offered static visitor experiences, which have been mirrored in the study of art. This project explores the current state of the art history classroom in higher education, which is historically a teacher-centered learning environment and the learning effects of that environment. The project then looks at how art museums are creating visitor-centered learning environments; specifically looking at how they are using reality technologies (virtual and augmented) to transition into digitally interactive learning environments that support various learning theories. Lastly, the project examines the learning benefits of such tools to see what could (and should) be implemented into the art history curricula at the higher education level and provides a sample section of a curriculum demonstrating what that implementation could look like. Art and art history are a crucial part of our culture and being able to successfully engage with it and learn from it enables the spread of our culture through digital means and of digital culture

What is XR? Towards a Framework for Augmented and Virtual Reality

Augmented Reality (AR), Virtual Reality (VR), Mixed Reality, and Extended Reality (often – misleadingly – abbreviated as XR) are commonly used terms to describe how technologies generate or modify reality. However, academics and professionals have been inconsistent in their use of these terms. This has led to conceptual confusion and unclear demarcations. Inspired by prior research and qualitative insights from XR professionals, we discuss the meaning and definitions of various terms and organize them in our proposed framework. As a result, we conclude that (1) XR should not be used to connote extended reality, but as a more open approach where the X implies the unknown variable: xReality; (2) AR and VR have fundamental differences and thus should be treated as different experiences; (3) AR experiences can be described on a continuum ranging from assisted reality to mixed reality (based on the level of local presence); and (4), VR experiences can be conceptualized on a telepresence-continuum ranging from atomistic to holistic VR

Procedural digital twin generation for co-creating in VR focusing on vegetation

An early-stage development of a Digital Twin (DT) in Virtual Reality (VR) is presented, aiming for civic engagement in a new urban development located in an area that is a forest today. The area is presently used for recreation. For the developer, it is important both to communicate how the new development will affect the forest and allow for feedback from the citizen. High quality DT models are time-consuming to generate, especially for VR. Current model generation methods require the model developer to manually design the virtual environment. Furthermore, they are not scalable when multiple scenarios are required as a project progresses. This study aimed to create an automated, procedural workflow to generate DT models and visualize large-scale data in VR with a focus on existing green structures as a basis for participatory approaches. Two versions of the VR prototype were developed in close cooperation with the urban developer and evaluated in two user tests. A procedural workflow was developed for generating DT models and integrated into the VR application. For the green structures, efforts focused on the vegetation, such as realistic representation and placement of different types of trees and bushes. Only navigation functions were enabled in the first user test with practitioners (9 participants). Interactive functions were enabled in the second user test with pupils (age 15, 9 participants). In both tests, the researchers observed the participants and carried out short reflective interviews. The user test evaluation focussed on the perception of the vegetation, general perception of the VR environment, interaction, and navigation. The results show that the workflow is effective, and the users appreciate green structure representations in VR environments in both user tests. Based on the workflow, similar scenes can be created for any location in Sweden. Future development needs to concentrate on the refinement of buildings and information content. A challenge will be balancing the level of detail for communication with residents

Understanding the immersive experience: Examining the influence of visual immersiveness and interactivity on spatial experiences and understanding

Advances in computer graphics have enabled us to generate more compelling 3D virtual environments. 'Immersive experience' in these environments result from a combination of immersion and interactivity. As such, various disciplines have started adopting 3D technology for enhancing spatial understanding and experience. But the impact of the immersive experience on spatial understanding and experience remains unclear. This study utilized a controlled, between-subjects experiment to systematically manipulate a virtual reality system's technology affordances (stereoscopy, field of view, and navigability) and measure their impact. Participants, N=120, explored a virtual office and completed a questionnaire on the experience and tasks evaluating their understanding of the space. The results indicated that visual immersion had the greatest impact on understanding but, better experiences were gained when visual immersion was combined with greater interactivity. These findings support the notion the immersive experience is important for the comprehension of virtual spaces. This study overall served to provide insight into the role of the immersive experience on the comprehension of virtual spaces. The findings advance theories of spatial presence and immersion, support the use of methods which look at technology as affordances rather than entities, and support the use of 3D technology for communicating spatial information as in the case of architecture and fire-fighter training

Influence of Narrative Elements on User Behaviour in Photorealistic Social VR

Social Virtual Reality (VR) applications are becoming the next big revolution in the field of remote communication. Social VR provides the possibility for participants to explore and interact with a virtual environments and objects, feelings of a full sense of immersion, and being together. Understanding how user behaviour is influenced by the shared virtual space and its elements becomes the key to design and optimize novel immersive experiences that take into account the interaction between users and virtual objects. This paper presents a behavioural analysis of user navigation trajectories in a 6 degrees of freedom, social VR movie. We analysed 48 user trajectories from a photorealistic telepresence experiment, in which subjects experience watching a crime movie together in VR. We investigate how users are affected by salient agents (i.e., virtual characters) and by the narrative elements of the VR movie (i.e., dialogues versus interactive part). We complete our assessment by conducting a statistical analysis on the collected data. Results indicate that user behaviour is affected by different narrative and interactive elements. We present our observations, and we draw conclusions on future paths for social VR experiences

A User-Based Look at Visualization Tools for Environmental Data and Suggestions for Improvement - An Inventory among City Planners in Gothenburg

With a growing interest in environmental data and the need to consider various environmental factors earlier in the planning processes, it becomes more important to disseminate this type of information to different target groups in a comprehensible way. To support easier decision making, many cities and municipalities are increasingly using digital city models where it is possible to integrate different types of information based on simulation and visualization of future scenarios. Such tools have high potential, but the visual representation of data still needs to be developed. In this paper, we investigate how professionals within urban planning currently use visualization to communicate environmental data, and what their needs are regarding tools and visual representation. We discuss challenges for representing environmental data in urban development processes, with the aim of contributing to a better understanding of these issues. We base our investigation on a literature study, an inventorying survey and a focus group discussion with professionals within urban planning. This study provides an end-user perspective among urban planners and valuable insights on tool usage and visualization. Results show that applications used for environmental visualization still can be improved regarding, e.g., user friendliness and information handling, which may increase their efficiency