Stage-directing the Virtual Reality Experience: Developing a Theoretical Framework for Immersive Literacy

Despite the incremental improvement and inclusion of immersive technologies in entertainment, training simulation, fine art, inclusive design, academia, and education; Virtual Reality (VR) still faces issues regarding its ability to compete with films and animation in visual storytelling without merging into the realm of video games. In 2015, Pixar’s Ed Catmull warned moviemakers that Virtual Reality is “not storytelling” and argued that the linear aspect of narratives poses an obstacle that cannot be overcome with VR. In contrast, Catmull argued that VR has immense application in games. However, VR creators have been pushing the boundaries and possibilities of delivering narratives in virtual spaces. In 2019, the VR experience “Gloomy Eyes” was presented at the Sundance festivals featuring a 30-minute story split between 3 episodes. The simulation is structured to provide its audience with some degrees of freedom while guiding them intuitively through the virtual space. In 2021, Blue Zoo also released a VR project titled “The Beast” featuring a cyclist powering up a snow-covered mountain. The short film was entirely created in Quill VR with the intention of being treated like a theatrical play rather than a film. While the creators of “The Beast” have explicitly mentioned the influence of theatre, “Gloomy Eyes” draws its visual language from similar theatrical roots. This paper argues that VR has been mistakenly compared to film and animation when it should be associated with theatre. The audience of both are not passive as they are during the screening of a film or animation. The space and the medium demands participation through their presence in the same space with the actors/characters. Theatre presents a promising candidate for extracting criteria that could be used to develop a visual language for VR. This research aims to formulate a framework for developing a VR visual language through comparison between character-driven narratives in VR such as “Gloomy Eyes” and “The Beast”. The comparative study establishes overlapping criteria and characteristics found in the structure, literacy, sound, and delivery format of narratives in a theatrical performance. These criteria are then outlined and discussed, drawing from affordance theory and discussions on aural and visual attention in theatre, to form a holistic view in approaching VR literacy

Game-based evacuation drill using augmented reality and head-mounted display

Purpose–Evacuation drills should be more realistic and interactive. Focusing on situational and audio-visual realities and scenario-based interactivity, we have developed a game-based evacuation drill (GBED) system that presents augmented reality (AR) materials on tablet computers. Our current research purpose is to improve visual reality (AR materials) in our GBED system. Design/methodology/approach–Our approach is to develop a new GBED system that superimposes digital objects (e.g. 3DCG elements) onto real-time vision using a marker-based AR library, a binocular opaque head-mounted display (HMD) and other current easily available technologies. Findings–Our findings from a trial experiment are that the new GBED system can improve visual reality and is appropriate for disaster education. However, a few problems remain for practical use. Research limitations/implications–When using the GBED system, participants (i.e. HMD wearers) can suffer from 3D sickness and have difficulty in moving. These are important safety problems in HMD-based systems. Social implications–The combination of AR and HMDs for GBEDs (i.e. integrating virtual and real worlds) will raise questions about its merits (pros and cons). Originality/value–The originality of our research is the combination of AR and an HMD to a GBED, which have previously been realized primarily as simulation games in virtual worlds. We believe that our research has the potential to expand disaster education

Developing serious games for cultural heritage: a state-of-the-art review

Although the widespread use of gaming for leisure purposes has been well documented, the use of games to support cultural heritage purposes, such as historical teaching and learning, or for enhancing museum visits, has been less well considered. The state-of-the-art in serious game technology is identical to that of the state-of-the-art in entertainment games technology. As a result, the field of serious heritage games concerns itself with recent advances in computer games, real-time computer graphics, virtual and augmented reality and artificial intelligence. On the other hand, the main strengths of serious gaming applications may be generalised as being in the areas of communication, visual expression of information, collaboration mechanisms, interactivity and entertainment. In this report, we will focus on the state-of-the-art with respect to the theories, methods and technologies used in serious heritage games. We provide an overview of existing literature of relevance to the domain, discuss the strengths and weaknesses of the described methods and point out unsolved problems and challenges. In addition, several case studies illustrating the application of methods and technologies used in cultural heritage are presented

Serious Games in Cultural Heritage

Although the widespread use of gaming for leisure purposes has been well documented, the use of games to support cultural heritage purposes, such as historical teaching and learning, or for enhancing museum visits, has been less well considered. The state-of-the-art in serious game technology is identical to that of the state-of-the-art in entertainment games technology. As a result the field of serious heritage games concerns itself with recent advances in computer games, real-time computer graphics, virtual and augmented reality and artificial intelligence. On the other hand, the main strengths of serious gaming applications may be generalised as being in the areas of communication, visual expression of information, collaboration mechanisms, interactivity and entertainment. In this report, we will focus on the state-of-the-art with respect to the theories, methods and technologies used in serious heritage games. We provide an overview of existing literature of relevance to the domain, discuss the strengths and weaknesses of the described methods and point out unsolved problems and challenges. In addition, several case studies illustrating the application of methods and technologies used in cultural heritage are presented

Trends in virtual reality technologies for the learning patient

NextMed convened the Medicine Meets Virtual Reality 22 (MMVR 22) conference in 2016. Since 1992, the conference has brought together a diverse group of researchers to share creative solutions for the evolving challenge of integrating virtual reality tools into medical education. Virtual reality (VR) and its enabling technologies utilize hardware and software to simulate environments and encounters where users can interact and learn. The MMVR 22 symposium proceedings contain projects that support a variety of learners: medical students, practitioners, soldiers, and patients. This report will contemplate the trends in virtual reality technologies for patients navigating their medical and healthcare learning. The learning patient seeks more than intervention; they seek prevention. From virtual humans and environments to motion sensors and haptic devices, patients are surrounded by increasingly rich and transformative data-driven tools. Applied data enables VR applications to simulate experience, predict health outcomes, and motivate new behavior. The MMVR 22 presents investigations into the usability of wearable devices, the efficacy of avatar inclusion, and the viability of multi-player gaming. With increasing need for individualized and scalable programming, only committed open source efforts will align instructional designers, technology integrators, trainers, and clinicians. Curriculum and InstructionCurriculum and Instructio