Updating the art history curriculum: incorporating virtual and augmented reality technologies to improve interactivity and engagement

Master's Project (M.Ed.) University of Alaska Fairbanks, 2017This project investigates how the art history curricula in higher education can borrow from and incorporate emerging technologies currently being used in art museums. Many art museums are using augmented reality and virtual reality technologies to transform their visitors' experiences into experiences that are interactive and engaging. Art museums have historically offered static visitor experiences, which have been mirrored in the study of art. This project explores the current state of the art history classroom in higher education, which is historically a teacher-centered learning environment and the learning effects of that environment. The project then looks at how art museums are creating visitor-centered learning environments; specifically looking at how they are using reality technologies (virtual and augmented) to transition into digitally interactive learning environments that support various learning theories. Lastly, the project examines the learning benefits of such tools to see what could (and should) be implemented into the art history curricula at the higher education level and provides a sample section of a curriculum demonstrating what that implementation could look like. Art and art history are a crucial part of our culture and being able to successfully engage with it and learn from it enables the spread of our culture through digital means and of digital culture

Communicating engineering heritage through immersive technology:A VR framework for enhancing users' interpretation process in virtual immersive environments

The recent advancement in immersive technologies opens up opportunities for the way individuals perceive and engage with information in public spaces to be innovated. This article discusses a study that investigates the application of Virtual Reality (VR) as an instrument for communicating engineering heritage in museum environments with the aim to enhance visitor experience. The study adopted Shannon’s communication theory as the main principle for contextualising heritage objects within virtual environments. This approach can benefit curators in informing the way the intended meaning, value, and context behind museum artefacts to be delivered through visual narratives and aesthetics. In this study, three VR scenarios have been developed using the Unreal engine to investigate the aspects of learning, interaction, and immersion during the virtual experience. One-way ANOVA approach was used to determine the significant differences between the proposed factors in the study. The study found that the absence of interaction in the immersive scenario reduced the mean score leading to a lack of constructive guidance during navigation. Whereas using Gamified and narrated approaches significantly increased the mean value of the participants compared to the control group. While many researchers argue that the utilisation of VR could improve the users’ level of presence, the study outcomes suggest that there are certain conditions that should be structured during the development process to facilitate better engagement with virtual content. To achieve these conditions, gamification and storytelling strategies have been found to be effective in delivering an interactive immersive experience for engaging with heritage artefacts and contents

The power of immersive technologies: a sociopsychological analysis of the relationship between immersive environments, storytelling, sentiment, and the impact on user experience

This dissertation initially focused on exploring the potential of immersive technologies for the distant future. However, the emergence of the COVID-19 virus in late 2019 disrupted the world, causing a pause in many areas. Nevertheless, the butterfly effect of the pandemic spurred the development of immersive technologies, resulting in the rise of the metaverse, web3, non-fungible tokens (NFT), and avatars, which are gaining increasing popularity. The excitement for the metaverse is growing in both academia and industry, leading to new avenues of research, digital marketing, video games, tourism, and social media. This dissertation explores this rapidly emerging technological revolution and its effects on user experience (UX)

A Spectrum of Audience Interactivity for entertainment domains

The concept of audience interactivity has been rediscovered across many domains of storytelling and entertainment—e.g. digital games, in-person role-playing, film, theater performance, music, and theme parks—that enrich the form with new idioms, language, and practices. In this paper, we introduce a Spectrum of Audience Interactivity that establishes a common vocabulary for the design space across entertainment domains. Our spectrum expands on an early vocabulary conceptualized through co-design sessions for interactive musical performances. We conduct a cross-disciplinary literature review to evaluate and iterate upon this vocabulary, using our findings to develop our validated spectrum

Exploitation of multiplayer interaction and development of virtual puppetry storytelling using gesture control and stereoscopic devices

With the rapid development of human-computer interaction technologies, the new media generation demands novel learning experiences with natural interaction and immersive experience. Considering that digital storytelling is a powerful pedagogical tool for young children, in this paper, we design an immersive storytelling environment that allows multiple players to use naturally interactive hand gestures to manipulate virtual puppetry for assisting narration. A set of multimodal interaction techniques is presented for a hybrid user interface that integrates existing 3D visualization and interaction devices including head-mounted displays and depth motion sensor. In this system, the young players could intuitively use hand gestures to manipulate virtual puppets to perform a story and interact with props in a virtual stereoscopic environment. We have conducted a user experiment with four young children for pedagogical evaluation, as well as system acceptability and interactivity evaluation by postgraduate students. The results show that our framework has great potential to stimulate learning abilities of young children through collaboration tasks. The stereoscopic head-mounted display outperformed the traditional monoscopic display in a comparison between the two

Narrative Transportation and Virtual Reality: Exploring the Immersive Qualities of Social Justice in the Digital World

This dissertation explores the potential applications for virtual reality (VR) stories in support of social justice causes, examining whether digital games historically been successfully leveraged for social justice purposes, and determining which components of VR technology can most encourage narrative transportation of participants in VR stories. The first chapter examines theories of simulation, virtual reality, narrative, and interactivity, as well as concepts of immersion from various disciplines and settles on narrative transportation, a theory from cognitive psychology, as the most useful in measuring the effect of VR stories on participants. The second chapter examines ethnographic practices, activist games, and modes of reclaiming digital spaces as a way to encourage digital social justice and ensure traditionally marginalized communities have meaningful access to technology—or, the tools to use it, create with it, and critique it. The third chapter presents the result of a play study conducted to measure participants\u27 transportation in a recent VR narrative and finds VR interactive narratives to be more transportive and engaging than their two-dimensional counterparts. The fourth chapter interrogates some of the fears of VR technology, namely that it will be used to further current societal injustices and as a potentially powerful propaganda tool. The final chapter presents five recommendations for designers seeking to experiment in virtual reality narratives. The ultimate aim of this work is to encourage scholars, designers, and participants to make ethical decisions in the creation and use of virtual societies

Exploring how to use virtual tours to create an interactive customer remote experience

This paper investigates the use of Virtual Reality (VR) to develop virtual tour applications for marketing purposes. The aim is to explore how virtual technologies can support the creation of knowledge about a specific food product and the achievement of user engagement by a multi-sensory virtual tour of the real production site. The study provides design guidelines to create a valuable, multisensory experience by VR tours and demonstrate how the adoption of a user-driven approach, instead of a technology-driven approach, allows to achieve a positive intention to buy. The case study was represented by one of the excellences among Italian food products, the Parmigiano Reggiano (PR) cheese. The PR virtual tour was validated by a user testing campaign, involving more than 70 users: users' reactions and feedback were collected by human physiological data monitoring and questionnaires' administration. The research results demonstrated how virtual technologies could effectively help people to create a solid knowledge about a food product to support the marketing process and to form an intention to buy thanks to a better understanding of the quality of the local and traditional productions

Immersive Journalism as Storytelling

"This book sets out cutting-edge new research and examines future prospects on 360-degree video, virtual reality (VR), and augmented reality (AR) in journalism, analyzing and discussing virtual world experiments from a range of perspectives. Featuring contributions from a diverse range of scholars, Immersive Journalism as Storytelling highlights both the opportunities and the challenges presented by this form of storytelling. The book discusses how immersive journalism has the potential to reach new audiences, change the way stories are told, and provide more interactivity within the news industry. Aside from generating deeper emotional reactions and global perspectives, the book demonstrates how it can also diversify and upskill the news industry. Further contributions address the challenges, examining how immersive storytelling calls for reassessing issues of journalism ethics and truthfulness, transparency, privacy, manipulation, and surveillance, and questioning what it means to cover reality when a story is told in virtual reality. Chapters are grounded in empirical data such as content analyses and expert interviews, alongside insightful case studies that discuss Euronews, Nonny de la Peña’s Project Syria, and The New York Times’ NYTVR application. This book is written for journalism teachers, educators, and students, as well as scholars, politicians, lawmakers, and citizens with an interest in emerging technologies for media practice.

Narrative Transportation and Virtual Reality: Exploring the Immersive Qualities of Social Justice in the Digital World

This dissertation explores the potential applications for virtual reality (VR) stories in support of social justice causes, examining whether digital games historically been successfully leveraged for social justice purposes, and determining which components of VR technology can most encourage narrative transportation of participants in VR stories. The first chapter examines theories of simulation, virtual reality, narrative, and interactivity, as well as concepts of immersion from various disciplines and settles on narrative transportation, a theory from cognitive psychology, as the most useful in measuring the effect of VR stories on participants. The second chapter examines ethnographic practices, activist games, and modes of reclaiming digital spaces as a way to encourage digital social justice and ensure traditionally marginalized communities have meaningful access to technology—or, the tools to use it, create with it, and critique it. The third chapter presents the result of a play study conducted to measure participants\u27 transportation in a recent VR narrative and finds VR interactive narratives to be more transportive and engaging than their two-dimensional counterparts. The fourth chapter interrogates some of the fears of VR technology, namely that it will be used to further current societal injustices and as a potentially powerful propaganda tool. The final chapter presents five recommendations for designers seeking to experiment in virtual reality narratives. The ultimate aim of this work is to encourage scholars, designers, and participants to make ethical decisions in the creation and use of virtual societies