An XRI Mixed-Reality Internet-of-Things Architectural Framework Toward Immersive and Adaptive Smart Environments

The internet-of-things (IoT) refers to the growing number of embedded interconnected devices within everyday ubiquitous objects and environments, especially their networks, edge controllers, data gathering and management, sharing, and contextual analysis capabilities. However, the IoT suffers from inherent limitations in terms of human-computer interaction. In this landscape, there is a need for interfaces that have the potential to translate the IoT more solidly into the foreground of everyday smart environments, where its users are multimodal, multifaceted, and where new forms of presentation, adaptation, and immersion are essential. This work highlights the synergetic opportunities for both IoT and XR to converge toward hybrid XR objects with strong real-world connectivity, and IoT objects with rich XR interfaces. The paper contributes i) an understanding of this multi-disciplinary domain XR-IoT (XRI); ii) a theoretical perspective on how to design XRI agents based on the literature; iii) a system design architectural framework for XRI smart environment development; and iv) an early discussion of this process. It is hoped that this research enables future researchers in both communities to better understand and deploy hybrid smart XRI environments

Measuring the effectiveness of virtual training : a systematic review

The amount of research on virtual reality learning tools increases with time. Despite the diverse environments and theoretical foundations, enough data have been accumulated in recent years to provide a systematic review of the methods used. We pose ten questions concerning the methodological aspects of these studies. We performed a search in three databases according to the PRISMA guidelines and evaluated several characteristics, with particular emphasis on researchers' methodological decisions. We found an increase over time in the number of studies on the effectiveness of VR-based learning. We also identified shortcomings related to how the duration and number of training sessions are reported. We believe that these two factors could affect the effectiveness of VR-based training. Furthermore, when using the Kirkpatrick model, a significant imbalance can be observed in favor of outcomes from the ‘Reaction’ and ‘Learning’ levels compared to the ‘Behavior’ and ‘Results’ levels. The last of these was not used in any of the 330 reviewed studies. These results highlight the importance of research on the effectiveness of VR training. Taking into account the identified methodological shortcomings will allow for more significant research on this topic in the future

Virtual Reality and Its Application in Education

Virtual reality is a set of technologies that enables two-way communication, from computer to user and vice versa. In one direction, technologies are used to synthesize visual, auditory, tactile, and sometimes other sensory experiences in order to provide the illusion that practically non-existent things can be seen, heard, touched, or otherwise felt. In the other direction, technologies are used to adequately record human movements, sounds, or other potential input data that computers can process and use. This book contains six chapters that cover topics including definitions and principles of VR, devices, educational design principles for effective use of VR, technology education, and use of VR in technical and natural sciences

A Framework for Extended Reality System Development in Manufacturing

This paper presents a framework for developing extended reality (XR) systems within manufacturing context. The aim of this study is to develop a systematic framework to improve the usability and user acceptance of future XR systems. So that manufacturing industry can move from the “wow effect” of XR demonstrators into the stage whereas XR systems can be successfully integrated and improve the conventional work routines. It is essential to ensure the usability and user acceptance of XR systems for the wider adoption in manufacturing. The proposed framework was developed through six case studies that covered different XR system developments for different application areas of manufacturing. The framework consists of five iterative phases: (1) requirements analysis, (2) solution selection, (3) data preparation, (4) system implementation and (5) system evaluation. It is validated through one empirical case and seven identified previous studies, which partly aligned with the proposed framework. The proposed framework provides a clear guideline on the steps needed to integrate XR in manufacturing and it extends the XR usage with increased usability and user acceptance. Furthermore, it strengthens the importance of user-centered approach for XR system development in manufacturing

How to Use Haptic Technology in Interactive Digital Documentation of Heritage

Virtual restoration of the extinct heritage is a method of reconstruction of an already destroyed work in a virtual environment. It represents a way and an opportunity to reenter the remodeled simulated space interactively and experience its contemporary atmosphere and former author expression. In addition to visual and acoustic experiences, haptic technologies represent the potential for expanding sensory perception, which is not yet sufficiently used in the architectural sector. This study focuses on defunct and endangered works of interior architecture and industrial heritage, which were significant at the time of their inception and shaped the direction of the industry. Especially in the case of cultural and spiritual heritage, we focus on interiors, which, by their short-term nature, are neither objective nor physically documentable. Selected extinct works for which there was enough data or there was still the possibility of consultation with a living author were experimentally virtually reconstructed. Using haptic technologies, we have expanded the observer’s ability to interactively analyze space and its context through User Tracking of observers. The data obtained in this way continue to help the creators of the architecture set new starting points and limits for the current creation and design as well

Experiential media and transforming storytelling: A theoretical analysis

Journalism and media content rests on a foundation of storytelling. Shaping this storytelling is the quality of the medium of content delivery and the nature of public engagement. With the development of digital, networked media, the audience’s role is transforming to be more of an active user who experiences stories as a participant rather than as a passive receiver of content. This article proposes a new model of experiential media based on six primary qualities of the digital environment. These qualities are 1) interactivity, 2) immersion, 3) multi-sensory presentation, 4) algorithmic and data-driven, 5) first-person perspective, and 6) a natural user interface. Augmented reality and virtual reality are among the most-widely discussed experiential media forms, but others include, for instance, advanced ultra-high-definition video. Experiential media bring implications for the nature, production, impact and the future of mediated storytelling

Investigating Real-time Touchless Hand Interaction and Machine Learning Agents in Immersive Learning Environments

The recent surge in the adoption of new technologies and innovations in connectivity, interaction technology, and artificial realities can fundamentally change the digital world. eXtended Reality (XR), with its potential to bridge the virtual and real environments, creates new possibilities to develop more engaging and productive learning experiences. Evidence is emerging that thissophisticated technology offers new ways to improve the learning process for better student interaction and engagement. Recently, immersive technology has garnered much attention as an interactive technology that facilitates direct interaction with virtual objects in the real world. Furthermore, these virtual objects can be surrogates for real-world teaching resources, allowing for virtual labs. Thus XR could enable learning experiences that would not bepossible in impoverished educational systems worldwide. Interestingly, concepts such as virtual hand interaction and techniques such as machine learning are still not widely investigated in immersive learning. Hand interaction technologies in virtual environments can support the kinesthetic learning pedagogical approach, and the need for its touchless interaction nature hasincreased exceptionally in the post-COVID world. By implementing and evaluating real-time hand interaction technology for kinesthetic learning and machine learning agents for self-guided learning, this research has addressed these underutilized technologies to demonstrate the efficiency of immersive learning. This thesis has explored different hand-tracking APIs and devices to integrate real-time hand interaction techniques. These hand interaction techniques and integrated machine learning agents using reinforcement learning are evaluated with different display devices to test compatibility. The proposed approach aims to provide self-guided, more productive, and interactive learning experiences. Further, this research has investigated ethics, privacy, and security issues in XR and covered the future of immersive learning in the Metaverse.<br/