Handheld AR for Collaborative Edutainment

Handheld Augmented Reality (AR) is expected to provide ergonomic, intuitive user interfaces for untrained users. Yet no comparative study has evaluated these assumptions against more traditional user interfaces for an education task. In this paper we compare the suitability of a handheld AR arts-history learning game against more traditional variants. We present results from a user study that demonstrate not only the effectiveness of AR for untrained users but also its fun-factor and suitability in environments such as public museums. Based on these results we provide design guidelines that can inform the design of future collaborative handheld AR applications

A framework study on the use of immersive XR technologies in the cultural heritage domain

Most cultural promotion and dissemination are nowadays performed through the digitization of heritage sites and museums, a necessary requirement to meet the new needs of the public. Augmented Reality (AR), Mixed Reality (MR), and Virtual Reality (VR) have the potential to improve the experience quality and educational effect of these sites by stimulating users’ senses in a more natural and vivid way. In this respect, head-mounted display (HMD) devices allow visitors to enhance the experience of cultural sites by digitizing information and integrating additional virtual cues about cultural artifacts, resulting in a more immersive experience that engages the visitor both physically and emotionally. This study contributes to the development and incorporation of AR, MR, and VR applications in the cultural heritage domain by providing an overview of relevant studies utilizing fully immersive systems, such as headsets and CAVE systems, emphasizing the advantages that they bring when compared to handheld devices. We propose a framework study to identify the key features of headset-based Extended Reality (XR) technologies used in the cultural heritage domain that boost immersion, sense of presence, and agency. Furthermore, we highlight core characteristics that favor the adoption of these systems over more traditional solutions (e.g., handheld devices), as well as unsolved issues that must be addressed to improve the guests’ experience and the appreciation of the cultural heritage. An extensive search of Google Scholar, Scopus, IEEE Xplore, ACM Digital Library, and Wiley Online Library databases was conducted, including papers published from January 2018 to September 2022. To improve review reporting, the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were used. Sixty-five papers met the inclusion criteria and were classified depending on the study’s purpose: education, entertainment, edutainment, touristic guidance systems, accessibility, visitor profiling, and management. Immersive cultural heritage systems allow visitors to feel completely immersed and present in the virtual environment, providing a stimulating and educational cultural experience that can improve the quality and learning purposes of cultural visits. Nonetheless, the analyzed studies revealed some limitations that must be faced to give a further impulse to the adoption of these technologies in the cultural heritage domain

Game-based evacuation drill using augmented reality and head-mounted display

Purpose–Evacuation drills should be more realistic and interactive. Focusing on situational and audio-visual realities and scenario-based interactivity, we have developed a game-based evacuation drill (GBED) system that presents augmented reality (AR) materials on tablet computers. Our current research purpose is to improve visual reality (AR materials) in our GBED system. Design/methodology/approach–Our approach is to develop a new GBED system that superimposes digital objects (e.g. 3DCG elements) onto real-time vision using a marker-based AR library, a binocular opaque head-mounted display (HMD) and other current easily available technologies. Findings–Our findings from a trial experiment are that the new GBED system can improve visual reality and is appropriate for disaster education. However, a few problems remain for practical use. Research limitations/implications–When using the GBED system, participants (i.e. HMD wearers) can suffer from 3D sickness and have difficulty in moving. These are important safety problems in HMD-based systems. Social implications–The combination of AR and HMDs for GBEDs (i.e. integrating virtual and real worlds) will raise questions about its merits (pros and cons). Originality/value–The originality of our research is the combination of AR and an HMD to a GBED, which have previously been realized primarily as simulation games in virtual worlds. We believe that our research has the potential to expand disaster education

Tsunami Evacuation Drill System Using Smart Glasses

Evacuation drills are commonly conducted as traditional disaster education to reduce damages from natural disasters. However participants are not always interested in or committed to such drills. To improve this situation, we focused on Edutainment and proposed game-based evacuation drill (GBED) using the Real-World Edutainment (RWE) program. There are two types of GBED systems, i.e. the Tablet-based GBED (T-GBED) and the AR and HMD-based GBED (AH-GBED). We conducted GBED at several schools and determined that it can improve student motivation for disaster prevention. Subduction-zone earthquakes frequently generate tsunamis and can cause catastrophic damage especially to coastal areas. Thus people in coastal areas must move very quickly to evacuation sites when a massive earthquake occurs. Both GBED systems cannot be used directly for tsunami evacuation drills because the participants will not want to sprint while holding a tablet or wearing a HMD and have time to stop to view the digital materials. In this study, we propose a tsunami evacuation drill (TED) and have developed a TED system. The TED system uses smart glasses (a lightweight optical see-through HMD) which allows participants to view digital materials while moving quickly

Handheld Augmented Reality in education

[ES] En esta tesis llevamos a cabo una investigación en Realidad Aumentada (AR) orientada a entornos de aprendizaje, donde la interacción con los estudiantes se realiza con dispositivos de mano. A través de tres estudios exploramos las respuestas en el aprendizaje que se pueden obtener usando AR en dispositivos de mano, en un juego que desarrollamos para niños. Exploramos la influencia de AR en Entornos de Aprendizaje de Realidad Virtual (VRLE) y las ventajas que pueden aportar, así como sus límites. También probamos el juego en dos dispositivos de mano distintos (un smartphone y un Tablet PC) y presentamos las conclusiones comparándolos en torno a la satisfación y la interacción. Finalmente, comparamos interfaces táctiles y tangibles en aplicaciones de AR para niños bajo una perspectiva en Interacción Hombre-Máquina.[EN] In this thesis we conduct a research in Augmented Reality (AR) aimed to learning environments, where the interaction with the students is carried out using handheld devices. Through three studies we explore the learning outcomes that can be obtained using handheld AR in a game that we developed for children. We explored the influence of AR in Virtual Reality Learning Environments (VRLE) and the advantages that can involve, as well as the limits. We also tested the game in two different handheld devices (a smartphone and a Tablet PC) and present the conclusions comparing them concerning satisfaction and interaction. Finally, we compare the use tactile and tangible user interfaces in AR applications for children under a Human-Computer Interaction perspective.González Gancedo, S. (2012). Handheld Augmented Reality in education. http://hdl.handle.net/10251/17973Archivo delegad

Enhancing collaborative learning in an augmented reality supported environment

Master'sMASTER OF ENGINEERIN

Emerging digital media, games and simulations: a challenge for open and distance learning

In this article we examine the state-of-the-art research related to digital media in education and evaluate the information concerning a new generation of students that are communityminded and technologically savvy, highlighting the innovative technology behind the new interaction and communication processes, and assessing the challenges for Open and Distance Learning (ODL). Where traditional distance education is based on the completion of carefully graded assignments and tests, today games, simulations and virtual environments may become safe platforms for trial and error experimentation. With games the chance of failure is high, but the cost is low and the lessons are learned immediately and with greater emotional impact. However, these conditions may become more difficult to address when the volume of users increases from small to medium, large or extra-large. Dealing effectively with tens or even hundreds of thousands of students in absentia requires following very sound organizational principles and good technical implementation, systematic monitoring of deviations from established norms, regular audition of users' comments and criticisms, careful analysis of final results. In this emerging scenario, involving digital media, games and simulations, ODL systems must have means of establishing rich connections with each member of the universe of users. In this sense we propose using a virtual space with multiple places, in ways that use the Internet, social applications, games and mobile devices to involve students in pedagogical activities

Mobile Augmented Reality in Museums : Towards Enhancing Visitor's Learning Experience

This article presents the design and implementation of a handheld Augmented Reality (AR) system called Mobile Augmented Reality Touring System (M.A.R.T.S). The results of experiments conducted during museum visits using this system are also described. These experiments aim at studying how such a tool can transform the visitor’s learning experience by comparing it to two widely used museum systems. First, we present the museum’s learning experience and a related model which emerged from the state of the art. This model consists of two types of activity experienced by the observer of a work of art: sensitive and analytical. Then, we detail M.A.R.T.S architecture and implementation. Our empirical study highlights the fact that AR can direct visitors’ attention by emphasizing and superimposing. Its magnifying and sensitive effects are well perceived and appreciated by visitors. The obtained results reveal that M.A.R.T.S contributes to a worthwhile learning experience