Designing Spatial UI as a Solution of the Narrow FOV of Microsoft HoloLens: Prototype of Virtual Museum Guide

Since the Augmented Reality (AR) headset ‘Microsoft HoloLens’ released in 2016, the academic and the industrial community witnessed an obvious transformation and changes in the perception of AR applications. Despite this breakthrough, most of the HoloLens users have explicitly reported the narrow field of view (FOV) that crops the virtual augmentation from the viewer’s sight to a small window of 34 degrees (Bimber & Bruns). This limitation can result in losing pre-made functions and visuals in the AR application. Therefore, this study introduced attempts to design a spatial UI representing a way around the narrow FOV that HoloLens suffers from. The UI was a crucial part of AR museum system which was evaluated by 9 experts in HCI, visual communication and museum engaging studies. Results showed a positive feedback on the usability of the system and users’ experience. This method can help HoloLens developers to extend their applications’ functionalities with avoiding missing content

Virtual Guidance using Mixed Reality in Historical Places and Museums

Mixed Reality (MR) is one of the most disruptive technologies that shows potential in many application domains, particularly in the tourism and cultural heritage sector. MR using the latest headsets with the highest capabilities introduces a new visual platform that can change people’s visual experience. This thesis introduces a HoloLens-based mixed reality guidance system for museums and historical places. This new guidance form considers the inclusiveness of the necessary and optimised functionalities, visual and audio guiding abilities, essential roles of a guide, and the related social interactions in the real-time. A mixed reality guide, dubbed ‘MuseumEye’ was designed and developed for the Egyptian Museum in Cairo, to overcome challenges currently facing the museum, e.g. lack of guiding methods, limited information signposted on the exhibits, lack of visitor engagement resulting in less time spent in the museum compared to other museums with similar capacity and significance. These problems motivated the researcher to conduct an exploratory study to investigate the museum environment and guiding methods by interviewing 10 participants and observing 20 visitors. ‘MuseumEye’ was built based on a literature review of immersive systems in museums and the findings of an exploratory study that reveals visitor behaviours and the nature of guidance in the museum. This project increased levels of engagement and the length of time visitors spend in museums, the Egyptian Museum in Cairo in particular, using the mixed reality technology that provides visitors with additional visual, audio information and computer-generated images at various levels of details and via different media. This research introduces the guidelines of designing immersive reality guide applications using the techniques of spatial mapping, designing the multimedia and UI, and designing interactions for exploratory purposes. The main contributions of this study include various theoretical contributions: 1) creating a new form of guidance that enhances the museum experience through developing a mixed reality system; 2) a theoretical framework that assesses mixed reality guidance systems in terms of perceived usefulness, ease of use, enjoyment, interactivity, the roles of a guide and the likelihood of future use; 3) the Ambient Information Visualisation Concept for increasing visitor engagement through better presenting information and enhancing communication and interaction between visitors and exhibits; and a practical contribution in creating a mixed reality guidance system that reshapes the museum space, enhances visitors’ experience and significantly increases the length of time they spend in the museum. The evaluation comprised of quantitative surveys (171 participants and 9 experts) and qualitative observation (51 participants) using MuseumEye in their tours. The results showed positive responses for all measured aspects and compares these to similar studies. The observation results showed that visitors who use MuseumEye spent four times the duration visitors spent without guides or with human guides in front of exhibited items. The quantitative results showed significant correlations between the measured constructs (perceived usefulness, ease of use, enjoyment, multimedia and UI, interactivity) and the likelihood of future use when the roles of guide mediate the relations. Moreover, the ‘perceived guidance’ is the most influential construct on the likelihood of future use of MuseumEye. The results also revealed a high likelihood of future use, which ensures the sustainability of adopting mixed reality technology in museums. This thesis shows the potential of mixed reality guides in the museum sector that reshape the museum space and offers endless possibilities for museums and heritage sites

Serious Gaming for Behaviour Change: A Systematic Review

Over the years, there has been a significant increase in the adoption of game-based interventions for behaviour change associated with many fields such as health, education, and psychology. This is due to the significance of the players’ intrinsic motivation that is naturally generated to play games and the substantial impact they can have on players. Many review papers measure the effectiveness of the use of gaming on changing behaviours; however, these studies neglect the game features involved in the game design process, which have an impact of stimulating behaviour change. Therefore, this paper aimed to identify game design mechanics and features that are reported to commonly influence behaviour change during and/or after the interventions. This paper identified key theories of behaviour change that inform the game design process, providing insights that can be adopted by game designers for informing considerations on the use of game features for moderating behaviour in their own games

User Experience of Markerless Augmented Reality Applications in Cultural Heritage Museums: ‘MuseumEye’ as a Case Study

This paper explores the User Experience (UX) of Augmented Reality applications in museums. UX as a concept is vital to effective visual communication and interpretation in museums, and to enhance usability during a museum tour. In the project ‘MuseumEye’, the augmentations generated were localized based on a hybrid system that combines of (SLAM) markerless tracking technology and the indoor Beacons or Bluetooth Low Energy (BLE). These augmentations include a combination of multimedia content and different levels of visual information that required for museum visitors. Using mobile devices to pilot this application, we developed a UX design model that has the ability to evaluate the user experience and usability of the application. This paper focuses on the multidisciplinary outcomes of the project from both a technical and museological perspective based on public responses. A field evaluation of the AR system was conducted after the UX model considered. Twenty-six participants were recruited in Leeds museum and another twenty participants in the Egyptian museum in Cairo. Results showed positive responses on experiencing the system after adopting the UX design model. This study contributes on synthesizing a UX design model for AR applications to reach the optimum levels of user interaction required that reflects ultimately on the entire museum experience

Serious Gaming for Behaviour Change: A Systematic Review

Over the years, there has been a significant increase in the adoption of game-based interventions for changing behaviours associated with many fields such as health, education, and psychology. This is due to the significance of the players’ intrinsic motivation that is naturally generated to play games and the substantial impact they can have on players. Many review papers measure the effectiveness of the use of gaming on changing behaviours; however, these studies neglect the game features involved in the game design process, which have an impact on stimulating behaviour change. Therefore, this paper aimed to identify game design mechanics and features that are reported to commonly influence behaviour change during and/or after the interventions. This paper identified key theories of behaviour change that inform the game design process, providing insights that can be adopted by game designers for informing considerations on the use of game features for moderating behaviour in their own games

Designing and Evaluation of A Mixed Reality System for Crime Scene investigation training: A hybrid approach

Police investigation in real-life crime scenes is an essential aspect of forensic science education. However, the practicality of bringing young investigators to actual crime scenes is often hindered by the costs and challenges involved. In order to overcome these obstacles, new technologies such as mixed reality (MR) are being explored as potential solutions. MR technology offers an interactive and cost-effective way to simulate real-life crime scenes, providing a valuable training experience for young investigators. This paper presents a novel design of a MR system using Microsoft HoloLens 2.0, which is tailored to work in a spatial 3D scanned and reconstructed crime scene using FARO point cloud 3D scanner X130 blended with photogrammetry techniques. The system was developed through the lens of Experiential Learning Theory and designed using a participatory approach, providing a cost-effective solution to help trained Kuwaiti police officers enhance their investigative skills. In order to evaluate the system’s user experience and user interaction, the Questionnaire of User Interaction Satisfaction and User Experience Questionnaire were utilised. Forty-four young police officers evaluated the system. Police students showed positive levels of satisfaction with user interaction and overall user experience with minimal negative feedback. Female students showed higher satisfaction with the overall impression compared to male students. Based on the positive feedback regarding the system expansion, the system will be taken into the commercialisation stage in the future to be provided as an essential tool for crime scene education and investigation practices

Evaluating the Use of Mixed Reality in CSI Training through the Integration of the Task-Technology Fit and Technology Acceptance Model

Despite the emerging literature on adopting Mixed Reality headsets in crime scene investigation ¬, it is still debatable on how to employ these headsets and its application for training purposes in higher education and police academies. Hence, this research presents a novel hybrid theoretical framework that combines the Task-technology Fit and Technology Acceptance Model variables and the most prominent features of MR headsets—immersion, interactivity and mobility. The main objective is to explore young investigators' behavioural intention to adopt MR headsets and their applications for investigation training practices. To validate the developed model, a questionnaire survey was the primary method used to collect data from 160 police academy students using the partial least squares-structural equation modelling technique. The empirical results revealed that task technology fit has a positive impact on the perceived usefulness of MR headset applications and no significant positive impact on the perceived ease of use applications of MR devices. On the contrary, individual technology fit has a positive impact on the perceived ease of use and no significant positive effects were found regarding the perceived usefulness of investigation training purposes. Furthermore, the results indicated that the mobility of MR wearable devices positively influences the perceived ease of use and the perceived usefulness for crime scene practices. The study also addresses the theoretical contributions and practical implications of these outcomes

Effect of Augmented Reality and Virtual Reality in Crime Scene Investigations

This research delves into the transformative potential of Augmented Reality (AR) and Virtual Reality (VR) in elevating the field of forensic science. Titled "Revelotinaising Forensic Science with the use of Augmented Reality and Virtual Reality," the study primarily focuses on leveraging HoloLens technology to aid crime scene investigation, addressing the challenges posed by limited time and geographical variations among colleagues. By exploring contemporary techniques for storing, visualizing, and manipulating evidence, the research seeks to equip forensic investigation units with advanced technological tools. In a landscape where law enforcement increasingly adopts forensic techniques, the paper underscores the significant role played by forensic scientists in criminal investigation, civil litigation, and disaster response. It highlights the importance of teamwork and innovative investigative tools like GPS positioning, video imaging, and data mining in the success of crime scene investigations. The integration of tri-dimensional (3D) representations of objects and the recognition and preservation of physical evidence are emphasized as key aspects of efficient crime-solving. Furthermore, recent studies on the application of AR for collaboration among crime scene investigators are explored, showcasing how AR technology fosters consensus-building within investigative teams. The distinction between VR and AR, with the former immersing users in a wholly digital environment and the latter enhancing the real world with digital elements, is elucidated. This paper serves as a comprehensive exploration of the integration of AR and VR in crime scene investigations, promising to revolutionize the field of forensic science. It sets the stage for further research and development in leveraging these technologies to enhance crime-solving capabilities and facilitate more efficiency