Calculation of the optical scheme of an augmented reality video module

At present the optical properties of coatings applied to the waveguide displays of AR glasses are not clearly investigated, and there are also difficulties in designing an optical scheme of a video module of AR glasses

DESIGNING AN EXTENDED REALITY MOBILE GUIDE APPLICATION TO COMMUNICATE AND INTERPRET SERIAL WORLD HERITAGE SITES: A CASE STUDY OF KOREA’S SEOWON UNESCO WORLD HERITAGE SITE

Extended reality (XR) mobile guide applications offer unprecedented potential for immersive visitor experiences and in-depth knowledge retention to promote cultural learning at large-scale heritage sites, but, despite their significant development, the literature underexplores these applications for World Heritage sites, especially the serial properties that are spatially dispersed in various locations but configured as a single property. This paper describes a framework (blueprint) for the development of an XR mobile guide application focused on serial properties. By incorporating interactive XR and edutainment features, it explores a way to comprehensively reveal the interconnections between the heritage attributes of the subcomponent of the serial properties and their larger, cross-cultural context vis-à-vis the Outstanding Universal Values. To this end, at the Seowon, the UNESCO World Heritage site in Korea, we analyzed user interactions with a prototype of the XR application to identify user preferences and areas for improving the framework

EVD Surgical Guidance with Retro-Reflective Tool Tracking and Spatial Reconstruction using Head-Mounted Augmented Reality Device

Augmented Reality (AR) has been used to facilitate surgical guidance during External Ventricular Drain (EVD) surgery, reducing the risks of misplacement in manual operations. During this procedure, the pivotal challenge is the accurate estimation of spatial relationship between pre-operative images and actual patient anatomy in AR environment. In this research, we propose a novel framework utilizing Time of Flight (ToF) depth sensors integrated in commercially available AR Head Mounted Devices (HMD) for precise EVD surgical guidance. As previous studies have proven depth errors for ToF sensors, we first conducted a comprehensive assessment for the properties of this error on AR-HMDs. Subsequently, a depth error model and patient-specific model parameter identification method, is introduced for accurate surface information. After that, a tracking procedure combining retro-reflective markers and point clouds is proposed for accurate head tracking, where head surface is reconstructed using ToF sensor data for spatial registration, avoiding fixing tracking targets rigidly on the patient's cranium. Firstly, $7.580\pm 1.488 mm$ ToF sensor depth value error was revealed on human skin, indicating the significance of depth correction. Our results showed that the ToF sensor depth error was reduced by over $85\%$ using proposed depth correction method on head phantoms in different materials. Meanwhile, the head surface reconstructed with corrected depth data achieved sub-millimeter accuracy. Experiment on a sheep head revealed $0.79 mm$ reconstruction error. Furthermore, a user study was conducted for the performance of proposed framework in simulated EVD surgery, where 5 surgeons performed 9 k-wire injections on a head phantom with virtual guidance. Results of this study revealed $2.09 \pm 0.16 mm$ translational accuracy and $2.97\pm 0.91 ^\circ$ orientational accuracy

Augmented Reality, Virtual Reality, and Computer Graphics - 5th International Conference, AVR 2018, Otranto, Italy, June 24-27, 2018, Proceedings, Part II

International audienc

Serious Games and Mixed Reality Applications for Healthcare

Virtual reality (VR) and augmented reality (AR) have long histories in the healthcare sector, offering the opportunity to develop a wide range of tools and applications aimed at improving the quality of care and efficiency of services for professionals and patients alike. The best-known examples of VR–AR applications in the healthcare domain include surgical planning and medical training by means of simulation technologies. Techniques used in surgical simulation have also been applied to cognitive and motor rehabilitation, pain management, and patient and professional education. Serious games are ones in which the main goal is not entertainment, but a crucial purpose, ranging from the acquisition of knowledge to interactive training.These games are attracting growing attention in healthcare because of their several benefits: motivation, interactivity, adaptation to user competence level, flexibility in time, repeatability, and continuous feedback. Recently, healthcare has also become one of the biggest adopters of mixed reality (MR), which merges real and virtual content to generate novel environments, where physical and digital objects not only coexist, but are also capable of interacting with each other in real time, encompassing both VR and AR applications.This Special Issue aims to gather and publish original scientific contributions exploring opportunities and addressing challenges in both the theoretical and applied aspects of VR–AR and MR applications in healthcare

Real-time Topology-Aware Augmented Reality

Augmented Reality (AR) technology fuses virtual information with the real-world en- vironment to enhance the way people interact with digital information in their physical world. This thesis is concerned with topology-aware AR systems designed to be aware of the topology changes in the surroundings and explore the topological features of scenes. Topological structures, such as graphs, can provide information on the relationship between point clouds to improve the quality of point cloud-based real-world 3D map reconstruc- tions for topology-aware AR systems. The reconstructed 3D maps provide information to improve the registration accuracy between virtual objects and the physical environment. Furthermore, 3D maps also help to reduce registration failures caused by complex and dynamic scenes, such as object occlusions, object motion, and object deformation. This thesis explores algorithms, computational methods, and frameworks for dense 3D surface reconstructions based on monocular videos and images for augmented reality applications. The main contributions of this PhD work are: 1) Proposed a graph deep learning-based framework for monocular depth estimation, which learns non-Euclidean features and improves the accuracy of depth estimations. Mathematical background on group equivariance, including translation equivariance and permutation equivariance, is also introduced to provide theoretical support for the proposed network; 2) Conducted two use cases to demonstrate the capabilities of the proposed methods in improving fine details of depth estimation for complex and unstructured environments with free camera motions; 3) A further improved the framework to address low-illumination endoscopy videos; 4) Proposed a statistical method to handle the non-rigid point cloud registration with special topology changes. Within which, a clustering and refinement scheme is proposed to deal with distribution irregularities of point sets; 5) Developed a framework to demonstrate the functionality of the proposed method in AR. Under challenging scenes such as endoscopy and unmanned aerial vehicle videos, the proposed methods outperform the state-of-the-art algorithms with robustness and accuracy. For example, the proposed depth estimation method improves the 3D data acquisition, the Break and Splice framework improves the 3D dynamic reconstruction, and the proposed AR framework provides a solution in dynamic scenes for medical applications

Матеріали 4-го Міжнародного семінару з доповненої реальності в освіті (AREdu 2021). Кривий Ріг, Україна. 11 травня 2021 року

Proceedings of the 4th International Workshop on Augmented Reality in Education (AREdu 2021). Kryvyi Rih, Ukraine. May 11, 2021.Матеріали 4-го Міжнародного семінару з доповненої реальності в освіті (AREdu 2021). Кривий Ріг, Україна. 11 травня 2021 рок

Eurodisplay 2019

The collection includes abstracts of reports selected by the program by the conference committee