REVISIÓN DE LAS TÉCNICAS DE REALIDAD AUMENTADA Y REALIDAD VIRTUAL EN EL ARTE RUPESTRE

[EN] The usage of augmented reality (AR) and virtual reality (VR) technologies began to grow when smartphones appeared. Until then, the number of portable devices capable of incorporating these technologies was reduced. Video games are the main field where these technologies are applied, but in other fields such as in archaeology, these technologies can offer many advantages. Ruins reconstruction, ancient life simulation, highly detailed 3D models visualisation of valuable objects from the past or even user free movement in missing places are just some examples found in literature. This paper reviews the latest visualisation technologies and their applicability to the rock art field. The main purpose is to disseminate rock art paintings through AR and VR applications. After the image-based three-dimensional (3D) modelling is obtained, an interactive visit to a shelter for displaying rock art paintings is presented. This is one of examples developed in this paper that pretends to apply the revised AR and VR techniques. In addition, an example of AR is developed that can be easily adapted to further applications displaying rock art paintings.[ES] El uso de las tecnologías de realidad virtual (RV) y realidad aumentada (RA) comenzó a crecer con la aparición de los teléfonos inteligentes. Hasta entonces, había pocos dispositivos portátiles capaces de incorporar estas tecnologías. Principalmente estas tecnologías se aplican en la creación de videojuegos, aunque en otros campos como la arqueología, estas tecnologías tienen mucho que ofrecer. Con estas tecnologías es posible mostrar la reconstrucción de ruinas, la simulación de otra época, modelos 3D altamente detallados de objetos de valor del pasado o incluso trasladar al usuario a lugares que ya no existen. Este trabajo presenta una revisión de las últimas tecnologías de visualización y su aplicabilidad en el campo del arte rupestre, con el objetivo de divulgar las pinturas rupestres a través de aplicaciones de RA y RV. Después del modelado 3D basado en imágenes, se presenta una visita interactiva a un refugio para la visualización de las pinturas rupestres. Este es uno de los ejemplos desarrollados en este trabajo que pretende aplicar las técnicas revisadas de RA y RV. Además, se detalla un sencillo ejemplo de RA que puede fácilmente adaptarse a otras aplicaciones que muestren pinturas rupestres.Blanco Pons, S.; Carrión Ruiz, B.; Lerma, JL. (2016). REVIEW OF AUGMENTED REALITY AND VIRTUAL REALITY TECHNIQUES IN ROCK ART. En 8th International congress on archaeology, computer graphics, cultural heritage and innovation. Editorial Universitat Politècnica de València. 176-183. https://doi.org/10.4995/arqueologica8.2016.3561OCS17618

Design and Evaluation of Neurosurgical Training Simulator

Surgical simulators are becoming more important in surgical training. Consumer smartphone technology has improved to allow deployment of VR applications and are now being targeted for medical training simulators. A surgical simulator has been designed using a smartphone, Google cardboard 3D glasses, and the Leap Motion (LM) hand controller. Two expert and 16 novice users were tasked with completing the same pointing tasks using both the LM and the medical simulator NeuroTouch. The novice users had an accuracy of 0.2717 bits (SD 0.3899) and the experts had an accuracy of 0.0925 bits (SD 0.1210) while using the NeuroTouch. Novices and experts improved their accuracy to 0.3585 bits (SD 0.4474) and 0.4581 bits (SD 0.3501) while using the LM. There were some tracking problems with the AR display and LM. Users were intrigued by the AR display and most preferred the LM, as they found it to have better usability

Exploring the past with Google Cardboard

Combining digital reconstruction with mobile technologies has the potential of enriching visitors experience to historic sites. Through designing a mobile App with Google Cardboard it is possible to use technology already in peoples' pockets to provide immersive on-site exploration of historic sites. This paper looks at our experience in developing such a mobile App which acts as a digital guided tour of the remains of St Andrews Cathedral. The App brings together traditional media such as audio, images, panoramas, 3D video and 4π Steradian (or 360°) video with a mobile smartphone and Google Cardboard to provide a tour of one of Scotland's most important historic sites. The mobile App is available from both Google Play and iTunes, providing direct delivery to a potential audience of millions. It complements the location-aware mediaeval St Andrews App, which provides a guided tour to the town of St Andrews as a whole. In the absence of Google Cardboard the App is still useful providing both visual content and audio commentary on this historic monument.Postprin

PhysioVR: a novel mobile virtual reality framework for physiological computing

Virtual Reality (VR) is morphing into a ubiquitous technology by leveraging of smartphones and screenless cases in order to provide highly immersive experiences at a low price point. The result of this shift in paradigm is now known as mobile VR (mVR). Although mVR offers numerous advantages over conventional immersive VR methods, one of the biggest limitations is related with the interaction pathways available for the mVR experiences. Using physiological computing principles, we created the PhysioVR framework, an Open-Source software tool developed to facilitate the integration of physiological signals measured through wearable devices in mVR applications. PhysioVR includes heart rate (HR) signals from Android wearables, electroencephalography (EEG) signals from a low cost brain computer interface and electromyography (EMG) signals from a wireless armband. The physiological sensors are connected with a smartphone via Bluetooth and the PhysioVR facilitates the streaming of the data using UDP communication protocol, thus allowing a multicast transmission for a third party application such as the Unity3D game engine. Furthermore, the framework provides a bidirectional communication with the VR content allowing an external event triggering using a real-time control as well as data recording options. We developed a demo game project called EmoCat Rescue which encourage players to modulate HR levels in order to successfully complete the in-game mission. EmoCat Rescue is included in the PhysioVR project which can be freely downloaded. This framework simplifies the acquisition, streaming and recording of multiple physiological signals and parameters from wearable consumer devices providing a single and efficient interface to create novel physiologically-responsive mVR applications.info:eu-repo/semantics/publishedVersio

A Pipeline for the Implementation of Immersive Experience in Cultural Heritage Sites in Sicily

Modern digital technologies allow potentially to explore Cultural Heritage sites in immersive virtual environments. This is surely an advantage for the users that can better experiment and understand a specific site, also before a real visit. This specific approach has gained increasing attention during the extreme conditions of the recent COVID-19 pandemic. In this work, we present the processes that lead to the implementation of an immersive app for different kinds of low and highcost devices, which have been attained in the context of the 3DLab-Sicilia project. 3DLab-Sicilia’s main objective is to sponsor the creation, development, and validation of a sustainable infrastructure that interconnects three main Sicilian centers specialized in augmented and virtual reality. The project gives great importance to the cultural heritage, as well as to the tourism related areas. Despite the presentation of the case study of the Santa Maria La Vetere church, the process of the final app implementation guided by the general pipeline here presented is general and can be applied to other cultural heritage sites

Analysis and Development of Augmented Reality Applications for the Dissemination of Cultural Heritage

Tesis por compendio[ES] La RA consiste en la superposición de elementos virtuales sobre el entorno real, de manera que el usuario percibe estos elementos como si formaran parte de la realidad que está visualizando. Las aplicaciones de RA en dispositivos móviles permiten visualizar el contenido virtual a través de la cámara del dispositivo. La RA es una herramienta de divulgación muy potente ya que permite añadir a la realidad cualquier tipo de información, desde un simple texto informativo a un modelo 3D interactivo. Tiene infinitas utilidades, puede servir de guía en un museo, puede mostrar la recreación de un monumento destruido, o como en el caso de estudio aquí presentado, ayudar a la interpretación de pinturas rupestres. Esta tesis parte de la idea de que la RA puede mejorar mucho la interpretación del arte rupestre sin alterar ni dañar las pinturas. Puede servir para atraer a un público mayor, dar a conocer la historia de las pinturas rupestres y que al mismo tiempo el visitante tenga una experiencia mucho más enriquecedora. A lo largo de la tesis se ha estudiado en profundidad la técnica de visualización de RA mediante dispositivos móviles. Se han analizado las diferentes librerías de programación mediante casos de estudio en entornos reales y examinado los factores que pueden afectar al reconocimiento de las pinturas. Se ha desarrollado una aplicación de RA aplicada a un caso real de pinturas rupestres y posteriormente ha sido evaluada por un grupo de personas. Finalmente, se ha estudiado el efecto de la luz solar y sus cambios a lo largo del día sobre el reconocimiento de imágenes en entornos al aire libre. Este trabajo proporciona un punto de partida para el desarrollo de aplicaciones de RA aplicadas a la difusión del patrimonio cultural, especialmente centrado en el arte rupestre, un entorno que sufre de unas dificultades añadidas debido a su localización, dificultad de reconocimiento de puntos característicos en las pinturas y los cambios en la luz solar, problemas que se han tratado de resolver a lo largo del estudio. Las principales conclusiones han sido muy favorables, partiendo de librerías de programación disponibles y gratuitas. Se han podido desarrollar un conjunto de aplicaciones de RA en diferentes lugares. Las valoraciones han sido muy positivas, los usuarios que han probado las aplicaciones afirman que la interpretación de las pinturas les resulta más fácil y consiguen entender mejor el propósito de las mismas. El principal inconveniente encontrado es la falta de conocimiento sobre esta técnica y la pérdida de realismo en algunos casos debido a la oclusión, es decir, que los objetos virtuales no se posicionen por detrás de los objetos reales. La buena noticia es que esta tecnología evoluciona muy rápido y durante el desarrollo de la tesis ha habido avances muy grandes, entre ellos, el desarrollo de nuevas librerías de programación desarrolladas por Google y Apple, que proporcionan las herramientas necesarias para crear aplicaciones muy potentes e immersivas, donde el usuario se sentirá parte de los entornos creados.[CA] La RA consisteix en la superposició d'elements virtuals sobre l'entorn real, de manera que l'usuari percep aquests elements com si formaren part de la realitat que està visualitzant. Les aplicacions de RA en dispositius mòbils permeten visualitzar el contingut virtual a través de la cambra del dispositiu. La RA és una eina de divulgació molt potent ja que permet afegir a la realitat qualsevol tipus d'informació, des d'un simple text informatiu a un model 3D interactiu. Té infinites utilitats, pot servir de guia en un museu, pot mostrar la recreació d'un monument destruït, o com en el cas d'estudi ací presentat, ajudar a la interpretació de pintures rupestres. Aquesta tesi parteix de la idea que la RA pot millorar molt la interpretació de l'art rupestre sense alterar ni danyar les pintures. Pot servir per a atraure a un públic major, donar a conéixer la història de les pintures rupestres i que al mateix temps el visitant tinga una experiència molt més enriquidora. Al llarg de la tesi s'ha estudiat en profunditat la tècnica de visualització de RA mitjançant dispositius mòbils. S'han analitzat les diferents llibreries de programació mitjançant casos d'estudi en entorns reals i analitzat els factors que poden afectar el reconeixement de les pintures. S'ha desenvolupat una aplicació de RA aplicada a un cas real de pintures rupestres i posteriorment ha sigut avaluada per un grup de persones. Finalment, s'ha estudiat l'efecte de la llum solar i els seus canvis al llarg del dia sobre el reconeixement d'imatges en entorns a l'aire lliure. Aquest treball proporciona un punt de partida per al desenvolupament d'aplicacions de RA aplicades a la difusió del patrimoni cultural, especialment centrat en l'art rupestre, un entorn que pateix d'unes dificultats afegides a causa de la seua localització, dificultat de reconeixement de punts característics en les pintures i els canvis en la llum solar, problemes que s'han tractat de resoldre al llarg de l'estudi. Les principals conclusions han sigut molt favorables, partint de llibreries de programació disponibles i gratuïtes. S'han pogut desenvolupar un conjunt d'aplicacions de RA en diferents llocs. Les valoracions han sigut molt positives, els usuaris que han provat les aplicacions afirmen que la interpretació de les pintures els resulta més fàcil i aconsegueixen entendre millor el propòsit d'aquestes. El principal inconvenient trobat és la falta de coneixement sobre aquesta tècnica i la perduda de realisme en alguns casos a causa de l'oclusió, és a dir, que els objectes virtuals no es posicionen per darrere dels objectes reals. La bona notícia és que aquesta tecnologia evoluciona molt ràpid i durant el desenvolupament de la tesi hi ha hagut avanços molt grans, entre ells, el desenvolupament de noves llibreries de programació per Google i Apple, que proporcionen les eines necessàries per a crear aplicacions molt potents i immersives, on l'usuari se sentirà part dels entorns creats.[EN] AR consists of superimposing virtual elements on the real environment, so that the user perceives these elements as if they were part of the reality they are looking at. AR applications on smartphones allow virtual content to be visualised through the device's camera. AR is a very powerful tool for dissemination as it allows any type of information to be added to reality, from a simple informative text to an interactive 3D model. It can be used as a guide in a museum, it can show the recreation of a destroyed monument, or, as in the case study presented here, it can help in the interpretation of cave paintings. This thesis is based on the idea that AR can greatly enhance the interpretation of rock art without affecting or damaging the paintings. It can be used to attract a wider audience, to introduce the history of the rock art paintings and at the same time provide the visitor with a much more enriching experience. Throughout the thesis, the technique of AR visualisation using mobile devices has been studied in-depth. The different programming libraries have been analysed by means of case studies in real environments as well as the factors that can affect the paintings recognition. An AR application applied to a real case of rock art paintings has been developed and subsequently evaluated by a group of people. Finally, the effect of sunlight and its changes throughout the day on image recognition in outdoor environments has been studied. This work provides a starting point for the AR applications development applied to the dissemination of cultural heritage, especially focused on rock art, an environment that suffers from additional difficulties due to its location, the difficulty of characteristic points recognition and changes in sunlight, problems that have been tried to solve throughout the study. The main outcomes have been very favourable, using freely available programming libraries, and it has been possible to develop a set of AR applications in different places. The evaluations have been very positive, with users who have tested the applications confirming that the interpretation of the paintings is easier for them and they can better understand the purpose of the paintings. The major drawback is the lack of knowledge about this technique and the loss of realism in some cases due to occlusion, i.e. the virtual objects are not positioned behind the real objects. The good news is that this technology is evolving very fast and during the development of the thesis there have been great advances, among them, the development of new programming libraries developed by Google and Apple, which provide the necessary tools to create very powerful and immersive applications, where the user will feel part of the virtual environments created.Blanco Pons, S. (2021). Analysis and Development of Augmented Reality Applications for the Dissemination of Cultural Heritage [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/178895TESISCompendi