Virtual Tours to Promote the Remote Customer Experience

Today, virtual reality and augmented reality can allow people to interact with products and places in a very realistic way. In this direction, the use of immersive virtual tours (VTs) can improve the users' experience, their perceptions, attitudes and even intended behaviours as potential or actual consumers. The paper focuses on a traditional Italian cheese product and defines a transdisciplinary, multimodal approach where VT helps the remote customer experience based on a VT application to virtually visit a Parmigiano Reggiano cheese dairy, using cutting- edge virtual reality set-up. The paper describes how to create a virtual tour of industrial plants by mapping the main actions, from the storytelling definition, to the plant digitization, until the creation of the virtual, immersive and multimodal application using Unity3D. The VT combines visual experience with gesture recognition and audio stimulation, adding also olfactory cues, in order to create an interactive and realistic experience

REVISIÓN DE LAS TÉCNICAS DE REALIDAD AUMENTADA Y REALIDAD VIRTUAL EN EL ARTE RUPESTRE

[EN] The usage of augmented reality (AR) and virtual reality (VR) technologies began to grow when smartphones appeared. Until then, the number of portable devices capable of incorporating these technologies was reduced. Video games are the main field where these technologies are applied, but in other fields such as in archaeology, these technologies can offer many advantages. Ruins reconstruction, ancient life simulation, highly detailed 3D models visualisation of valuable objects from the past or even user free movement in missing places are just some examples found in literature. This paper reviews the latest visualisation technologies and their applicability to the rock art field. The main purpose is to disseminate rock art paintings through AR and VR applications. After the image-based three-dimensional (3D) modelling is obtained, an interactive visit to a shelter for displaying rock art paintings is presented. This is one of examples developed in this paper that pretends to apply the revised AR and VR techniques. In addition, an example of AR is developed that can be easily adapted to further applications displaying rock art paintings.[ES] El uso de las tecnologías de realidad virtual (RV) y realidad aumentada (RA) comenzó a crecer con la aparición de los teléfonos inteligentes. Hasta entonces, había pocos dispositivos portátiles capaces de incorporar estas tecnologías. Principalmente estas tecnologías se aplican en la creación de videojuegos, aunque en otros campos como la arqueología, estas tecnologías tienen mucho que ofrecer. Con estas tecnologías es posible mostrar la reconstrucción de ruinas, la simulación de otra época, modelos 3D altamente detallados de objetos de valor del pasado o incluso trasladar al usuario a lugares que ya no existen. Este trabajo presenta una revisión de las últimas tecnologías de visualización y su aplicabilidad en el campo del arte rupestre, con el objetivo de divulgar las pinturas rupestres a través de aplicaciones de RA y RV. Después del modelado 3D basado en imágenes, se presenta una visita interactiva a un refugio para la visualización de las pinturas rupestres. Este es uno de los ejemplos desarrollados en este trabajo que pretende aplicar las técnicas revisadas de RA y RV. Además, se detalla un sencillo ejemplo de RA que puede fácilmente adaptarse a otras aplicaciones que muestren pinturas rupestres.Blanco Pons, S.; Carrión Ruiz, B.; Lerma, JL. (2016). REVIEW OF AUGMENTED REALITY AND VIRTUAL REALITY TECHNIQUES IN ROCK ART. En 8th International congress on archaeology, computer graphics, cultural heritage and innovation. Editorial Universitat Politècnica de València. 176-183. https://doi.org/10.4995/arqueologica8.2016.3561OCS17618

A Case Study on the Advantages of 3D Walkthroughs over Photo Stitching Techniques

Virtual tours and interactive walkthroughs enable a more in-depth platform for communicating information. Many current techniques employ the use of Photo Stitching to accomplish this. However, over the last decade advancements in computing power and the accessibility of game engines, meant that developing rich 3D content for virtual tours is more possible than ever before. As such, the purpose of this paper is to present a study into the advantages of developing an interactive 3D virtual tour of student facilities, using the Unreal Development 4 Game Engine, for educational establishments. The project aims to demonstrate a comparison between the use of Photo Stitching and 3D Modelled interactive walkthrough for developing rich visual environments. The research reveals that the approach in this paper can improve educational facilities prominence within universities, and contains many advantages over Photo Stitching techniques

Design and implementation of an augmented reality application for rock art visualization in Cova dels Cavalls (Spain)

[EN] Prehistoric rock art paintings, specifically rock-shelters exposed to environmental and anthropogenic factors, are usually faint and severely damaged, being them difficult to identify and understand by visitors. Augmented Reality (AR) supplements reality with virtual information superimposed onto the real world. This sensor-based technology in smartphones/tablets can improve the paintings experience displaying the 2D digital tracings overlapped onto the real scene (rock with faint paintings). This paper presents an AR application (app) developed in Cova dels Cavalls that shows a recreation of a possible original composition full of motifs with descriptive information to improve current guided tour user experiences. This case study aims to evaluate the rock art AR app targeting non-expert visitors as a means of improving rock art knowledge and sensibility of a fragile archaeological UNESCO Work Heritage site. To achieve this, a variety of participants with different backgrounds and interests tested the AR app on site and answered a complete questionnaire about the use of AR mobile apps. Overall, the results showed great acceptance of this AR app, mainly because in addition to adding new information interactively, it helps to identify the rock art motifs, as well as to recognise them quickly, improving their understanding.The authors gratefully acknowledge the support from the Spanish Ministerio de Economia y Competitividad to the project HAR201459873-R. The authors acknowledge the authorisation of the Conselleria d'Educacio, Investigacio, Cultura i Esports the chance to carry out research at this exceptional archaeological site.Blanco-Pons, S.; Carrión-Ruiz, B.; Lerma, JL.; Villaverde, V. (2019). Design and implementation of an augmented reality application for rock art visualization in Cova dels Cavalls (Spain). Journal of Cultural Heritage. 39:177-185. https://doi.org/10.1016/j.culher.2019.03.014S1771853

Developing a virtual zoological museum

Abstract. This is a documentation of our work developing a virtual zoological museum. Although it’s challenging to create a virtual museum that lives up to the original, Unity3D and virtual reality technology are utilized in order to provide experiences that a traditional museum cannot. As we aim to digitize the museum that once was in University of Oulu, different ways of designing an educating and engaging virtual museum visit are explored. The animals of the museum can be interacted with, being able to play back animations and audio while also providing information in text form. An interactive forest was also developed as a more natural and lively environment. Furthermore, 360° photos of local forests were added to improve the representation of nature. Virtual reality support was programmed for Oculus Rift, allowing movement and interaction as if one was there in real life. In order to achieve a comfortable experience, some performance optimization has been done to reach stable frame rates. We evaluated users’ sense of presence, experienced Game Transfer Phenomena (GTP), system usability and content quality. Based on our tests, users found the virtual museum visit enjoyable and immersive overall despite being distracted by some aspects, like the quality of the display. Users were also mostly satisfied with the environments and the quality of the animals. Experienced Game Transfer was low, however. All in all, this concept for creating a virtual museum has appeared to be successful, and it could be developed further.Virtuaalisen eläintieteellisen museon kehittäminen. Tiivistelmä. Tämä on dokumentaatio virtuaalisen eläintieteellisen museon kehittämisestä. Vaikka onkin haastavaa luoda virtuaalinen museo, joka on verrattavissa alkuperäiseen, hyödyntämällä Unity3D:tä ja virtuaalitodellisuusteknologiaa on mahdollista tarjota kokemuksia, mitä perinteinen museo ei pysty. Digitalisoidessamme sitä museota, joka Oulun Yliopistolla ennen oli, tutkimme erilaisia keinoja kehittää opetuksellinen ja kiinnostava virtuaalimuseovierailu. Museon eläimet ovat interaktiivisia, pystyen toistamaan animaatioita ja ääniä sekä antamaan tietoa tekstin muodossa. Interaktiivinen metsä luotiin tarjoamaan luonnollisemman ja elävämmän ympäristön. Lisäksi 360° kuvia paikallisista metsistä lisättiin parantaakseen luonnon edustusta. Virtuaalitodellisuustuki lisättiin Oculus Rift:ille, sallien liikkumisen ja vuorovaikuttamisen kuin olisi siellä todellisessa elämässä. Luodakseen mukavan kokemuksen, sovelluksen suorituskykyä on optimoitu saavuttaakseen vakaan kuvan päivitystaajuuden. Evaluoimme käyttäjien läsnäolon tunnetta, koettua Game Transfer -ilmiötä (GTP), järjestelmän käytettävyyttä ja sisällön laatua. Testien perusteella käyttäjät kokivat museovierailun miellyttävänä sekä immersiivisenä yleisesti ottaen, vaikka jotkin piirteet, kuten näytön laatu, häiritsivät. Käyttäjät olivat myöskin pitkälti tyytyväisiä ympäristöihin ja eläinten laatuun. Koettu Game Transfer oli kuitenkin vähäistä. Kaikenkaikkiaan tämä virtuaalimuseo konsepti vaikuttaa toimivalta, ja sitä voisi kehittää pidemmälle

A 3D virtual tour of the Santa Maria della Scala Museum Complex in Siena, Italy, based on the use of Oculus Rift HMD

In this paper we present the realization of a 3D virtual museum tour through the use of paired full-panoramas, to be displayed using the Head-Mounted Display Oculus Rift. The paper analyzes in details every stage of the project, from the starting point, i.e. the collection of the required images, to the end, that is the creation of the tour itself. The proposed solution is conceived to be developed using off-the-shelf devices in order to be easily replicated in other contexts: in particular, image capture is performed using two paired GoPro Hero 3 cameras. While this solution can be applied in several different scenarios this paper focuses on the development of a virtual reproduction of the Santa Maria della Scala Museum Complex in Siena, Italy

Analysis and Development of Augmented Reality Applications for the Dissemination of Cultural Heritage

Tesis por compendio[ES] La RA consiste en la superposición de elementos virtuales sobre el entorno real, de manera que el usuario percibe estos elementos como si formaran parte de la realidad que está visualizando. Las aplicaciones de RA en dispositivos móviles permiten visualizar el contenido virtual a través de la cámara del dispositivo. La RA es una herramienta de divulgación muy potente ya que permite añadir a la realidad cualquier tipo de información, desde un simple texto informativo a un modelo 3D interactivo. Tiene infinitas utilidades, puede servir de guía en un museo, puede mostrar la recreación de un monumento destruido, o como en el caso de estudio aquí presentado, ayudar a la interpretación de pinturas rupestres. Esta tesis parte de la idea de que la RA puede mejorar mucho la interpretación del arte rupestre sin alterar ni dañar las pinturas. Puede servir para atraer a un público mayor, dar a conocer la historia de las pinturas rupestres y que al mismo tiempo el visitante tenga una experiencia mucho más enriquecedora. A lo largo de la tesis se ha estudiado en profundidad la técnica de visualización de RA mediante dispositivos móviles. Se han analizado las diferentes librerías de programación mediante casos de estudio en entornos reales y examinado los factores que pueden afectar al reconocimiento de las pinturas. Se ha desarrollado una aplicación de RA aplicada a un caso real de pinturas rupestres y posteriormente ha sido evaluada por un grupo de personas. Finalmente, se ha estudiado el efecto de la luz solar y sus cambios a lo largo del día sobre el reconocimiento de imágenes en entornos al aire libre. Este trabajo proporciona un punto de partida para el desarrollo de aplicaciones de RA aplicadas a la difusión del patrimonio cultural, especialmente centrado en el arte rupestre, un entorno que sufre de unas dificultades añadidas debido a su localización, dificultad de reconocimiento de puntos característicos en las pinturas y los cambios en la luz solar, problemas que se han tratado de resolver a lo largo del estudio. Las principales conclusiones han sido muy favorables, partiendo de librerías de programación disponibles y gratuitas. Se han podido desarrollar un conjunto de aplicaciones de RA en diferentes lugares. Las valoraciones han sido muy positivas, los usuarios que han probado las aplicaciones afirman que la interpretación de las pinturas les resulta más fácil y consiguen entender mejor el propósito de las mismas. El principal inconveniente encontrado es la falta de conocimiento sobre esta técnica y la pérdida de realismo en algunos casos debido a la oclusión, es decir, que los objetos virtuales no se posicionen por detrás de los objetos reales. La buena noticia es que esta tecnología evoluciona muy rápido y durante el desarrollo de la tesis ha habido avances muy grandes, entre ellos, el desarrollo de nuevas librerías de programación desarrolladas por Google y Apple, que proporcionan las herramientas necesarias para crear aplicaciones muy potentes e immersivas, donde el usuario se sentirá parte de los entornos creados.[CA] La RA consisteix en la superposició d'elements virtuals sobre l'entorn real, de manera que l'usuari percep aquests elements com si formaren part de la realitat que està visualitzant. Les aplicacions de RA en dispositius mòbils permeten visualitzar el contingut virtual a través de la cambra del dispositiu. La RA és una eina de divulgació molt potent ja que permet afegir a la realitat qualsevol tipus d'informació, des d'un simple text informatiu a un model 3D interactiu. Té infinites utilitats, pot servir de guia en un museu, pot mostrar la recreació d'un monument destruït, o com en el cas d'estudi ací presentat, ajudar a la interpretació de pintures rupestres. Aquesta tesi parteix de la idea que la RA pot millorar molt la interpretació de l'art rupestre sense alterar ni danyar les pintures. Pot servir per a atraure a un públic major, donar a conéixer la història de les pintures rupestres i que al mateix temps el visitant tinga una experiència molt més enriquidora. Al llarg de la tesi s'ha estudiat en profunditat la tècnica de visualització de RA mitjançant dispositius mòbils. S'han analitzat les diferents llibreries de programació mitjançant casos d'estudi en entorns reals i analitzat els factors que poden afectar el reconeixement de les pintures. S'ha desenvolupat una aplicació de RA aplicada a un cas real de pintures rupestres i posteriorment ha sigut avaluada per un grup de persones. Finalment, s'ha estudiat l'efecte de la llum solar i els seus canvis al llarg del dia sobre el reconeixement d'imatges en entorns a l'aire lliure. Aquest treball proporciona un punt de partida per al desenvolupament d'aplicacions de RA aplicades a la difusió del patrimoni cultural, especialment centrat en l'art rupestre, un entorn que pateix d'unes dificultats afegides a causa de la seua localització, dificultat de reconeixement de punts característics en les pintures i els canvis en la llum solar, problemes que s'han tractat de resoldre al llarg de l'estudi. Les principals conclusions han sigut molt favorables, partint de llibreries de programació disponibles i gratuïtes. S'han pogut desenvolupar un conjunt d'aplicacions de RA en diferents llocs. Les valoracions han sigut molt positives, els usuaris que han provat les aplicacions afirmen que la interpretació de les pintures els resulta més fàcil i aconsegueixen entendre millor el propòsit d'aquestes. El principal inconvenient trobat és la falta de coneixement sobre aquesta tècnica i la perduda de realisme en alguns casos a causa de l'oclusió, és a dir, que els objectes virtuals no es posicionen per darrere dels objectes reals. La bona notícia és que aquesta tecnologia evoluciona molt ràpid i durant el desenvolupament de la tesi hi ha hagut avanços molt grans, entre ells, el desenvolupament de noves llibreries de programació per Google i Apple, que proporcionen les eines necessàries per a crear aplicacions molt potents i immersives, on l'usuari se sentirà part dels entorns creats.[EN] AR consists of superimposing virtual elements on the real environment, so that the user perceives these elements as if they were part of the reality they are looking at. AR applications on smartphones allow virtual content to be visualised through the device's camera. AR is a very powerful tool for dissemination as it allows any type of information to be added to reality, from a simple informative text to an interactive 3D model. It can be used as a guide in a museum, it can show the recreation of a destroyed monument, or, as in the case study presented here, it can help in the interpretation of cave paintings. This thesis is based on the idea that AR can greatly enhance the interpretation of rock art without affecting or damaging the paintings. It can be used to attract a wider audience, to introduce the history of the rock art paintings and at the same time provide the visitor with a much more enriching experience. Throughout the thesis, the technique of AR visualisation using mobile devices has been studied in-depth. The different programming libraries have been analysed by means of case studies in real environments as well as the factors that can affect the paintings recognition. An AR application applied to a real case of rock art paintings has been developed and subsequently evaluated by a group of people. Finally, the effect of sunlight and its changes throughout the day on image recognition in outdoor environments has been studied. This work provides a starting point for the AR applications development applied to the dissemination of cultural heritage, especially focused on rock art, an environment that suffers from additional difficulties due to its location, the difficulty of characteristic points recognition and changes in sunlight, problems that have been tried to solve throughout the study. The main outcomes have been very favourable, using freely available programming libraries, and it has been possible to develop a set of AR applications in different places. The evaluations have been very positive, with users who have tested the applications confirming that the interpretation of the paintings is easier for them and they can better understand the purpose of the paintings. The major drawback is the lack of knowledge about this technique and the loss of realism in some cases due to occlusion, i.e. the virtual objects are not positioned behind the real objects. The good news is that this technology is evolving very fast and during the development of the thesis there have been great advances, among them, the development of new programming libraries developed by Google and Apple, which provide the necessary tools to create very powerful and immersive applications, where the user will feel part of the virtual environments created.Blanco Pons, S. (2021). Analysis and Development of Augmented Reality Applications for the Dissemination of Cultural Heritage [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/178895TESISCompendi