Augmented reality technology applications in museum tourism; examples from Turkey and throughout the World

Özellikle son yıllarda oldukça ön plana çıktığı göze çarpan kültürel turizmin bir parçası olan müze turizmi, günümüzde turizm sektörünün önemli bir unsuru haline gelmiştir. Müze turizmi, yerel ekonominin güçlenmesi için oldukça önemli olmasının yanı sıra öğrenmenin ve sosyalleşmenin de gerçekleşmesini sağlaması bakımından dikkat çekmektedir. Bugün müzecilik, aktif öğrenmenin sağlandığı sosyal ve kültürel mekanlar olma görevini üstlenmektedir. Dünyanın her yerinde önemli işlevlere sahip olan müzeler, ziyaretçi sayılarını koruma ya da artırma yönünde çaba göstermektedir. Bu sebeple rekabet halinde kalabilmek için modern teknolojilerden yararlanmak gerekli hale gelmiştir. Bu çalışmada, müzeciliğin sürdürülebilir olması bakımından artırılmış gerçeklik teknolojisinin rolü ve kullanım detayları, ağırlıklı olarak yurt dışında bulunan ve bu teknolojiyi uygulayan müzelerden çeşitli örnekler verilerek ortaya konmuştur. Çalışmada, Türkiye’de ve yabancı ülkelerde artırılmış gerçeklik teknolojisinden yararlanan müzeler araştırılmış, örneklendirilmiş ve bu yeni teknolojinin turizm ile ilişkisi irdelenerek müzeciliğin gelişimi açısından ve modern müzecilik anlayışında önemli rol oynadığı sonucuna varılmıştır.Museum tourism, which is a part of cultural tourism that attracts the attention to come to the forefront especially in recent years, today became an important element of tourism sector. Besides being important for boosting the local economy, museum tourism draws attention in terms of providing learning and socialization. Today, the museum has taken the task to be a social and cultural environment where active learning is provided. Museums that have important functions throughout the world make the effort to preserve or increase their number of visitors. That is why the use of modern technology became a necessity to stay competitive. In this study, the role and details of augmented reality technology in terms of sustainability of the museums has been revealed by giving various museum examples, mostly from abroad, that are using this technology. In the study, museums in Turkey and abroad using augmented reality were searched, exemplified and by analyzing the relation of this new technology with tourism, it has been determined that this technology plays an important role in the development and understanding of modern museolog

Augmented Reality Markerless Multi-Image Outdoor Tracking System for the Historical Buildings on Parliament Hill

[EN] Augmented Reality (AR) applications have experienced extraordinary growth recently, evolving into a well-established method for the dissemination and communication of content related to cultural heritage¿including education. AR applications have been used in museums and gallery exhibitions and virtual reconstructions of historic interiors. However, the circumstances of an outdoor environment can be problematic. This paper presents a methodology to develop immersive AR applications based on the recognition of outdoor buildings. To demonstrate this methodology, a case study focused on the Parliament Buildings National Historic Site in Ottawa, Canada has been conducted. The site is currently undergoing a multiyear rehabilitation program that will make access to parts of this national monument inaccessible to the public. AR experiences, including simulated photo merging of historic and present content, are proposed as one tool that can enrich the Parliament Hill visit during the rehabilitation. Outdoor AR experiences are limited by factors, such as variable lighting (and shadows) conditions, caused by changes in the environment (objects height and orientation, obstructions, occlusions), the weather, and the time of day. This paper proposes a workflow to solve some of these issues from a multi-image tracking approach.This work has been developed under the framework of the New Paradigms/New Tools for Heritage Conservation in Canada, a project funded through the Social Sciences and Humanities Research Council of Canada (SSHRC).Blanco-Pons, S.; Carrión-Ruiz, B.; Duong, M.; Chartrand, J.; Fai, S.; Lerma, JL. (2019). Augmented Reality Markerless Multi-Image Outdoor Tracking System for the Historical Buildings on Parliament Hill. Sustainability. 11(16):1-15. https://doi.org/10.3390/su11164268S1151116Bekele, M. K., Pierdicca, R., Frontoni, E., Malinverni, E. S., & Gain, J. (2018). A Survey of Augmented, Virtual, and Mixed Reality for Cultural Heritage. Journal on Computing and Cultural Heritage, 11(2), 1-36. doi:10.1145/3145534Gimeno, J., Portalés, C., Coma, I., Fernández, M., & Martínez, B. (2017). Combining traditional and indirect augmented reality for indoor crowded environments. A case study on the Casa Batlló museum. Computers & Graphics, 69, 92-103. doi:10.1016/j.cag.2017.09.001Kolivand, H., El Rhalibi, A., Shahrizal Sunar, M., & Saba, T. (2018). ReVitAge: Realistic virtual heritage taking shadows and sky illumination into account. Journal of Cultural Heritage, 32, 166-175. doi:10.1016/j.culher.2018.01.020Amakawa, J., & Westin, J. (2017). New Philadelphia: using augmented reality to interpret slavery and reconstruction era historical sites. International Journal of Heritage Studies, 24(3), 315-331. doi:10.1080/13527258.2017.1378909Kim, J.-B., & Park, C. (2011). Development of Mobile AR Tour Application for the National Palace Museum of Korea. Lecture Notes in Computer Science, 55-60. doi:10.1007/978-3-642-22021-0_7Barrile, V., Fotia, A., Bilotta, G., & De Carlo, D. (2019). Integration of geomatics methodologies and creation of a cultural heritage app using augmented reality. Virtual Archaeology Review, 10(20), 40. doi:10.4995/var.2019.10361Analysis of Tracking Accuracy for Single-Camera Square-Marker-Based Tracking. In Third Workshop on Virtual and Augmented Reality of the GI-Fachgruppe VR/AR, Koblenz, Germany, 2006http://campar.in.tum.de/Chair/PublicationDetail?pub=pentenrieder2006giCirulis, A., & Brigmanis, K. B. (2013). 3D Outdoor Augmented Reality for Architecture and Urban Planning. Procedia Computer Science, 25, 71-79. doi:10.1016/j.procs.2013.11.009You, S., Neumann, U., & Azuma, R. (1999). Orientation tracking for outdoor augmented reality registration. IEEE Computer Graphics and Applications, 19(6), 36-42. doi:10.1109/38.799738Wither, J., Tsai, Y.-T., & Azuma, R. (2011). Indirect augmented reality. Computers & Graphics, 35(4), 810-822. doi:10.1016/j.cag.2011.04.010Radkowski, R., & Oliver, J. (2013). Natural Feature Tracking Augmented Reality for On-Site Assembly Assistance Systems. Lecture Notes in Computer Science, 281-290. doi:10.1007/978-3-642-39420-1_30Rao, J., Qiao, Y., Ren, F., Wang, J., & Du, Q. (2017). A Mobile Outdoor Augmented Reality Method Combining Deep Learning Object Detection and Spatial Relationships for Geovisualization. Sensors, 17(9), 1951. doi:10.3390/s17091951Hoppe, H., DeRose, T., Duchamp, T., McDonald, J., & Stuetzle, W. (1993). Mesh optimization. Proceedings of the 20th annual conference on Computer graphics and interactive techniques - SIGGRAPH ’93. doi:10.1145/166117.166119Rossignac, J., & Borrel, P. (1993). Multi-resolution 3D approximations for rendering complex scenes. Modeling in Computer Graphics, 455-465. doi:10.1007/978-3-642-78114-8_29Gross, M. H., Staadt, O. G., & Gatti, R. (1996). Efficient triangular surface approximations using wavelets and quadtree data structures. IEEE Transactions on Visualization and Computer Graphics, 2(2), 130-143. doi:10.1109/2945.506225Botsch, M., Pauly, M., Rossl, C., Bischoff, S., & Kobbelt, L. (2006). Geometric modeling based on triangle meshes. ACM SIGGRAPH 2006 Courses on - SIGGRAPH ’06. doi:10.1145/1185657.1185839Pietroni, N., Tarini, M., & Cignoni, P. (2010). Almost Isometric Mesh Parameterization through Abstract Domains. IEEE Transactions on Visualization and Computer Graphics, 16(4), 621-635. doi:10.1109/tvcg.2009.96Khan, D., Yan, D.-M., Ding, F., Zhuang, Y., & Zhang, X. (2018). Surface remeshing with robust user-guided segmentation. Computational Visual Media, 4(2), 113-122. doi:10.1007/s41095-018-0107-yGuidi, G., Russo, M., Ercoli, S., Remondino, F., Rizzi, A., & Menna, F. (2009). A Multi-Resolution Methodology for the 3D Modeling of Large and Complex Archeological Areas. International Journal of Architectural Computing, 7(1), 39-55. doi:10.1260/147807709788549439Remondino, F., & El-Hakim, S. (2006). Image-based 3D Modelling: A Review. The Photogrammetric Record, 21(115), 269-291. doi:10.1111/j.1477-9730.2006.00383.xBruno, F., Bruno, S., De Sensi, G., Luchi, M.-L., Mancuso, S., & Muzzupappa, M. (2010). From 3D reconstruction to virtual reality: A complete methodology for digital archaeological exhibition. Journal of Cultural Heritage, 11(1), 42-49. doi:10.1016/j.culher.2009.02.006Unity, The Photogrammetry Workflowhttps://unity.com/solutions/photogrammetry.Blanco, S., Carrión, B., & Lerma, J. L. (2016). REVIEW OF AUGMENTED REALITY AND VIRTUAL REALITY TECHNIQUES IN ROCK ART. Proceedings of the ARQUEOLÓGICA 2.0 8th International Congress on Archaeology, Computer Graphics, Cultural Heritage and Innovation. doi:10.4995/arqueologica8.2016.3561Behzadan, A. H., & Kamat, V. R. (2010). Scalable Algorithm for Resolving Incorrect Occlusion in Dynamic Augmented Reality Engineering Environments. Computer-Aided Civil and Infrastructure Engineering, 25(1), 3-19. doi:10.1111/j.1467-8667.2009.00601.xTian, Y., Long, Y., Xia, D., Yao, H., & Zhang, J. (2015). Handling occlusions in augmented reality based on 3D reconstruction method. Neurocomputing, 156, 96-104. doi:10.1016/j.neucom.2014.12.081Tian, Y., Guan, T., & Wang, C. (2010). Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach. Sensors, 10(4), 2885-2900. doi:10.3390/s10040288

Mobile Augmented Reality for Hearing Impaired Museum Engagement (MARHIME): a conceptual model

Most Mobile Augmented Reality (MAR) applications for museum are largely tailored for normal visitors while the disabled such as hearing-impaired (HI) visitors are not well supported. This makes them to go through unpalatable experiences and eventually dissatisfy with their visit to the museum. In order to attract HI museum visitors’ interest, our study employs the concept of engagement through the use of the MAR application. Our recent finding revealed several MAR elements for museum HI visitors’ engagement. These elements include aesthetics, curiosity, usability, interaction, motivation, satisfaction, self-efficacy, perceived control, enjoyment, focused attention and interest. These elements which were extracted from a comprehensive literature review are then validated through expert reviews. A total of eleven elements were sent for review by the experts and they have validated six elements of engagement. This paper proposes a conceptual model of MAR for HI museum engagement (MARHIME).This model is expected to provide guidelines for developers in developing MAR applications that are able to engage HI museum visitors and make them satisfy with the museum visit. Our future work will develop the MARHIME application which will be validated by HI museum visitors

Dar luz a colecciones de cráneos precolombinos a través de técnicas de escaneado 3D de última generación

[EN] During the 19th and 20th centuries, numerous museums, scientific societies, and royal academies were founded in Europe and America. In this scenario, the Anthropological Museum Montané was founded in Havana, Cuba. Its collection has grown over the years, thanks to researchers, antiquarians, and amateurs. Since its foundation, the Museum Montané has become an essential institution for anthropological and archaeological research in the region. Nowadays, the Museum Montané, like other museums in developing countries, faces a challenge in the introduction of state-of-the-art technologies to digitizing exhibits and the creation of innovative projects to attract visitors. The current possibilities of virtualization of cultural heritage using digital technologies have a favorable impact on the preservation, access, and management of museum collections. The use of three-dimensional (3D) models fosters engagement with visitors, stimulates new forms of learning, and revalorizes the exhibits. In the current study, we use a hand-held structured light scanner to create 3D reality-based models of pre-Columbian crania from the Caribbean and South American collection of the Anthropological Museum Montané. The resulting 3D models were used for producing 3D printing replicas and animated videos. The 3D resources derived will encourage new knowledge through research, and provide broader access to these pre-Columbian crania collection through learning and outreach activities. The significance of digitizing these specimens goes beyond the creation of 3D models. It means protecting these fragile and valuable collections for future generations. The methodology and results reported here can be used in other museums with similar collections to digitally document, study, protect, and disseminate the archaeological heritage. Going forward, we seek to continue exploring the application of novel methods and digital techniques to the study of the pre-Columbian crania collections in Latin American and the Caribbean area.Highlights:A hand-held structured light scanner was used to acquire 3D reality-based models of pre-Columbian crania. The 3D models resulting were used for 3D printing replicas and 3D animations.This study provides unprecedented 3D reconstructions of pre-Columbian crania in the Caribbean area, and new 3D reconstructions of artificially deformed crania from South America.The 3D resources created will encourage new knowledge through research, and provide broader access to these pre-Columbian crania collection through learning and outreach activities.[ES] Durante los siglos XIX y XX numerosos museos, sociedades científicas y academias reales fueron fundados en Europa y América. En este escenario, el Museo Antropológico Montané fue fundado en La Habana, Cuba. Su colección ha crecido con los años, gracias a investigadores, anticuarios y aficionados. Desde su fundación, el Museo Montané se ha convertido en una institución esencial para la investigación antropológica y arqueológica de la región. Actualmente, el Museo Montané, como otros museos de países en desarrollo, se enfrenta a un reto en la introducción de tecnologías avanzadas para digitalizar las colecciones y la creación de proyectos innovadores para atraer visitantes. Las posibilidades actuales de virtualización del patrimonio cultural mediante tecnologías digitales repercuten favorablemente en la conservación, el acceso y gestión de las colecciones de los museos. El uso de modelos tridimensionales (3D) fomenta el compromiso con los visitantes, estimula nuevas formas de aprendizaje y revaloriza las exposiciones. En este estudio, utilizamos un escáner de luz estructurada portátil para crear modelos 3D, basados en la realidad, de cráneos precolombinos de la colección del Caribe y Sudamérica del Museo Montané. Los modelos 3D resultantes se utilizaron para producir réplicas impresas en 3D y vídeos animados. Los recursos 3D derivados fomentarán nuevos conocimientos mediante la investigación y proporcionarán un acceso más amplio a estas colecciones de cráneos precolombinos mediante actividades de aprendizaje y divulgación. La importancia de la digitalización de estos especímenes va más allá de la creación de modelos 3D. Significa proteger estas frágiles y valiosas colecciones para futuras generaciones. La metodología y los resultados reportados pueden ser utilizados en otros museos con colecciones similares para documentar, estudiar, proteger y difundir digitalmente el patrimonio arqueológico. En el futuro, continuaremos explorando la aplicación de métodos y técnicas digitales para el estudio de colecciones de cráneos precolombinos en América Latina y el Caribe.We thank the reviewers and editors for constructive comments provided. 3D models were generated using the Artec Space Spider scanner, software, and hardware facilities of the Digital Mapping and 3D Analysis Laboratory (CENIEH). Gizéh Rangel-de Lázaro is supported by the Spanish Government (PGC2018-093925-B-C32).Rangel-De Lázaro, G.; Martínez-Fernández, A.; Rangel-Rivero, A.; Benito-Calvo, A. (2021). Shedding light on pre-Columbian crania collections through state-of-the-art 3D scanning techniques. Virtual Archaeology Review. 12(24):1-10. https://doi.org/10.4995/var.2021.13742OJS1101224Artec3D. (2019). Professional 3D scanning solutions Offices.Berquist, S., Spence-Morrow, G., Gonzalez-Macqueen, F., Rizzuto, B., Álvarez, W. Y., Bautista, S., & Jennings, J. (2018). A new aerial photogrammetric survey method for recording inaccessible rock art. Digital Applications in Archaeology and Cultural Heritage, 8, 46-56. https://doi.org/10.1016/j.daach.2018.03.001Boylan, P. J. (2004). Running a museum: a practical handbook. Paris: ICOM.Champion, E., & Rahaman, H. (2020). Survey of 3D Digital Heritage Repositories and Platforms. Virtual Archaeology Review, 11(23), 1-15. https://doi.org/10.4995/var.2020.13226Charlier, P., Kissel, E., Moulherat, C., Kimmel, P. A., Fur, Y. Le, Fontaine, M. A., Veynachter, M., Jacqueline, S., Deo, S., Huynh, I., & Gorincour, G. (2020). First in-situ use of a mobile CT-scan for museum artefacts: the quai Branly - Jacques Chirac museum experience. Forensic Imaging, 200365. https://doi.org/10.1016/j.fri.2020.200365Cooper, C. (2019). You Can Handle It: 3D Printing for Museums. Advances in Archaeological Practice, 7(4), 443-447. https://doi.org/10.1017/aap.2019.39Cosculluela, J. A. (1918). Cuatro años en la Ciénaga de Zapata. La Habana: Imprenta y Papelería La Universal de Ruiz y Ca.Curet, L. Antonio. (2011). Colonialism and the History of Archaeology in the Spanish Caribbean. In L. Lozny (Ed.), Comparative Archaeologies (pp. 641-672). New York: Springer. https://doi.org/10.1007/978-1-4419-8225-4_19Dacal Moure, R., & Rivero de la Calle, M. (1986). Arqueología aborigen de Cuba. La Habana: Editorial Gente Nueva.Dacal Moure, R., & Watters, D. R. (2005). Three Stages in the History of Cuban Archaeology. In L. A. Curet, S. L. Dawdy, & G. La Rosa Corzo (Eds.), Dialogues in Cuban Archaeology (pp. 30-40). Tuscaloosa: University of Alabama Press.de la Torre Huerta, C. (1890). Conferencia Científica. Anales de La Real Academia de Ciencias Médicas, Físicas y Naturales de La Habana, 27, 325-343.de las Casas, B. (1875). Historia de las Indias. Madrid: Imprenta de Miguel Ginesta.Erolin, C., Jarron, M., & Csetenyi, L. J. (2017). Zoology 3D: Creating a digital collection of specimens from the D′Arcy Thompson Zoology Museum. Digital Applications in Archaeology and Cultural Heritage, 7, 51-55. https://doi.org/10.1016/j.daach.2017.11.002Farazis, G., Thomopoulos, C., Bourantas, C., Mitsigkola, S., & Thomopoulos, S. C. (2019). Digital approaches for public outreach in cultural heritage: The case study of iGuide Knossos and Ariadne's Journey. Digital Applications in Archaeology and Cultural Heritage, 15, e00126. https://doi.org/10.1016/j.daach.2019.e00126Fazio, L., & Brutto, M. L. (2020). 3D survey for the archaeological study and virtual reconstruction of the sanctuary of ISIS in the ancient lilybaeum (Italy). Virtual Archaeology Review, 11(22), 1-14. https://doi.org/10.4995/var.2020.11928Fenu, C., & Pittarello, F. (2018). Svevo tour: The design and the experimentation of an augmented reality application for engaging visitors of a literary museum. Int. J. Human-Computer Studies, 114, 20-35. https://doi.org/10.1016/j.ijhcs.2018.01.009Gillespie, S. D., & Volk, M. (2014). A 3d model of complex A, la Venta, Mexico. Digital Applications in Archaeology and Cultural Heritage, 1(3-4), 72-81. https://doi.org/10.1016/j.daach.2014.06.001Gimeno, J., Portalés, C., Coma, I., Fernández, M., & Martínez, B. (2017). Combining traditional and indirect augmented reality for indoor crowded environments. A case study on the Casa Batlló museum. Computers & Graphics, 69, 94-105. https://doi.org/10.1016/j.cag.2017.09.001Giuseppantonio Di Franco, P., Camporesi, C., Galeazzi, F., & Kallmann, M. (2015). 3D Printing and Immersive Visualization for Improved Perception of Ancient Artifacts. Presence, 24(3), 243-264. https://doi.org/10.1162/PRES_a_00229Hixon, S. W., Lipo, C. P., Hunt, T. L., & Lee, C. (2018). Using Structure from Motion Mapping to Record and Analyze Details of the Colossal Hats (Pukao) of Monumental Statues on Rapa Nui (Easter Island). Advances in Archaeological Practice, 6(1), 42-57. https://doi.org/10.1017/aap.2017.28Kosmopoulos, D., & Styliaras, G. (2018). A survey on developing personalized content services in museums. Pervasive and Mobile Computing, 47, 54-77. https://doi.org/10.1016/j.pmcj.2018.05.002Kuzminsky, S. C., & Gardiner, M. S. (2012). Three-dimensional laser scanning: potential uses for museum conservation and scientific research. Journal of Archaeological Science, 39(8), 2744-2751. https://doi.org/10.1016/j.jas.2012.04.020Kuzminsky, S. C., Tung, T. A., Hubbe, M., & Villaseñor-Marchal, A. (2016). The application of 3D geometric morphometrics and laser surface scanning to investigate the standardization of cranial vault modification in the Andes. Journal of Archaeological Science: Reports, 10, 507-513. https://doi.org/10.1016/j.jasrep.2016.11.007Liang, H., Li, W., & Zhang, Q. (2019). Semantic-based 3D information modelling and documentation of rockeries in Chinese classical gardens: A case study on the rockery at Huanxiu Shanzhuang, Suzhou, China. Journal of Cultural Heritage, 37, 247-258. https://doi.org/10.1016/j.culher.2018.11.015Magnani, M., Guttorm, A., & Magnani, N. (2018). Three-dimensional, community-based heritage management of indigenous museum collections: Archaeological ethnography, revitalization and repatriation at the Sámi Museum Siida. Journal of Cultural Heritage, 31, 162-169. https://doi.org/10.1016/j.culher.2017.12.001Michelena Zubieta, J. (1890). Contribución al estudio de la antropología cubana. Ensayo craneológico de un indio caribe. (Thesis, Archivo de la Universidad de La Habana, Fondo Histórico Administrativo, Cuba).Montané Dardé, L. E. (1907). En la Sierra de Banao. Revista de La Facultad de Letras y Ciencias, May, 45-46.Moore, J. D. (2014). A prehistory of South America. Colorado:University Press of Colorado.Morris, M. (2017). Managing people and projects in museums: strategies that work. London: Rowman & Littlefield.Novotny, A. C. (2019). Implementing Photogrammetry in Three Bioarchaeological Contexts: Steps for In-Field Documentation. Advances in Archaeological Practice, 7(1), 87-96. https://doi.org/10.1017/aap.2018.45Núñez Andrés, A., Buill Pozuelo, F., Regot Marimón, J., & de Mesa Gisbert, A. (2012). Generation of virtual models of cultural heritage. Journal of Cultural Heritage, 13(1), 103-106. https://doi.org/10.1016/j.culher.2011.06.004Payne, E. M. (2019). 3D imaging of the Parthenon sculptures: an assessment of the archaeological value of nineteenth-century plaster casts. Antiquity, 93(372), 1625-1642. https://doi.org/10.15184/aqy.2019.179Pierdicca, R. (2018). Mapping Chimu's settlements for conservation purposes using UAV and close range photogrammetry. The virtual reconstruction of Palacio Tschudi, Chan Chan, Peru. Digital Applications in Archaeology and Cultural Heritage, 8, 27-34. https://doi.org/10.1016/j.daach.2017.11.004Portuondo, F. (1977). El Segundo Viaje de Descubrimiento. La Habana: Editorial de Ciencias Sociales.Rangel‐de Lázaro, G. (2020). Tracing craniovascular traits in artificially modified pre‐Columbian crania from Cuba, the largest Caribbean archipelago. International Journal of Osteoarchaeology, 1-6. https://doi.org/10.1002/OA.2947Rangel Rivero, A. (2012). Antropología en Cuba: Orígenes y desarrollo. La Habana: Fundación Fernando Ortiz.Rangel Rivero, A. (2018). Los estudios sobre arqueología aborigen en Cuba: Teorías y Apreciaciones. In A. Rangel Rivero & J. A. Larramendi Joa (Eds.), Cuba: Arqueología y legado histórico (pp. 17-39). Ciudad de Guatemala: Ediciones Polymita S.A.Renfrew, C., & Bahn, P. G. (1996). Archaeology: Theories, methods, and practice. London: Thames and Hudson.Rivero de la Calle, M. (2002). Nociones de Anatomía humana aplicada a la Arqueología. La Habana: Félix Varela.Robson, S., MacDonald, S., Were, G., & Hess, M. (2012). 3D recording and museums. In C. Warwick, M. Terras, & J. Nyhan (Eds.), Digital Humanities in Practice (pp. 91-116). London: Facet. https://doi.org/10.29085/9781856049054.006Rodríguez Miranda, Á., Valle Melón, J. M., Calparsoro, E., & Iñañez, J. G. (2017). Study, revalorization and virtual musealization of a ceramic kiln based on information gathered from old excavations. Digital Applications in Archaeology and Cultural Heritage, 7, 1-9. https://doi.org/10.1016/j.daach.2017.08.003Santos, P., Ritz, M., Fuhrmann, C., & Fellner, D. (2017). 3D mass digitization: A milestone for archaeological documentation. Virtual Archaeology Review, 8(16), 1-11. https://doi.org/10.4995/var.2017.6321Schultz, E. (1990). Notes on the history of collecting and of museums. Journal of the History of Collections, 2(2), 205-218. https://doi.org/10.1093/jhc/2.2.205Styliani, S., Fotis, L., Kostas, K., & Petros, P. (2009). Virtual museums, a survey and some issues for consideration. Journal of Cultural Heritage, 10, 520-528. https://doi.org/10.1016/j.culher.2009.03.003Stylianidis, E., & Remondino, F. (2016). 3D Recording, Documentation and Management of Cultural Heritage. Dunbeath: Whittles Publishing.Vega, M. (1826). Historia del descubrimiento de la América Septentrional por Cristóbal Colón (C. M. Bustamante (ed.)). Mexico: Oficina de la Testamentaria de Ontiveros.Vermeeren, A., Calvi, L., & Sabiescu, A. (Eds.) (2018). Museum experience design : crowds, ecosystems and novel technologies. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-58550-5Verona, L., Vivacqua, A. S., & Campos, M. L. M. (2018). Interactive and Social Technology: Challenges and Opportunities for Museums and Heritage Institutions in Latin America. In A. Vermeeren, L. Calvi, & A. Sabiescu (Eds.), Springer Series on Cultural Computing (pp. 225-238). Cham: Springer. https://doi.org/10.1007/978-3-319-58550-5_11Weber, G. (1974). Science and society in nineteenth century anthropology. History of Science; an Annual Review of Literature, Research and Teaching, 12(4), 260-283. https://doi.org/10.1177/007327537401200402Younan, S., & Treadaway, C. (2015). Digital 3D models of heritage artefacts: Towards a digital dream space. Digital Applications in Archaeology and Cultural Heritage, 2(4), 240-247. https://doi.org/10.1016/j.daach.2015.11.001Zhang, X., Blaas, J., Botha, C., Reischig, P., Bravin, A., & Dik, J. (2012). Process for the 3D virtual reconstruction of a microcultural heritage artifact obtained by synchrotron radiation CT technology using open source and free software. Journal of Cultural Heritage, 13(2), 221-225. https://doi.org/10.1016/j.culher.2011.08.00

Analysis and Development of Augmented Reality Applications for the Dissemination of Cultural Heritage

Tesis por compendio[ES] La RA consiste en la superposición de elementos virtuales sobre el entorno real, de manera que el usuario percibe estos elementos como si formaran parte de la realidad que está visualizando. Las aplicaciones de RA en dispositivos móviles permiten visualizar el contenido virtual a través de la cámara del dispositivo. La RA es una herramienta de divulgación muy potente ya que permite añadir a la realidad cualquier tipo de información, desde un simple texto informativo a un modelo 3D interactivo. Tiene infinitas utilidades, puede servir de guía en un museo, puede mostrar la recreación de un monumento destruido, o como en el caso de estudio aquí presentado, ayudar a la interpretación de pinturas rupestres. Esta tesis parte de la idea de que la RA puede mejorar mucho la interpretación del arte rupestre sin alterar ni dañar las pinturas. Puede servir para atraer a un público mayor, dar a conocer la historia de las pinturas rupestres y que al mismo tiempo el visitante tenga una experiencia mucho más enriquecedora. A lo largo de la tesis se ha estudiado en profundidad la técnica de visualización de RA mediante dispositivos móviles. Se han analizado las diferentes librerías de programación mediante casos de estudio en entornos reales y examinado los factores que pueden afectar al reconocimiento de las pinturas. Se ha desarrollado una aplicación de RA aplicada a un caso real de pinturas rupestres y posteriormente ha sido evaluada por un grupo de personas. Finalmente, se ha estudiado el efecto de la luz solar y sus cambios a lo largo del día sobre el reconocimiento de imágenes en entornos al aire libre. Este trabajo proporciona un punto de partida para el desarrollo de aplicaciones de RA aplicadas a la difusión del patrimonio cultural, especialmente centrado en el arte rupestre, un entorno que sufre de unas dificultades añadidas debido a su localización, dificultad de reconocimiento de puntos característicos en las pinturas y los cambios en la luz solar, problemas que se han tratado de resolver a lo largo del estudio. Las principales conclusiones han sido muy favorables, partiendo de librerías de programación disponibles y gratuitas. Se han podido desarrollar un conjunto de aplicaciones de RA en diferentes lugares. Las valoraciones han sido muy positivas, los usuarios que han probado las aplicaciones afirman que la interpretación de las pinturas les resulta más fácil y consiguen entender mejor el propósito de las mismas. El principal inconveniente encontrado es la falta de conocimiento sobre esta técnica y la pérdida de realismo en algunos casos debido a la oclusión, es decir, que los objetos virtuales no se posicionen por detrás de los objetos reales. La buena noticia es que esta tecnología evoluciona muy rápido y durante el desarrollo de la tesis ha habido avances muy grandes, entre ellos, el desarrollo de nuevas librerías de programación desarrolladas por Google y Apple, que proporcionan las herramientas necesarias para crear aplicaciones muy potentes e immersivas, donde el usuario se sentirá parte de los entornos creados.[CA] La RA consisteix en la superposició d'elements virtuals sobre l'entorn real, de manera que l'usuari percep aquests elements com si formaren part de la realitat que està visualitzant. Les aplicacions de RA en dispositius mòbils permeten visualitzar el contingut virtual a través de la cambra del dispositiu. La RA és una eina de divulgació molt potent ja que permet afegir a la realitat qualsevol tipus d'informació, des d'un simple text informatiu a un model 3D interactiu. Té infinites utilitats, pot servir de guia en un museu, pot mostrar la recreació d'un monument destruït, o com en el cas d'estudi ací presentat, ajudar a la interpretació de pintures rupestres. Aquesta tesi parteix de la idea que la RA pot millorar molt la interpretació de l'art rupestre sense alterar ni danyar les pintures. Pot servir per a atraure a un públic major, donar a conéixer la història de les pintures rupestres i que al mateix temps el visitant tinga una experiència molt més enriquidora. Al llarg de la tesi s'ha estudiat en profunditat la tècnica de visualització de RA mitjançant dispositius mòbils. S'han analitzat les diferents llibreries de programació mitjançant casos d'estudi en entorns reals i analitzat els factors que poden afectar el reconeixement de les pintures. S'ha desenvolupat una aplicació de RA aplicada a un cas real de pintures rupestres i posteriorment ha sigut avaluada per un grup de persones. Finalment, s'ha estudiat l'efecte de la llum solar i els seus canvis al llarg del dia sobre el reconeixement d'imatges en entorns a l'aire lliure. Aquest treball proporciona un punt de partida per al desenvolupament d'aplicacions de RA aplicades a la difusió del patrimoni cultural, especialment centrat en l'art rupestre, un entorn que pateix d'unes dificultats afegides a causa de la seua localització, dificultat de reconeixement de punts característics en les pintures i els canvis en la llum solar, problemes que s'han tractat de resoldre al llarg de l'estudi. Les principals conclusions han sigut molt favorables, partint de llibreries de programació disponibles i gratuïtes. S'han pogut desenvolupar un conjunt d'aplicacions de RA en diferents llocs. Les valoracions han sigut molt positives, els usuaris que han provat les aplicacions afirmen que la interpretació de les pintures els resulta més fàcil i aconsegueixen entendre millor el propòsit d'aquestes. El principal inconvenient trobat és la falta de coneixement sobre aquesta tècnica i la perduda de realisme en alguns casos a causa de l'oclusió, és a dir, que els objectes virtuals no es posicionen per darrere dels objectes reals. La bona notícia és que aquesta tecnologia evoluciona molt ràpid i durant el desenvolupament de la tesi hi ha hagut avanços molt grans, entre ells, el desenvolupament de noves llibreries de programació per Google i Apple, que proporcionen les eines necessàries per a crear aplicacions molt potents i immersives, on l'usuari se sentirà part dels entorns creats.[EN] AR consists of superimposing virtual elements on the real environment, so that the user perceives these elements as if they were part of the reality they are looking at. AR applications on smartphones allow virtual content to be visualised through the device's camera. AR is a very powerful tool for dissemination as it allows any type of information to be added to reality, from a simple informative text to an interactive 3D model. It can be used as a guide in a museum, it can show the recreation of a destroyed monument, or, as in the case study presented here, it can help in the interpretation of cave paintings. This thesis is based on the idea that AR can greatly enhance the interpretation of rock art without affecting or damaging the paintings. It can be used to attract a wider audience, to introduce the history of the rock art paintings and at the same time provide the visitor with a much more enriching experience. Throughout the thesis, the technique of AR visualisation using mobile devices has been studied in-depth. The different programming libraries have been analysed by means of case studies in real environments as well as the factors that can affect the paintings recognition. An AR application applied to a real case of rock art paintings has been developed and subsequently evaluated by a group of people. Finally, the effect of sunlight and its changes throughout the day on image recognition in outdoor environments has been studied. This work provides a starting point for the AR applications development applied to the dissemination of cultural heritage, especially focused on rock art, an environment that suffers from additional difficulties due to its location, the difficulty of characteristic points recognition and changes in sunlight, problems that have been tried to solve throughout the study. The main outcomes have been very favourable, using freely available programming libraries, and it has been possible to develop a set of AR applications in different places. The evaluations have been very positive, with users who have tested the applications confirming that the interpretation of the paintings is easier for them and they can better understand the purpose of the paintings. The major drawback is the lack of knowledge about this technique and the loss of realism in some cases due to occlusion, i.e. the virtual objects are not positioned behind the real objects. The good news is that this technology is evolving very fast and during the development of the thesis there have been great advances, among them, the development of new programming libraries developed by Google and Apple, which provide the necessary tools to create very powerful and immersive applications, where the user will feel part of the virtual environments created.Blanco Pons, S. (2021). Analysis and Development of Augmented Reality Applications for the Dissemination of Cultural Heritage [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/178895TESISCompendi

Augmented Reality for the Presentation of Cultural Heritage: On-Site Application and Evaluation of a Model

 This paper comes out of a scientific study concerning development of an AR model for the presentation the archaeological site of Alexandria Troas for the visitor experience, and on-site application of this model, through a case, namely the Podium (or Forum) Temple, to investigate the nature of that experience provided by AR and its implications as well. The study is established upon the proposition that “AR is tailored to fit to provide a compatible, accessible, and sustainable presentation of historical built environments and archeological sites to public experience, while respecting much of the problem(atics) coming along with norms and privileges of historical heritage preservation and conservation.” Departing from this ultimate proposition, it sets out a framework of questions to address. This paper provides a summary of the whole research, followed by the detailed description of the methodology and process concerning the developed model’s on-site application, and a succinct presentation of its findings, finally, an account of the research as a means of testing the research questions. Findings confirm much of the assumptions deriving from the initial proposition and showed the great potential of AR towards this end as expected. A number of issues and problems were surfaced as well, some of which are oriented from the technologies concerning the AR itself, while others are related to the limitations of the proposed model and its on-site execution. Furthermore, the research indicated a number of matters to address and possible ways to expand such research. All in all, we argue that the research yielded a number of valuable results and insights in addressing the departing problem situation, while it also posed new questions and research paths to follow for new research

Pose estimation system based on monocular cameras

Our world is full of wonders. It is filled with mysteries and challenges, which through the ages inspired and called for the human civilization to grow itself, either philosophically or sociologically. In time, humans reached their own physical limitations; nevertheless, we created technology to help us overcome it. Like the ancient uncovered land, we are pulled into the discovery and innovation of our time. All of this is possible due to a very human characteristic - our imagination. The world that surrounds us is mostly already discovered, but with the power of computer vision (CV) and augmented reality (AR), we are able to live in multiple hidden universes alongside our own. With the increasing performance and capabilities of the current mobile devices, AR is what we dream it can be. There are still many obstacles, but this future is already our reality, and with the evolving technologies closing the gap between the real and the virtual world, soon it will be possible for us to surround ourselves into other dimensions, or fuse them with our own. This thesis focuses on the development of a system to predict the camera’s pose estimation in the real-world regarding to the virtual world axis. The work was developed as a sub-module integrated on the M5SAR project: Mobile Five Senses Augmented Reality System for Museums, aiming to a more immerse experience with the total or partial replacement of the environments’ surroundings. It is based mainly on man-made buildings indoors and their typical rectangular cuboid shape. With the possibility of knowing the user’s camera direction, we can then superimpose dynamic AR content, inviting the user to explore the hidden worlds. The M5SAR project introduced a new way to explore the existent historical museums by exploring the human’s five senses: hearing, smell, taste, touch, vision. With this innovative technology, the user is able to enhance their visitation and immerse themselves into a virtual world blended with our reality. A mobile device application was built containing an innovating framework: MIRAR - Mobile Image Recognition based Augmented Reality - containing object recognition, navigation, and additional AR information projection in order to enrich the users’ visit, providing an intuitive and compelling information regarding the available artworks, exploring the hearing and vision senses. A device specially designed was built to explore the additional three senses: smell, taste and touch which, when attached to a mobile device, either smartphone or tablet, would pair with it and automatically react in with the offered narrative related to the artwork, immersing the user with a sensorial experience. As mentioned above, the work presented on this thesis is relative to a sub-module of the MIRAR regarding environment detection and the superimposition of AR content. With the main goal being the full replacement of the walls’ contents, and with the possibility of keeping the artwork visible or not, it presented an additional challenge with the limitation of using only monocular cameras. Without the depth information, any 2D image of an environment, to a computer doesn’t represent the tridimensional layout of the real-world dimensions. Nevertheless, man-based building tends to follow a rectangular approach to divisions’ constructions, which allows for a prediction to where the vanishing point on any environment image may point, allowing the reconstruction of an environment’s layout from a 2D image. Furthermore, combining this information with an initial localization through an improved image recognition to retrieve the camera’s spatial position regarding to the real-world coordinates and the virtual-world, alas, pose estimation, allowed for the possibility of superimposing specific localized AR content over the user’s mobile device frame, in order to immerse, i.e., a museum’s visitor into another era correlated to the present artworks’ historical period. Through the work developed for this thesis, it was also presented a better planar surface in space rectification and retrieval, a hybrid and scalable multiple images matching system, a more stabilized outlier filtration applied to the camera’s axis, and a continuous tracking system that works with uncalibrated cameras and is able to achieve particularly obtuse angles and still maintain the surface superimposition. Furthermore, a novelty method using deep learning models for semantic segmentation was introduced for indoor layout estimation based on monocular images. Contrary to the previous developed methods, there is no need to perform geometric calculations to achieve a near state of the art performance with a fraction of the parameters required by similar methods. Contrary to the previous work presented on this thesis, this method performs well even in unseen and cluttered rooms if they follow the Manhattan assumption. An additional lightweight application to retrieve the camera pose estimation is presented using the proposed method.O nosso mundo está repleto de maravilhas. Está cheio de mistérios e desafios, os quais, ao longo das eras, inspiraram e impulsionaram a civilização humana a evoluir, seja filosófica ou sociologicamente. Eventualmente, os humanos foram confrontados com os seus limites físicos; desta forma, criaram tecnologias que permitiram superá-los. Assim como as terras antigas por descobrir, somos impulsionados à descoberta e inovação da nossa era, e tudo isso é possível graças a uma característica marcadamente humana: a nossa imaginação. O mundo que nos rodeia está praticamente todo descoberto, mas com o poder da visão computacional (VC) e da realidade aumentada (RA), podemos viver em múltiplos universos ocultos dentro do nosso. Com o aumento da performance e das capacidades dos dispositivos móveis da atualidade, a RA pode ser exatamente aquilo que sonhamos. Continuam a existir muitos obstáculos, mas este futuro já é o nosso presente, e com a evolução das tecnologias a fechar o fosso entre o mundo real e o mundo virtual, em breve será possível cercarmo-nos de outras dimensões, ou fundi-las dentro da nossa. Esta tese foca-se no desenvolvimento de um sistema de predição para a estimação da pose da câmara no mundo real em relação ao eixo virtual do mundo. Este trabalho foi desenvolvido como um sub-módulo integrado no projeto M5SAR: Mobile Five Senses Augmented Reality System for Museums, com o objetivo de alcançar uma experiência mais imersiva com a substituição total ou parcial dos limites do ambiente. Dedica-se ao interior de edifícios de arquitetura humana e a sua típica forma de retângulo cuboide. Com a possibilidade de saber a direção da câmara do dispositivo, podemos então sobrepor conteúdo dinâmico de RA, num convite ao utilizador para explorar os mundos ocultos. O projeto M5SAR introduziu uma nova forma de explorar os museus históricos existentes através da exploração dos cinco sentidos humanos: a audição, o cheiro, o paladar, o toque e a visão. Com essa tecnologia inovadora, o utilizador pode engrandecer a sua visita e mergulhar num mundo virtual mesclado com a nossa realidade. Uma aplicação para dispositivo móvel foi criada, contendo uma estrutura inovadora: MIRAR - Mobile Image Recognition based Augmented Reality - a possuir o reconhecimento de objetos, navegação e projeção de informação de RA adicional, de forma a enriquecer a visita do utilizador, a fornecer informação intuitiva e interessante em relação às obras de arte disponíveis, a explorar os sentidos da audição e da visão. Foi também desenhado um dispositivo para exploração em particular dos três outros sentidos adicionais: o cheiro, o toque e o sabor. Este dispositivo, quando afixado a um dispositivo móvel, como um smartphone ou tablet, emparelha e reage com este automaticamente com a narrativa relacionada à obra de arte, a imergir o utilizador numa experiência sensorial. Como já referido, o trabalho apresentado nesta tese é relativo a um sub-módulo do MIRAR, relativamente à deteção do ambiente e a sobreposição de conteúdo de RA. Sendo o objetivo principal a substituição completa dos conteúdos das paredes, e com a possibilidade de manter as obras de arte visíveis ou não, foi apresentado um desafio adicional com a limitação do uso de apenas câmaras monoculares. Sem a informação relativa à profundidade, qualquer imagem bidimensional de um ambiente, para um computador isso não se traduz na dimensão tridimensional das dimensões do mundo real. No entanto, as construções de origem humana tendem a seguir uma abordagem retangular às divisões dos edifícios, o que permite uma predição de onde poderá apontar o ponto de fuga de qualquer ambiente, a permitir a reconstrução da disposição de uma divisão através de uma imagem bidimensional. Adicionalmente, ao combinar esta informação com uma localização inicial através de um reconhecimento por imagem refinado, para obter a posição espacial da câmara em relação às coordenadas do mundo real e do mundo virtual, ou seja, uma estimativa da pose, foi possível alcançar a possibilidade de sobrepor conteúdo de RA especificamente localizado sobre a moldura do dispositivo móvel, de maneira a imergir, ou seja, colocar o visitante do museu dentro de outra era, relativa ao período histórico da obra de arte em questão. Ao longo do trabalho desenvolvido para esta tese, também foi apresentada uma melhor superfície planar na recolha e retificação espacial, um sistema de comparação de múltiplas imagens híbrido e escalável, um filtro de outliers mais estabilizado, aplicado ao eixo da câmara, e um sistema de tracking contínuo que funciona com câmaras não calibradas e que consegue obter ângulos particularmente obtusos, continuando a manter a sobreposição da superfície. Adicionalmente, um algoritmo inovador baseado num modelo de deep learning para a segmentação semântica foi introduzido na estimativa do traçado com base em imagens monoculares. Ao contrário de métodos previamente desenvolvidos, não é necessário realizar cálculos geométricos para obter um desempenho próximo ao state of the art e ao mesmo tempo usar uma fração dos parâmetros requeridos para métodos semelhantes. Inversamente ao trabalho previamente apresentado nesta tese, este método apresenta um bom desempenho mesmo em divisões sem vista ou obstruídas, caso sigam a mesma premissa Manhattan. Uma leve aplicação adicional para obter a posição da câmara é apresentada usando o método proposto

Applying Axial Symmetries to Historical Silk Fabrics: SILKNOW's Virtual Loom

Symmetry is part of textile art in patterns and motifs that decorate fabrics, which are made by the interlacement of warp and wefts. Moreover, the 3D representation of fabrics have already been studied by some authors; however, they have not specifically dealt with preserving historical weaving techniques. In this paper, we present the SILKNOW's Virtual Loom, a tool intended to document, preserve and reproduce silk historical weaving techniques from the 15th to the 19th centuries. We focus on the symmetry function and its contribution to art history, textile conservation, and modern design. We analyzed 2028 records from Garin 1820 datasets¿a historical industry that still weaves with these techniques¿and we reconstructed some historical designs that presented different types of defects. For those images (including fabrics and drawings) that had a symmetrical axis, we applied the symmetry functionality allowing to reconstruct missing parts. Thanks to these results, we were able to verify the usefulness of the Virtual Loom for conservation, analysis and new interpretative advantages, thanks to symmetry analysis applied to historical fabrics

Usability framework for mobile augmented reality language learning

After several decades since its introduction, the existing ISO9241-11 usability framework is still vastly used in Mobile Augmented Reality (MAR) language learning. The existing framework is generic and can be applied to diverse emerging technologies such as electronic and mobile learning. However, technologies like MAR have interaction properties that are significantly unique and require different usability processes. Hence, implementing the existing framework on MAR can lead to non-optimized, inefficient, and ineffective outcomes. Furthermore, state-of-the-art analysis models such as machine learning are not apparent in MAR usability studies, despite evidence of positive outcomes in other learning technologies. In recent MAR learning studies, machine learning benefits such as problem identification and prioritization were non-existent. These setbacks could slow down the advancement of MAR language learning, which mainly aims to improve language proficiency among MAR users, especially in English communication. Therefore, this research proposed the Usability Framework for MAR (UFMAR) that addressed the currently identified research problems and gaps in language learning. UFMAR introduced an improved data collection method called Individual Interaction Clustering-based Usability Measuring Instrument (IICUMI), followed by a machine learning-driven analysis model called Clustering-based Usability Prioritization Analysis (CUPA) and a prioritization quantifier called Usability Clustering Prioritization Model (UCPM). UFMAR showed empirical evidence of significantly improving usability in MAR, capitalizing on its unique interaction properties. UFMAR enhanced the existing framework with new abilities to systematically identify and prioritize MAR usability issues. Through the experimental results of UFMAR, it was found that the IICUMI method was 50% more effective, while CUPA and UCPM were 57% more effective than the existing framework. The outcome through UFMAR also produced 86% accuracy in analysis results and was 79% more efficient in framework implementation. UFMAR was validated through three cycles of the experimental processes, with triangulation through expert reviews, to be proven as a fitting framework for MAR language learning