A GAMING APPROACH for CULTURAL HERITAGE KNOWLEDGE and DISSEMINATION

In these last years, video games have become one of the most popular entertainment for children/teenagers/adults thanks to their appealing and seductive features and, in this context, the Serious Games (SG) have become an important research field. The most popular SGs in Cultural Heritage (CH) used the historical building like scenario where the game is playing. In this paper we show the procedure to achieve a CH video game where the Cultural Heritage is the main actor and not the scenario of the game. Furthermore, the game is not a SG but an Action-Adventure Game (AAG) or Survival Game (SuG), in a largest heading it can be classified as Entertainment Games (EGs). The novelty of this study is not only in the original application of the CH within the AAG sector but also consists of the experimentation of the Virtual Reality (VR) algorithm and of the application of Augmented Reality (AR) within the VR scenario used in the form of an avatar. Furthermore, in this paper we overcome the technical problems due to the different size of the environment and the work art

Virtual museum enriched by gis data to share science and culture. Church of saint stephen in Umm ar-Rasas (Jordan)

none5noUmm ar-Rasas is a Jordan archaeological site, located 30 km southeast of the city of Madaba, in the northern part of Wadi Mujib. It preserves findings dating back the period from the end of 3rd to the 9th century AD and, since 2004, it belongs to the world heritage list of UNESCO. In 2015 a multidisciplinary work was undertaken over the archaeological site, mainly focusing on the Church of Saint Stephen, with the main purpose of enhancing the knowledge and documenting the conservation state of the polychrome mosaic floor, which covers the entire surface of the hall and presbytery. A huge amount of data has been collected, coming from archaeological and historical investigations, geophysics and geodetic inspections and geomatics surveying, which produced also a true orthophoto of the mosaic floor. Data has been organized in a geo-database, facilitating the exchange of information between different actors. Moreover, the management of data within a dedicated Geographic Information System (GIS), has allowed in-depth analysis for understanding the evolution of the iconographic repertoire that, over the centuries, has undergone several disfigurements due to the iconoclastic age. The knowledge of the mosaic has also been vital for the implementation of multimedia applications and for the creation of virtual experiences, in which the information can be conveyed and visualized directly on the virtual reconstruction of the whole archaeological site. The innovation of the proposed work, is therefore in the management of a data flow that can be exploited by different actors through different platforms: experts, thanks to the use of GIS, and visitors with the use of multimedia applications (such as Augmented Reality (AR) or highresolution web visualization) for dissemination purposes, in order to preserve this priceless mankind heritage.openMalinverni E.S.; Pierdicca R.; Di Stefano F.; Gabrielli R.; Albiero A.Malinverni, E. S.; Pierdicca, R.; Di Stefano, F.; Gabrielli, R.; Albiero, A

Virtual museum enriched by GIS data to share science and culture. Church of Saint Stephen in Umm Ar-Rasas (Jordan)

[EN] Umm ar-Rasas is a Jordan archaeological site, located 30 km southeast of the city of Madaba, in the northern part of Wadi Mujib. It preserves findings dating back the period from the end of 3rd to the 9th century AD and, since 2004, it belongs to the world heritage list of UNESCO. In 2015 a multidisciplinary work was undertaken over the archaeological site, mainly focusing on the Church of Saint Stephen, with the main purpose of enhancing the knowledge and documenting the conservation state of the polychrome mosaic floor, which covers the entire surface of the hall and presbytery. A huge amount of data has been collected, coming from archaeological and historical investigations, geophysics and geodetic inspections and geomatics surveying, which produced also a true orthophoto of the mosaic floor. Data has been organized in a geo-database, facilitating the exchange of information between different actors. Moreover, the management of data within a dedicated Geographic Information System (GIS), has allowed in-depth analysis for understanding the evolution of the iconographic repertoire that, over the centuries, has undergone several disfigurements due to the iconoclastic age. The knowledge of the mosaic has also been vital for the implementation of multimedia applications and for the creation of virtual experiences, in which the information can be conveyed and visualized directly on the virtual reconstruction of the whole archaeological site. The innovation of the proposed work, is therefore in the management of a data flow that can be exploited by different actors through different platforms: experts, thanks to the use of GIS, and visitors with the use of multimedia applications (such as Augmented Reality (AR) or highresolution web visualization) for dissemination purposes, in order to preserve this priceless mankind heritage.Highlights:Definition of a complete pipeline ranging from data acquisition to visualization in multi-channel multimedia applications.Management of heterogeneous data in Geographic Information Systems (GIS) and their exploitation in Augmented and Virtual Reality (AR/VR).GIS applied to the archaeological domain for expert and non-expert users.[ES] Umm er-Rasas es un sitio arqueológico de Jordania, ubicado a 30 km al sureste de la ciudad de Madaba, en la parte norte de Wadi Mujib. Conserva hallazgos que datan del período comprendido entre finales del siglo III y IX d.C. y, desde 2004, pertenece a la lista del patrimonio mundial de la UNESCO. En 2015, se realizó un trabajo multidisciplinar en el sitio arqueológico, que se centró principalmente en la Iglesia de San Esteban, con el propósito principal de mejorar el conocimiento y la documentación del estado de conservación del suelo con el mosaico policromado que cubre toda la superficie de la sala y el presbiterio. Se ha recopilado una gran cantidad de datos provenientes de investigaciones arqueológicas e históricas, inspecciones geofísicas y geodésicas y levantamientos geomáticos, que produjeron también una ortofoto verdadera del suelo con el mosaico. Los datos se han organizado en una geodatabase, facilitando el intercambio de información entre diferentes actores. Además, la gestión de los datos en un Sistema de Información Geográfica (SIG) dedicado, ha permitido un análisis profundo que facilita la comprensión de la evolución del repertorio iconográfico que, a lo largo de los siglos, ha sufrido varias desfiguraciones debido a la era iconoclasta. El conocimiento del mosaico también ha sido vital en la implementación de aplicaciones multimedia y en la creación de experiencias virtuales, en las que la información se puede transmitir y visualizar directamente en la reconstrucción virtual de todo el sitio arqueológico. La innovación del trabajo propuesto está, por lo tanto, en la gestión del flujo de datos que puede ser explotado por diferentes actores a través de diferentes plataformas: expertos, gracias al uso del SIG, y visitantes con el uso de las aplicaciones multimedia (como son la Realidad Aumentada (AR) o la visualización web de alta resolución) para fines de divulgación, con el fin de preservar este patrimonio incalculable de la humanidad.Malinverni, ES.; Pierdiccaa, R.; Di Stefano, F.; Gabrielli, R.; Albiero, A. (2019). Museo virtual enriquecido con datos GIS para compartir ciencia y cultura. La Iglesia de San Esteban en Umm er-Rasas (Jordania). Virtual Archaeology Review. 10(21):31-39. https://doi.org/10.4995/var.2019.11919SWORD31391021Anichini, F., Bini, D., Bini, M., Dubbini, N., Fabiani, F., Gattiglia, G., ... Steffè, S. (2012). MAPPAproject: Methodologies applied to archaeological potential predictivity. MapPapers, 1en-I, 23-43.Anichini, F., Fabiani, F., Gattiglia, G., & Gualandi, M. L. (2012). A database for archaeological data recording and analysis. MapPapers, 1en-II, 21-38.Baik, A., Yaagoubi, R., & Boehm, J. (2015). Integration of Jeddah historical BIM and 3D GIS for documentation and restoration of historical monument. International Society for Photogrammetry and Remote Sensing, XL-5/W7, 29-34. https://doi.org/10.5194/isprsarchives-XL-5-W7-29-2015Barrile, V., Fotia, A., Bilotta, G., & De Carlo, D. (2019). Integration of geomatics methodologies and creation of a cultural heritage app using augmented reality. Virtual Archaeology Review, 10(20), 40-51. https://doi.org/10.4995/var.2019.10361Blanco-Pons, S., Carrión-Ruiz, B., Lerma, J. L., & Villaverde, V. (2019). Design and implementation of an augmented reality application for rock art visualization in Cova dels Cavalls (Spain). Journal of Cultural Heritage. https://doi.org/10.1016/j.culher.2019.03.014Bruno, F., Bruno, S., De Sensi, G., Luchi, M. L., Mancuso, S., & Muzzupappa, M. (2010). From 3D reconstruction to virtual reality: A complete methodology for digital archaeological exhibition. Journal of Cultural Heritage, 11(1), 42-49. https://doi.org/10.1016/j.culher.2009.02.006Colosi, F., Fangi, G., Gabrielli, R., Orazi, R., Angelini, A., & Bozzi, C. A. (2009). Planning the Archaeological Park of Chan Chan (Peru) by means of satellite images, GIS and photogrammetry. Journal of Cultural Heritage, 10 (SUPPL. 1), 27-34. https://doi.org/10.1016/j.culher.2009.08.002d'Annibale, E., Tassetti, A. N., & Malinverni, E. S. (2014). Finalizing a low-cost photogrammetric workflow: from panoramic photos to Heritage 3D documentation and visualization. International Journal of Heritage in the Digital Era, 3(1), 33-49. https://doi.org/10.1260/2047-4970.3.1.33Dilek, A. P. S. E., Doğan, M., & Kozbe, G. (2019). The Influences of the Interactive Systems on Museum Visitors' Experience: A Comparative Study from Turkey. Journal of Tourism Intelligence and Smartness, 2(1), 27-38. Retrieved from http://dergipark.org.tr/jtis/issue/44975/559246Felicetti, A., Albiero, A., Gabrielli, R., Pierdicca, R., Paolanti, M., Zingaretti, P.,& Malinverni, E. S. (2018). Automatic Mosaic Digitalization: a Deep Learning approach to tessera segmentation. In METROARCHEO, IEEE International Conference on Metrology for Archaeology and Cultural Heritage. Cassino.Gabrielli, R., Portarena, D., & Franceschinis, M. (2017). Tecniche di documentazione dei tappeti musivi del sito archeologico di Umm Al-Rasas-Kastron Mefaa (Giordania). Archeologia e Calcolatori, 28(1), 201-218.Gabrielli, R., & Greco, G. (2018). Umm Ar-Rasas: The Application of Integrated Methodologies for the Valorization of a Unesco Site. Global Journal of Archaeology & Anthropology, 6(3), 555688. https://doi.org/10.19080/GJAA.2018.06.555688Han, D.-I. D., Weber, J., Bastiaansen, M., Mitas, O., & Lub, X. (2019). Virtual and augmented reality technologies to enhance the visitor experience in cultural tourism. In M. C. tom Dieck & T. Jung (Eds.), Augmented Reality and Virtual Reality (pp. 113-128). Cham: Springer. https://doi.org/10.1007/978-3-030-06246-0Hunter, J., Jateff, E., & van den Hengel, A. (2019). Using digital visualization of archival sources to enhance archaeological interpretation of the 'Life History'of Ships: The case study of HMCS/HMAS Protector. In J. McCarthy, J. Benjamin, T. Winton, & W. van Duivenvoorde (Eds.), 3D Recording and Interpretation for Maritime Archaeology (vol. 31, pp. 89-101). Cham: Springer. https://doi.org/10.1007/978-3-030-03635-5_6Kyriakou, P., & Hermon, S. (2019). Can I touch this? Using natural interaction in a Museum Augmented Reality System. Digital Applications in Archaeology and Cultural Heritage, 12. https://doi.org/10.1016/j.daach.2018.e00088Malinverni, E. S., Pierdicca, R., Giuliano, A., & Mariano, F. (2018). A geographical information system to support restoration activities: a methodological approach experienced upon the case study of Ascoli Satriano Fortress. Applied Geomatics, 10(4), 427-439. https://doi.org/10.1007/s12518-018-0216-4Ognibene, S. (2002). Umm al-Rasas. L'Erma di Bretschneider.Piccirillo, M. (1991). Il complesso di Santo Stefano a Umm al-Rasas Kastron Mefaa in Giordania (1986-1991). Liber Annuus Studii Biblici Franciscani, 41, 327-357.Piccirillo, M. (2008). La Palestina cristiana: I-VII secolo. EDB.Piccirillo, M., & Alliata, E. (1994). Umm al-Rasas Mayfa'ah I: gli scavi del complesso di Santo Stefano.Pierdicca, R., Frontoni, E., Malinverni, E. S., Colosi, F., & Orazi, R. (2016). Virtual reconstruction of archaeological heritage using a combination of photogrammetric techniques: Huaca Arco Iris, Chan Chan, Peru. Digital Applications in Archaeology and Cultural Heritage, 3(3), 80-90. https://doi.org/10.1016/j.daach.2016.06.002Pierdicca, R., Malinverni, E. S., Frontoni, E., Colosi, F., & Orazi, R. (2016). 3D visualization tools to explore ancient architectures in South America. Virtual Archaeology Review, 7(15), 44-53. https://doi.org/10.4995/var.2016.5904Rahaman, H., Champion, E., & Bekele, M. (2019). From photo to 3D to mixed reality: A complete workflow for cultural heritage visualisation and experience. Digital Applications in Archaeology and Cultural Heritage, 13. https://doi.org/10.1016/j.daach.2019.e00102Salonia, P., & Negri, A. (2003). Cultural Heritage emergency: GIS-based tools for assessing and deciding preservation. In Proceedings of the Twenty-Third Annual ESRI International User Conference, San Diego, CA, USA (pp. 7-11).Saygi, G., & Remondino, F. (2013). Management of architectural heritage information in BIM and GIS: State-of-the-art and future perspectives. Internationa

3D photogrammetric data modeling and optimization for multipurpose analysis and representation of Cultural Heritage assets

This research deals with the issues concerning the processing, managing, representation for further dissemination of the big amount of 3D data today achievable and storable with the modern geomatic techniques of 3D metric survey. In particular, this thesis is focused on the optimization process applied to 3D photogrammetric data of Cultural Heritage assets. Modern Geomatic techniques enable the acquisition and storage of a big amount of data, with high metric and radiometric accuracy and precision, also in the very close range field, and to process very detailed 3D textured models. Nowadays, the photogrammetric pipeline has well-established potentialities and it is considered one of the principal technique to produce, at low cost, detailed 3D textured models. The potentialities offered by high resolution and textured 3D models is today well-known and such representations are a powerful tool for many multidisciplinary purposes, at different scales and resolutions, from documentation, conservation and restoration to visualization and education. For example, their sub-millimetric precision makes them suitable for scientific studies applied to the geometry and materials (i.e. for structural and static tests, for planning restoration activities or for historical sources); their high fidelity to the real object and their navigability makes them optimal for web-based visualization and dissemination applications. Thanks to the improvement made in new visualization standard, they can be easily used as visualization interface linking different kinds of information in a highly intuitive way. Furthermore, many museums look today for more interactive exhibitions that may increase the visitors’ emotions and many recent applications make use of 3D contents (i.e. in virtual or augmented reality applications and through virtual museums). What all of these applications have to deal with concerns the issue deriving from the difficult of managing the big amount of data that have to be represented and navigated. Indeed, reality based models have very heavy file sizes (also tens of GB) that makes them difficult to be handled by common and portable devices, published on the internet or managed in real time applications. Even though recent advances produce more and more sophisticated and capable hardware and internet standards, empowering the ability to easily handle, visualize and share such contents, other researches aim at define a common pipeline for the generation and optimization of 3D models with a reduced number of polygons, however able to satisfy detailed radiometric and geometric requests. iii This thesis is inserted in this scenario and focuses on the 3D modeling process of photogrammetric data aimed at their easy sharing and visualization. In particular, this research tested a 3D models optimization, a process which aims at the generation of Low Polygons models, with very low byte file size, processed starting from the data of High Poly ones, that nevertheless offer a level of detail comparable to the original models. To do this, several tools borrowed from the game industry and game engine have been used. For this test, three case studies have been chosen, a modern sculpture of a contemporary Italian artist, a roman marble statue, preserved in the Civic Archaeological Museum of Torino, and the frieze of the Augustus arch preserved in the city of Susa (Piedmont- Italy). All the test cases have been surveyed by means of a close range photogrammetric acquisition and three high detailed 3D models have been generated by means of a Structure from Motion and image matching pipeline. On the final High Poly models generated, different optimization and decimation tools have been tested with the final aim to evaluate the quality of the information that can be extracted by the final optimized models, in comparison to those of the original High Polygon one. This study showed how tools borrowed from the Computer Graphic offer great potentialities also in the Cultural Heritage field. This application, in fact, may meet the needs of multipurpose and multiscale studies, using different levels of optimization, and this procedure could be applied to different kind of objects, with a variety of different sizes and shapes, also on multiscale and multisensor data, such as buildings, architectural complexes, data from UAV surveys and so on

Digital Techniques for Documenting and Preserving Cultural Heritage

In this unique collection the authors present a wide range of interdisciplinary methods to study, document, and conserve material cultural heritage. The methods used serve as exemplars of best practice with a wide variety of cultural heritage objects having been recorded, examined, and visualised. The objects range in date, scale, materials, and state of preservation and so pose different research questions and challenges for digitization, conservation, and ontological representation of knowledge. Heritage science and specialist digital technologies are presented in a way approachable to non-scientists, while a separate technical section provides details of methods and techniques, alongside examples of notable applications of spatial and spectral documentation of material cultural heritage, with selected literature and identification of future research. This book is an outcome of interdisciplinary research and debates conducted by the participants of the COST Action TD1201, Colour and Space in Cultural Heritage, 2012–16 and is an Open Access publication available under a CC BY-NC-ND licence.https://scholarworks.wmich.edu/mip_arc_cdh/1000/thumbnail.jp

MeshPipe: a Python-based tool for easy automation and demonstration of geometry processing pipelines

The popularization of inexpensive 3D scanning, 3D printing, 3D publishing and AR/VR display technologies have renewed the interest in open-source tools providing the geometry processing algorithms required to clean, repair, enrich, optimize and modify point-based and polygonal-based models. Nowadays, there is a large variety of such open-source tools whose user community includes 3D experts but also 3D enthusiasts and professionals from other disciplines. In this paper we present a Python-based tool that addresses two major caveats of current solutions: the lack of easy-to-use methods for the creation of custom geometry processing pipelines (automation), and the lack of a suitable visual interface for quickly testing, comparing and sharing different pipelines, supporting rapid iterations and providing dynamic feedback to the user (demonstration). From the user's point of view, the tool is a 3D viewer with an integrated Python console from which internal or external Python code can be executed. We provide an easy-to-use but powerful API for element selection and geometry processing. Key algorithms are provided by a high-level C library exposed to the viewer via Python-C bindings. Unlike competing open-source alternatives, our tool has a minimal learning curve and typical pipelines can be written in a few lines of Python code.Peer ReviewedPostprint (published version

Digital Techniques for Documenting and Preserving Cultural Heritage

This book presents interdisciplinary approaches to the examination and documentation of material cultural heritage, using non-invasive spatial and spectral optical technologies