A knowledge based architecture for the virtual restoration of ancient photos

Historical images are essential documents of the recent past. Nevertheless, time and bad preservation corrupt their physical supports. Digitization can be the solution to extend their \u201clives\u201d, and digital techniques can be used to recover lost information. This task is often difficult and time-consuming, if commercial restoration tools are used for the purpose. A new solution is proposed to help non-expert users in restoring their damaged photos. First, we defined a dual taxonomy for the defects in printed and digitized photos. We represented our restoration domain with an ontology and we created some rules to suggest actions to perform in case of some specific events. Classes and properties of the ontology are included into a knowledge base, that grows dynamically with its use. A prototypal tool and a web application version have been implemented as an interface to the database, and to support non-expert users in the restoration process

FOR A CONSCIUOS FRUITION OF THE CULTURAL HERITAGE OF ANCIENT NOTO (SICILY). EFIAN PROJECT AS OPPORTUNITY FOR VALORISATION

The archaeological site of Ancient Noto is all that remains of one of the most interesting and important cities in the Est part of Sicily. Architecture and political life made Noto a point of reference for the island, expecially in XVI and XVII century, before it was destroyed by a devastating earthquake in 1963. A general project of safeguard, together with archaeological excavations, could hand a great amount of information, archaeological finds, pieces of architecture, that are useful to understand the site, known as a "Sicilian Pompei". Our intervention has the aim to describe the importance of EFIAN (Experimental Fruition Ingenious Ancient Noto). The project is carried out as a collaboration between Palermo University, Catania University, SIQUILLIYA s.r.l. and Service & Advice s.r.l.. The project answers to the need of improving the valorisation of the site, according to the principles of Italian Code for Cultural Heritage and Landscape. EFIAN's purpose is that of improving public's sensibilisation, to open lines of research and restauration of monuments. The working method is based on the strong relationship established between History, Architectonic Relief, Restauration, and Study of ancient technics of construction linked to the territory. The research is supported by new generation technologies. Datas are used to build digital reconstructions of ruins in the shape of virtual anastylosis and digital reconstruction of whole buildings. Four different sites have been studied during the project development

Classification of geometric forms in mosaics using deep neural network

The paper addresses an image processing problem in the field of fine arts. In particular, a deep learning-based technique to classify geometric forms of artworks, such as paintings and mosaics, is presented. We proposed and tested a convolutional neural network (CNN)-based framework that autonomously quantifies the feature map and classifies it. Convolution, pooling and dense layers are three distinct categories of levels that generate attributes from the dataset images by introducing certain specified filters. As a case study, a Roman mosaic is considered, which is digitally reconstructed by close-range photogrammetry based on standard photos. During the digital transformation from a 2D perspective view of the mosaic into an orthophoto, each photo is rectified (i.e., it is an orthogonal projection of the real photo on the plane of the mosaic). Image samples of the geometric forms, e.g., triangles, squares, circles, octagons and leaves, even if they are partially deformed, were extracted from both the original and the rectified photos and originated the dataset for testing the CNN-based approach. The proposed method has proved to be robust enough to analyze the mosaic geometric forms, with an accuracy higher than 97%. Furthermore, the performance of the proposed method was compared with standard deep learning frameworks. Due to the promising results, this method can be applied to many other pattern identification problems related to artworks

A N-D VIRTUAL NOTEBOOK ABOUT THE BASILICA OF S. AMBROGIO IN MILAN: INFORMATION MODELING FOR THE COMMUNICATION OF HISTORICAL PHASES SUBTRACTION PROCESS

This essay describes the combination of 3D solutions and software techniques with traditional studies and researches in order to achieve an integrated digital documentation between performed surveys, collected data, and historical research. The approach of this study is based on the comparison of survey data with historical research, and interpretations deduced from a data cross-check between the two mentioned sources. The case study is the Basilica of S. Ambrogio in Milan, one of the greatest monuments in the city, a pillar of the Christianity and of the History of Architecture. It is characterized by a complex stratification of phases of restoration and transformation. Rediscovering the great richness of the traditional architectural notebook, which collected surveys and data, this research aims to realize a virtual notebook, based on a 3D model that supports the dissemination of the collected information. It can potentially be understandable and accessible by anyone through the development of a mobile app. The 3D model was used to explore the different historical phases, starting from the recent layers to the oldest ones, through a virtual subtraction process, following the methods of Archaeology of Architecture. Its components can be imported into parametric software and recognized both in their morphological and typological aspects. It is based on the concept of LoD and ReverseLoD in order to fit the accuracy required by each step of the research

Authenticity and cultural heritage in the age of 3D digital reproductions

This volume represents the first attempt to collate an organic collection of contributions on authenticity and the digital realm in heritage and archaeology. It analyses the concept of authenticity from different perspectives and with different multidisciplinary contributions, together with theoretical debate. The collection of papers explores the concept of authenticity in a comprehensive way, engaging with theories relating to the commodification of ancient material culture, heritage-making processes, scholarly views and community engagement. These papers also take into account current digital practices for the study of past material culture and how their use affects and redefines interpretation processes in archaeology. This will provide a key reference text for archaeologists, museum and heritage specialists, and other readers interested in authenticity, cultural heritage and 3D reproductions.This book was funded by the EU 7th Framework Programme (7FP), DIGIFACT 625637 Project (http://cordis.europa.eu/project/rcn/187953_ en.html) and ADS3DV 625636 Project (http://cordis.europa.eu/project/ rcn/187952_en.html). The book will be Open Access, thanks to FP7 post-grant Open Access (https://www.openaire.eu/postgrantoapilot)

Levantamiento 3D para el estudio arqueológico y la reconstrucción virtual del Santuario de Isis en la antigua Lilybaeum (Italia)

[EN] In recent years, the use of three-dimensional (3D) models in cultural and archaeological heritage for documentation and dissemination purposes has increased. New geomatics technologies have significantly reduced the time spent on fieldwork surveys and data processing. The archaeological remains can be documented and reconstructed in a digital 3D environment thanks to the new 3D survey technologies. Furthermore, the products generated by modern surveying technologies can be reconstructed in a virtual environment on effective archaeological bases and hypotheses coming from a detailed 3D data analysis. However, the choice of technologies that should be used to get the best results for different archaeological remains and how to use 3D models to improve knowledge and dissemination to a wider audience are open questions. This paper deals with the use of terrestrial laser scanners and photogrammetric surveys for the virtual reconstruction of an archaeological site. In particular, the work describes the study for the 3D documentation and virtual reconstruction of the Sanctuary of Isis in Lilybaeum, the ancient city of Marsala (southern Italy). The Sanctuary of Isis is the only Roman sacred building known in this archaeological area. Based on the survey data, it has been possible to recreate the original volumes of the ancient building and rebuild the two best-preserved floors –a geometric mosaic and an opus spicatum– for a first digital reconstruction of the archaeological complex in a 3D environment.[ES] En los últimos años, el uso de los modelos tridimensionales (3D) en el patrimonio cultural y arqueológico para los propósitos de documentación y difusión están aumentando. Las nuevas tecnologías geomáticas han reducido significativamente el tiempo de trabajo de campo y procesamiento de los datos. Los restos arquitectónicos se pueden documentar y reconstruir en un entorno digital tridimensional (3D) gracias a las nuevas tecnologías de levantamiento 3D. Además, los productos generados con las tecnologías modernas de levantamiento se pueden reconstruir en entornos virtuales a partir de bases e hipótesis arqueológicas sólidas que provienen de un análisis detallado de los datos 3D. Sin embargo, la elección de las tecnologías que se deberían usar para obtener los mejores resultados en diferentes objetos y cómo los modelos 3D para mejorar el conocimiento y la divulgación a un público más amplio son cuestiones abiertas. Este artículo aborda el uso de los escáneres láser terrestre y de los levantamientos fotogramétricos para la reconstrucción virtual del Santuario de Isis en Lilybaeum, la antigua ciudad de Marsala (sur de Italia). El Santuario de Isis es el único edificio sagrado en la ciudad romana en esta área arqueológica. Sobre la base de la toma de datos, es posible recrear los volúmenes originales del edificio antiguo y reconstruir los dos suelos mejor conservados, un mosaico geométrico y un opus spicatum, para una primera reconstrucción digital del complejo arqueológico en un entorno 3D.Fazio, L.; Lo Brutto, M. (2020). 3D survey for the archaeological study and virtual reconstruction of the “Sanctuary of Isis” in the ancient Lilybaeum (Italy). Virtual Archaeology Review. 11(22):1-14. https://doi.org/10.4995/var.2020.11928OJS1141122Banfi, F. (2017). BIM orientation: grades of generation and information for different type of analysis and management process. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-2/W5, 57-64. https://doi.org/10.5194/isprs-archives-XLII-2-W5-57-2017Demetrescu, E. (2015). Archaeological Stratigraphy as a Formal Language for Virtual Reconstruction. Theory and Practice. Journal of Archaeological Science, 57, 42-55. https://doi.org/10.1016/j.jas.2015.02.004Demetrescu, E., & Fanini, B. (2017). A white-box framework to oversee archaeological virtual reconstructions in space and time: methods and tools. Journal of Archaeological Science: Reports, 14, 500-514. https://doi.org/10.1016/j.jasrep.2017.06.034Demetrescu, E. (2018). Virtual Reconstruction as a Scientific Tool: The Extended Matrix and Source-Based Modelling Approach, In Münster S., Friedrichs K., Niebling F., Seidel-Grzesińska A. (eds), Digital Research and Education in Architectural Heritage, Communications in Computer and Information Science, 817, 102-116. https://doi.org/10.1007/978-3-319-76992-9_7Denker, A. (2017). Rebuilding Palmyra virtually: recreation of its former glory in digital space. Virtual Archaeology Review, 8(17), 20-30. https://doi.org/10.4995/var.2017.5963Ebolese, D., Lo Brutto, M., & Dardanelli, G. (2019). UAV survey for the archaeological map of Lilybaeum (Marsala, Italy). International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-2/W11, 495-502, https://doi.org/10.5194/isprs-archives-XLII-2-W11-495-2019Ercek, R., Viviers, D., & Warzé, N. (2010). 3D reconstruction and digitalization of an archeological site, Itanos, Crete. Virtual Archaeology Review, 1(1), 81-85. https://doi.org/10.4995/var.2010.4794Fazio, L., Lo Brutto, M., & Dardanelli, G. (2019). Survey and virtual reconstruction of ancient Roman floors in an archaeological context. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-2/W11, 511-518. https://doi.org/10.5194/isprs-archives-XLII-2-W11-511-2019Fiorillo, F., Jimenez, B, Remondino, F., & Barba, S. (2013). 3D surveying and modelling of the archaeological area of Paestum, Italy. Virtual Archaeology Review, 4(8), 55-60. https://doi.org/10.4995/var.2013.4306Forte, M. (2014). 3D archaeology - New Perspectives and Challenges - The Example of Çatalhöyük. Journal of Eastern Mediterranean Archaeology & Heritage Studies, 2(1), 1-29. https://www.jstor.org/stable/10.5325/jeasmedarcherstu.2.1.0001Gabellone, F., Ferrari, I., & Giuri, F. (2017). A new contribution for the reconstructive study of the theatre of Taormina. IMEKO International Conference on Metrology for Archaeology and Cultural Heritage, Italy, October 23-25, 2017, 23-25.Galeazzi, F. (2016). Towards the definition of best 3D practices in archaeology: Assessing 3D documentation techniques for intra-site data recording. Journal of Cultural Heritage, 17, 159-169. https://doi.org/10.1016/j.culher.2015.07.005Gherardini, F., Santachiara, M., & Leali, F. (2019). Enhancing heritage fruition through 3D virtual models and augmented reality: an application to Roman artefacts. Virtual Archaeology Review, 10(21), 67-79. https://doi.org/10.4995/var.2019.11918Giglio Cerniglia, R., Palazzo, P., Vecchio, P., & Canzonieri, E. (2012). Lilibeo (Marsala). Risultati della campagna 2008. In C. Ampolo (Ed.), Sicilia occidentale. Studi, Rassegne, Ricerche (Vol. II, pp. 225-238). Erice, 12-15 October 2009.Grussenmeyer, P., Alby, E., Assali, P., Poitevin, V., Hullo, J. F., & Smigiel, E. (2011). Accurate Documentation in Cultural Heritage by merging TLS and high resolution photogrammetric data. Proceedings SPIE 8085, Videometrics, Range Imaging, and Applications XI, 808508, 1-13. https://doi.org/10.1117/12.890087Guidi, G., Russo, M., & Angheleddu, D. (2014). 3D survey and virtual reconstruction of archeological sites. Digital Applications in Archaeology and Cultural Heritage, 1(2), 55-69. https://doi.org/10.1016/j.daach.2014.01.001Historic England (2017). Photogrammetric Applications for Cultural Heritage. Guidance for Good Practice. Swindon: Historic England.Historic England (2018). 3D Laser Scanning for Heritage: Advice and Guidance on the Use of Laser Scanning in Archaeology and Architecture. Swindon: Historic England.Kuroczyński, P. (2017). Virtual research environment for digital 3D reconstructions: standards, thresholds, and prospects. Studies in Digital Heritage 1(2), 456-476. https://doi.org/10.14434/sdh.v1i2.23330Lerma, J. L., Navarro, S., Cabrelles, M., Seguí, A. E., Haddad, N., & Akasheh T. (2011). Integration of Laser Scanning and Imagery for Photorealistic 3D Architectural Documentation. In C-C. Wang (Ed.) Laser Scanning, Theory and Applications, (pp. 414-430). Rijeka, Croatia: InTech.Lo Brutto, M., & Dardanelli, G. (2017). Vision metrology and structure from motion for archaeological heritage 3D reconstruction: a Case Study of various Roman mosaics. Acta IMEKO, 6(3), 35-44. http://dx.doi.org/10.21014/acta_imeko.v6i3.458López-Martínez, T., Calvo-Bartolomé, B., & García-Bueno, A. (2019). Virtual restitution of the parietal decoration in the sala del mosaic de lod amores castulo archaeological site (Linares, Spain). International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-2/W11, 741-745. https://doi.org/10.5194/isprs-archives-XLII-2-W11-741-2019Monti, M., & Maino, G. (2018). Non-metric digital reconstruction of Roman mosaics excavated in the city of Ravenna (Italy). Virtual Archaeology Review, 9 (19), 66-75. https://doi.org/10.4995/var.2018.7227Remondino, F., & El‐Hakim, S. (2006). Image‐based 3D modelling: a review. The Photogrammetric Record, 21, 269-291. https://doi.org/10.1111/j.1477-9730.2006.00383.xSantachiara, M., Gherardini, F., & Leali. F. (2018). An augmented reality application for the visualization and the pattern analysis of a Roman mosaic. IOP Conference Series: Materials Science and Engineering, 364, 1-8. https://doi.org/10.1088/1757-899X/364/1/012094Sapirstein, P., & Murray, S. (2017). Establishing Best Practices for Photogrammetric Recording During Archaeological Fieldwork. Journal of Field Archaeology, 42(4), 337-350. https://doi.org/10.1080/00934690.2017.1338513Tucci, G., Bonora, V., Conti, A., & Fiorini, L. (2017). High quality 3D models and their use in a cultural heritage conservation project. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-2/W5, 687-693. https://doi.org/10.5194/isprs-archives-XLII-2-W5-687-2017Valente, R., Brumana, R., Oreni, D., Banfi, F., Barazzetti, L., & Previtali, M. (2017). Object-oriented approach for 3D archaeological documentation. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-2/W5, 707-712. https://doi.org/10.5194/isprs-archives-XLII-2-W5-707-2017Younes, G., Kahil, R., Jallad, M., Asmar, D., Elhajj, I., Turkiyyah, G., & Al-Harithy, H. (2017). Virtual and augmented reality for rich interaction with cultural heritage sites: A case study from the Roman Theater at Byblos. Digital Applications in Archaeology and Cultural Heritage, 5, 1-9. https://doi.org/10.1016/j.daach.2017.03.00

GEOMATICS TECHNIQUES FOR THE ENHANCEMENT AND PRESERVATION OF CULTURAL HERITAGE

Abstract. The deep knowledge of Cultural Heritage, with historical research and interpretative analysis of materials, is fundamental to know the state of conservation and to plan potential restoration interventions. In the last years, thanks to the fast and continuous technological development, the metrical survey had a significant increase in this particular field: in fact, 3D digital acquisition allows to study some aspects otherwise difficult to investigate in a detailed way.In this research, we will explain the methodology used for the ceiling's survey of the Sala Capitolare of the Scuola Grande di San Rocco in Venice, focusing on the support structure of Tintoretto's paintings, anchored to a wooden system of Palladian trusses. The complexity of this Venetian architecture, its considerable dimension, the richness of decorations and the particular lighting conditions provided the opportunity of thinking about unconventional choices to apply from time to time and they required the integration of different methodologies: the laser scanning survey and the photogrammetric acquisition, together with a topographic network, allowed to obtain an adequate metric result for the study of the structure in its entirety. Furthermore, it was also decided to test image acquisition with a spherical camera for the documentation of the analysed architecture: this type of information, more related to a viewable aspect than to a metric one, can be presented together with traditional 2D representations to ensure a better enhancement of the achieved results.</p

The Virtual Reconstruction of the Aesculapius and Hygeia Statues from the Sanctuary of Isis in Lilybaeum: Methods and Tools for Ancient Sculptures’ Enhancement

Thanks to recent technological developments in 3D surveys, computer graphics and virtual reality, new scenarios have been opened for the documentation and enhancement of ancient sculptures. When not totally preserved, sculptures can be digitally reproduced, modified and visualized to simulate their physical or virtual reconstruction in a non-invasive way for specialists or for dissemination aims. The virtual sculptural reconstruction process starts usually from the 3D survey of real fragments, and then continues by integrating missing parts with 3D modelling techniques by means of source evaluation. Along with primary data sources (reality-based model), secondary data sources (photos, drawings and 3D models of similar sculptures) can be directly used in the reconstruction process. This approach has a double advantage of making the reconstruction activities easier and less arbitrary, contributing to a decrease in the degree of uncertainty for the sculptural reconstruction work, also thanks to many iconographic comparisons to ancient copies. Moreover, virtual reconstruction can be easily visualized alongside a scalable rendering system using open-source Web3D apps and platforms, accessing information, 3D models and descriptions in order to enhance the experience of artworks. Inspecting theoretical and technical approaches, this work aims at establishing how primary and secondary data sources can be effectively used in sculptural reconstruction workflows, and how 3D outputs can be applied to implement digital sculptural heritage exploitation for museums and cultural institutions. The statues of Aesculapius and Hygeia from the sanctuary of Isis in Lilybaeum (Marsala, Italy) were chosen as a case study