GRAPH CNN WITH RADIUS DISTANCE FOR SEMANTIC SEGMENTATION OF HISTORICAL BUILDINGS TLS POINT CLOUDS

Abstract. Point clouds obtained via Terrestrial Laser Scanning (TLS) surveys of historical buildings are generally transformed into semantically structured 3D models with manual and time-consuming workflows. The importance of automatizing this process is widely recognized within the research community. Recently, deep neural architectures have been applied for semantic segmentation of point clouds, but few studies have evaluated them in the Cultural Heritage domain, where complex shapes and mouldings make this task challenging. In this paper, we describe our experiments with the DGCNN architecture to semantically segment historical buildings point clouds, acquired with TLS. We propose a variation of the original approach where a radius distance based technique is used instead of K-Nearest Neighbors (KNN) to represent the neighborhood of points. We show that our approach provides better results by evaluating it on two real TLS point clouds, representing two Italian historical buildings: the Ducal Palace in Urbino and the Palazzo Ferretti in Ancona

Augmented reality experience: from high-resolution acquisition to real time augmented contents

This paper presents results of a research project "dUcale" that experiments ICT solutions for the museum of Palazzo Ducale (Urbino). In this project, the famed painting the "Città Ideale" becomes a case to exemplify a specific approach to the digital mediation of cultural heritage. An augmented reality (AR) mobile application, able to enhance the museum visit experience, is presented. The computing technologies involved in the project (websites, desktop and social applications, mobile software, and AR) constitute a persuasive environment for the artwork knowledge. The overall goal of our research is to provide to cultural institutions best practices efficiently on low budgets. Therefore, we present a low cost method for high-resolution acquisition of paintings; the image is used as a base in AR approach. The proposed methodology consists of an improved SIFT extractor for real time image. The other novelty of this work is the multipoint probabilistic layer. Experimental results demonstrated the robustness of the proposed approach with extensive use of the AR application in front of the "Città Ideale" painting. To prove the usability of the application and to ensure a good user experience, we also carried out several users tests in the real scenario

Heritage and Railways: Sustainable Tourism Opportunities Boosted by Digital Transformation

This Special Issue focuses on the debate and recent trends in research dealing with railways, touristic itineraries, landscape and heritage digital documentation, while keeping in mind the goals of “The European Year of Rail”. This initiative was proposed for the 2021 by the European Commission in order to promote the use of railway transport as a stable and innovative type of land transport and to achieve the goals of the European Green Deal in the field of transport and, with a series of activities and campaigns highlighting the advantages of rail for both holidaymakers and commuters

Chapter In dialogo con i musei: innovazione e trasformazione digitale per una nuova visione del patrimonio

The 43rd UID conference, held in Genova, takes up the theme of ‘Dialogues’ as practice and debate on many fundamental topics in our social life, especially in these complex and not yet resolved times. The city of Genova offers the opportunity to ponder on the value of comparison and on the possibilities for the community, naturally focused on the aspects that concern us, as professors, researchers, disseminators of knowledge, or on all the possibile meanings of the discipline of representation and its dialogue with ‘others’, which we have broadly catalogued in three macro areas: History, Semiotics, Science / Technology. Therefore, “dialogue” as a profitable exchange based on a common language, without which it is impossible to comprehend and understand one another; and the graphic sign that connotes the conference is the precise transcription of this concept: the title ‘translated’ into signs, derived from the visual alphabet designed for the visual identity of the UID since 2017. There are many topics which refer to three macro sessions: - Witnessing (signs and history) - Communicating (signs and semiotics) - Experimenting (signs and sciences) Thanks to the different points of view, an exceptional resource of our disciplinary area, we want to try to outline the prevailing theoretical-operational synergies, the collaborative lines of an instrumental nature, the recent updates of the repertoires of images that attest and nourish the relations among representation, history, semiotics, sciences

Per un approccio sistemico alla rilevazione, misurazione e valutazione dell'applicazione delle tecnologie digitali alla tutela, gestione e valorizzazione del patrimonio culturale

In vista dell\u2019anno europeo del patrimonio culturale sembra pi\uf9 che mai opportuno riflettere in modo sistemico sullo stato dell\u2019arte nell\u2019applicazione delle tecnologie ICT al patrimonio culturale, anche in rapporto agli effetti eventuali di miglioramento della qualit\ue0 nella tutela e valorizzazione. Data la molteplicit\ue0 e autonomia delle linee di finanziamento a livello nazionale e locale, allo stato attuale non \ue8 possibile monitorare i progetti e la loro efficacia con un\u2019ottica olistica. L\u2019intervento presenter\ue0 i passi fatti finora per la costruzione di un osservatorio, di livello regionale, che si candiderebbe ad essere un riferimento condiviso per la ricerca, per la formazione e per l\u2019applicazione delle tecnologie digitali nelle Marche. In particolare l\u2019aspettativa \ue8 quella di una valutazione e misurazione di efficacia, evitando sovrapposizioni e dispersioni di risorse pubbliche e favorendo lo scambio di soluzioni nella valorizzazione delle best practice

Methodologies supporting the historical and archival research and for the transparency of the HBIM models of the Lazzaretto in Ancona in Luigi Vanvitelli's Design

In the Cultural Heritage domain, the potential of BIM for the built heritage is well known. However, research in Historical Building Information Modeling (HBIM) is still developing and deserves new experiments. Currently, the main objectives are the model transparency, meaning that sources and reliability of information can be linked to the model and retrieved from it, for a better interoperability and multi-disciplinary collaboration. Given the proliferation of 3D models, both informed and uninformed, and their increasing quality, there is a need to protect this heritage and provide useful uses beyond visualisation. This research not only addresses the challenge of creating an informed three-dimensional model capable of showing and documenting the evolution and transformation of the building, but also aims to achieve an output that can be used by historical experts who contribute to the creation and validation of the information apparatus. The case study is the Lazzaretto in Ancona, designed by Luigi Vanvitelli in the 18th century: it is an example of a building that shows the material culture of its time. The information gained from the primary sources, which contribute to the analysis of early modern notions of contagion, are merged with the analysis of the built environment. The proposed HBIM model is the result of interdisciplinary research between history and digital survey/representation and aims to provide the greatest transparency of knowledge in both areas. The informed model shows how the data improvement through HBIM platforms is a powerful tool to support historical-archival research and guarantees the transparency of the model

Procedimiento HBIM para implementar el conocimiento histórico-constructivo. El caso de la Real Colegiata de San Isidoro (León, España)

[EN] The development of Historic Building Information Modelling (HBIM) focuses (among other uses) on the adaptation of the BIM methodology to the historical building’s features, as well as on increasing geometric accuracy and on model data enrichment. Regarding the first issue, it can be underlined, on the one hand, that historical buildings are the result of a sequence of transformations that take place throughout their whole history; they cannot be considered as unitary objects that have been created in a single moment. Therefore, they have a temporal sequence which can be understood as the essence of their evolving nature. On the other hand, historical architecture has different construction materials and techniques, with other kinds of features and pathological processes that are quite different from those of contemporary buildings. In this line, this study proposes a new workflow that allows outlining new criteria that include both the temporal sequence and the constructive features of historical buildings. For this purpose, the case study of the Real Colegiata of San Isidoro in León (Spain) has been considered. In order to create the model, several modelling strategies have been used to compare both the results and the time spent in this task. Then, the model has been divided into several parts, both in terms of constructive criteria and temporal stratification, and thus, the database and the implemented information have been organized following such essential aspects of the historical building. Finally, to provide an advanced and more efficient use of the information, customized queries have been created using Dynamo, allowing searching with combined criteria and the isolation and visualization of the resulting elements. This could be helpful for both research and conservation and management activities.Highlights:A comparison of modelling strategies applied to historical buildings taking into consideration their singularities and estimation of required times and benefits.The division and taxonomy of the model to incorporate both the temporal sequence and the constructive aspects, allowing enrichment of the HBIM model with customized parameters.The development of queries generated in Dynamo to allow customized and combined searches of data, optimizing the use of the database.[ES] El desarrollo del modelado de información de edificios históricos (HBIM) se ha centrado, entre otros aspectos, en la adaptación de la metodología BIM a las características específicas de la arquitectura histórica, en el aumento de la precisión geométrica y en el enriquecimiento de los datos relacionados con el modelo. En referencia al primer aspecto, podemos destacar que los edificios históricos se caracterizan por ser el producto de una secuencia de transformaciones que tienen lugar a lo largo de su historia, de modo que no pueden concebirse como objetos unitarios creados en un momento determinado, sino que incorporan una secuencia temporal que forma parte de su esencia evolutiva. Por otro lado, a diferencia de las edificaciones actuales, la arquitectura histórica emplea técnicas y materiales constructivos distintos con características y patología diferentes. En esta línea, el presente trabajo tiene como objetivo proponer un nuevo método de trabajo que permita incorporar la secuencia temporal y las características constructivas de los edificios históricos, centrándose en el caso de la Real Colegiata de San Isidoro, en León (España). Para ello, se han analizado y comparado varias estrategias de modelado, atendiendo fundamentalmente a los resultados obtenidos y al tiempo empleado en cada una de ellas. Posteriormente, el modelo se ha dividido en varias partes, teniendo en cuenta las características constructivas y la estratificación temporal y, de este modo, tanto la base de datos como la información implementada se han organizado en base a estos aspectos esenciales del edificio histórico. Finalmente, con la intención de permitir un uso avanzado y más eficiente de la información, se ha creado un sistema de consultas personalizadas con Dynamo, lo que permite la búsqueda basada en criterios combinados y la identificación y visualización de los elementos resultantes, lo cual podrá ser útil para las labores de investigación y de conservación.This research has been developed within the framework of the CampusWorld programme of the Università Politecnica delle Marche (Italy). The research is also partially framed in CIVITAS, Strategic research project of UNIVPM. The authors would like to thank the helpful collaboration of both the staff of the Museo de San Isidoro, as well as of the Servicio de Restauración of the Dirección General de Patrimonio Cultural of the Junta de Castilla y León for providing the access and some data of the analyzed building.Santoni, A.; Martín-Talaverano, R.; Quattrini, R.; Murillo-Fragero, JI. (2021). HBIM approach to implement the historical and constructive knowledge. The case of the Real Colegiata of San Isidoro (León, Spain). Virtual Archaeology Review. 12(24):49-65. https://doi.org/10.4995/var.2021.13661OJS49651224Achille, C., Fassi, F., Mandelli, A., Perfetti, L., Rechichi, F., & Teruggi, S. (2020). From a Traditional to a Digital Site: 2008-2019. The History of Milan Cathedral Survey. In B. Daniotti, M. Gianinetto, & S. Della Torre (Eds.), Digital Transformation of the Design, Construction and Management Processes of the Built Environment (pp. 331-341). Springer, Cham. https://doi.org/10.1007/978-3-030-33570-0_30Adami, A., Fassi, F., Fregonese, L., & Piana, M. (2018). Image-based techniques for the survey of mosaics in the St Mark's Basilica in Venice. Virtual Archaeology Review, 9(19), 1-20, https://doi.org/10.4995/var.2018.9087Aparicio Resco, P., & Figueiredo, C. (2017). El grado de evidencia histórico-arqueológica de las reconstrucciones virtuales: Hacia una escala de representación gráfica - The level of historical-archaeological evidence of virtual reconstructions: Towards a scale of graphical representation. Otras Arqueologías, 1. https://doi.org/10.23914/otarq.v0i1.96Apollonio, F. I., Gaiani, M., & Sun, Z. (2016). A Reality Integrated BIM for Architectural Heritage Conservation. Handbook of Research on Emerging Technologies for Architectural and Archaeological Heritage (pp. 31-65). IGI Global, Hershey. https://doi.org/10.4018/978-1-5225-0675-1.ch002Banfi, F. (2017). BIM orientation: Grades of generation and information for different type of analysis and management process. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-2/W5, 57-64. https://doi.org/10.5194/isprs-archives-XLII-2-W5-57-2017Banfi, F., Brumana, R., & Stanga, C. (2019). Extended reality and informative models for the architectural heritage: from scan-to-BIM process to virtual and augmented reality. Virtual Archaeology Review, 10(21), 14-30. https://doi.org/10.4995/var.2019.11923Biagini, C., Capone, P., Donato, V., & Facchini, N. (2016). Towards the BIM implementation for historical building restoration sites. Automation in Construction, 71, 74-86. https://doi.org/10.1016/J.AUTCON.2016.03.003Bruno, N., & Roncella, R. (2019). HBIM for conservation: A new proposal for information modeling. Remote Sensing, 11(15). https://doi.org/10.3390/rs11151751Brusaporci, S., Ruggeri, G., Maiezza, P., & Tata, A. (2018). AHBIM per l'analisi stratigrafica dell'architettura storica. Restauro Archeologico, 26(1), 112-131. https://doi.org/10.13128/RA-23463Caballero, L. (2010). Experiencia metodológica en Arqueología de la Arquitectura de un grupo de investigación. Instituto de Historia. CSIC. Madrid. In C. Martín Morales & E. De Vega (Eds.), Arqueología aplicada al estudio e intervención de edificios históricos. Últimas tendencias metodológicas, (pp. 103-120). Madrid: Ministerio de Cultura.Castellano-Román, M., & Pinto-Puerto, F. (2019). Dimensions and Levels of Knowledge in Heritage Building Information Modelling, HBIM: The model of the Charterhouse of Jerez (Cádiz, Spain). Digital Applications in Archaeology and Cultural Heritage, 14, e00110. https://doi.org/10.1016/j.daach.2019.e00110Felicetti, A., Murano, F., Ronzino, P., & Niccolucci, F. (2015). CIDOC CRM and epigraphy: A hermeneutic challenge. CEUR Workshop Proceedings, 1656, (pp. 55-68). CEUR-WS.Gargaro, S., Giudice, M. Del, & Ruffino, P. A. (2019). Towards a multi-functional HBIM model. SCIRES-IT - SCIentific RESearch and Information Technology, 8(2), 49-58. https://doi.org/10.2423/I22394303V8N2P49Iso Committee. (2019). UNI EN ISO 19650-1:2019 Organization and digitization of information about buildings and civil engineering works, including building information modelling (BIM) - Information management using building information modelling.Lerma, J. L., Navarro, S., Cabrelles, M., & Villaverde, V. (2010). Terrestrial laser scanning and close range photogrammetry for 3D archaeological documentation: the Upper Palaeolithic Cave of Parpalló as a case study. Journal of Archaeological Science, 37(3), 499-507. https://doi.org/10.1016/j.jas.2009.10.011Lo Turco, M., Calvano, M., & Giovannini, E. C. (2019). DATA MODELING for MUSEUM COLLECTIONS. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 42(2/W9), 433-440. https://doi.org/10.5194/isprs-archives-XLII-2-W9-433-2019López, F. J., Lerones, P. M., Llamas, J., Gómez-García-Bermejo, J., & Zalama, E. (2018). A review of heritage building information modeling (H-BIM). Multimodal Technologies and Interaction, 2(2), 21. https://doi.org/10.3390/mti2020021Macher, H., Landes, T., & Grussenmeyer, P. (2017). From point clouds to building information models: 3D semi-automatic reconstruction of indoors of existing buildings. Applied Sciences, 7(10), 1030. https://doi.org/10.3390/app7101030Maietti, F., Di Giulio, R., Medici, M., Ferrari, F., Piaia, E., & Brunoro, S. (2019). Accessing and Understanding Heritage Buildings through ICT. The INCEPTION Methodology Applied to the Istituto degli Innocenti. International Journal of Architectural Heritage, 1-10. https://doi.org/10.1080/15583058.2019.1683780Malinverni, E. S., Pierdicca, R., Paolanti, M., Martini, M., Morbidoni, C., Matrone, F., & Lingua, A. (2019). Deep learning for semantic segmentation of 3D point cloud. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-2/W15, 735-742. https://doi.org/10.5194/isprs-archives-XLII-2-W15-735-2019Marchetti, A., Redi, F., Savini, F., Trizio, I., & Giannangeli, A. (2017). La chiesa di San Cipriano a Castelvecchio Calvisio(AQ) nella Baronia di Carapelle: documentazione speditiva e analisi stratigrafica 3D del manufatto. Archeologia Dell'Architettura», XXII, 2017, 239-253.Martín-Talaverano, R., Murillo-Fragero, J. I., & Utrero-Agudo, M. (2021). Reflexiones y criterios relativos a la creación de modelos BIM de edificios históricos. Arqueología de la Arquitectura, 18.Murphy, M., McGovern, E., & Pavia, S. (2009). Historic building information modelling (HBIM). Structural Survey, 27(4), 311-327. https://doi.org/10.4018/978-1-4666-8379-2.ch007Nespeca, R. (2018). Towards a 3D digital model for management and fruition of Ducal Palace at Urbino. An integrated survey with mobile mapping. SCIRES-IT - SCIentific RESearch and Information Technology, 8(2), 1-14. https://doi.org/10.2423/I22394303V8N2P1Paris, L., & Wahbeh, W. (2016). Survey and representation of the parametric geometries in HBIM Rilievo e rappresentazione delle geometrie parametriche per l 'HBIM. DISEGNARECON, 9(16).Quattrini, R., Malinverni, E. S., Clini, P., Nespeca, R., & Orlietti, E. (2015). From TLS to HBIM. High quality semantically-aware 3D modeling of complex architecture. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XL-5/W4, 367-374. https://doi.org/10.5194/isprsarchives-XL-5-W4-367-2015Quattrini, R., Pierdicca, R., & Morbidoni, C. (2017). Knowledge-based data enrichment for HBIM: Exploring high-quality models using the semantic-web. Journal of Cultural Heritage, 28, 129-139. https://doi.org/10.1016/j.culher.2017.05.004Quattrini, R., Pierdicca, R., Morbidoni, C., & Malinverni, E. S. (2017). Conservation-oriented HBIM. The bimexplorer web tool. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 42(5W1). https://doi.org/10.5194/isprs-Archives-XLII-5-W1-275-2017Santagati, C., & Lo Turco, M. (2016). From structure from motion to historical building information modeling: populating a semantic-aware library of architectural elements. Journal of Electronic Imaging, 26(1), 011007. https://doi.org/10.1117/1.JEI.26.1.011007Simeone, D., Cursi, S., & Acierno, M. (2019). BIM semantic-enrichment for built heritage representation. Automation in Construction, 97, 122-137. https://doi.org/10.1016/j.autcon.2018.11.004Simeone, D., Cursi, S., Toldo, I., & Carrara, G. (2014). B ( H ) IM - Built Heritage Information Modelling. Extending BIM approach to historical and archaeological heritage representation. ECAADe, 1, (pp.613-622).Tomalini, A., & Lo Turco, M. (2019). Parametric heritage. The digital reconstruction of P.L. Nervi's Palazzo del Lavoro in the 3Dmodelling age. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 42(2/W15), 1149-1155. https://doi.org/10.5194/isprs-archives-XLII-2-W15-1149-2019Uni Committee. (2017). UNI 11337-5:2017 Titolo : Edilizia e opere di ingegneria civile - Gestione digitale dei processi informativi delle costruzioni - Parte 5: Flussi informativi nei processi digitalizzati (pp. 1-24).Utrero-Agudo, M. A., & Murillo-Fragero, J. I. (2017). Arqueología de la Basílilca de San Isidoro de León. In M. A. Utrero Agudo, E. Álvarez Areces, J. M. Baltuille Martín, & J. I. Murillo Fragero (Eds.), La Real Colegiata de San Isidoro de León. Diez siglos de construcción y reconstrucción en piedra (pp. 25-166). Madrid: Instituto Geológico y Minero de España.Utrero-Agudo, M. A., Murillo-Fragero, J. I., & Martín-Talaverano, R. (2016). Virtual models for archaeological research and 2.0 dissemination: The early medieval church of San Cebrián de Mazote (Spain). SCIRES-IT - SCIentific RESearch and Information Technology, 6(2), 93-108. https://doi.org/10.2423/I22394303V6N2P93Utrero-Agudo, M., & Murillo-Fragero, J. I. (2014). San Isidoro de León. Construcción y reconstrucción de una basílica románica. Arqueologia de La Arquitectura, 11. https://doi.org/10.3989/arq.arqt.2014.011Volk, R., Stengel, J., & Schultmann, F. (2014). Building Information Modeling (BIM) for existing buildings-Literature review and future needs. Automation in Construction, 38, 109-127. https://doi.org/10.1016/j.autcon.2013.10.02

From point cloud data to HBIM for public performance spaces knowledge, management and storytelling: Palazzo Olivieri in Pesaro

The very latest lines of European research in the field of Cultural Heritage are mainly focusing on disruptive global transitions through valueand future-oriented strategies in a green and digital scenario. This approach stems from the concept of Heritage as a unique but nonrenewable resource, featuring multilayer cultural contents (tangible and intangible), and evolving in close correlation with the constantly changing components in the territory. Digitisation is increasingly confirming itself as an enabling factor for many practices involving cultural heritage. With specific regard to the built heritage, digital technologies provide functions that can catalyse and optimally support architecture knowledge and storytelling, which in turn enhance new levels of interaction, and can improve the active conservation and integrated management of heritage asset. Starting from this assumptions, Palazzo Olivieri-Machirelli in Pesaro (Italy) was studied for challenging trials. Nowadays, the historical building is used as a music conservatory thanks to the testamentary legacy of the Italian composer Gioachino Rossini and the homonymous Foundation, and incorporates the Auditorium Pedrotti, which is the focus of this research. Thus, this architecture was selected as a testing case for inventive and immersive experiences as well as for long-term management solutions and systems, which exploit the paradigm of Heritage – or Historic – Building Information Modelling (HIBIM) and the robust technology of Augmented and Virtual Reality (AR, VR), taking advantage of solid base in the survey phase, which developed an high-detailed 3D numerical model

Dal Codice Magliabechiano alla mixed reality: il complesso Rocca-Torrione di F. di Giorgio Martini a Cagli

La ricerca presenta un workflow volto alla ricostruzione 3D del complesso Rocca-Torrione di F. di Giorgio Martini a Cagli, tra patrimonio materiale e immateriale. Dal rilievo alla mixed reality, è stato riportato alla luce l’intero sistema architettonico, a partire da fonti storiche. Utilizzando stampa 3D e MR si restituisce una dimensione fisica al virtuale e se ne favorisce la divulgazione

Trasformazione digitale delle Collezioni civiche di Ascoli Piceno

In line with current trends and challenges in the field of cultural heritage, the research presented here is the result of the V.I.T.A. project: an initiative on digital cultural heritage that involves museum operators in the digitization and development of digital applications for various works of art and ethnographic elements from the Civic Museums of Ascoli Piceno. The project includes the entire digitization workflow, ranging from three-dimensional modeling to immersive virtual experiences for museums. The work testifies to a fruitful collaboration between universities and cultural institutions, which has led the Marche museum to become a virtuous example in the field of digital transformation of heritage