An approach for precise 2D/3D semantic annotation of spatially-oriented images for in-situ visualization applications

Thanks to nowadays technologies, innovative tools afford to increase our knowledge of historic monuments, in the field of preservation and valuation of cultural heritage. These tools are aimed to help experts to create, enrich and share information on historical buildings. Among the various documentary sources, photographs contain a high level of details about shapes and colors. With the development of image analysis and image-based-modeling techniques, large sets of images can be spatially oriented towards a digital mock-up. For these reasons, digital photographs prove to be an easy to use, affordable and flexible support, for heritage documentation. This article presents, in a first step, an approach for 2D/3D semantic annotations in a set of spatially-oriented photographs (whose positions and orientations in space are automatically estimated). In a second step, we will focus on a method for displaying those annotations on new images acquired by mobile devices in situ. Firstly, an automated image-based reconstruction method produces 3D information (specifically 3D coordinates) by processing a large images set. Then, images are semantically annotated and a process uses the previously generated 3D information inherent to images for the annotations transfer. As a consequence, this protocol provides a simple way to finely annotate a large quantity of images at once instead of one by one. As those images annotations are directly inherent to 3D information, they can be stored as 3D files. To bring up on screen the information related to a building, the user takes a picture in situ. An image processing method allows estimating the orientation parameters of this new photograph inside the already oriented large images base. Then the annotations can be precisely projected on the oriented picture and send back to the user. In this way a continuity of information could be established from the initial acquisition to the in situ visualization

An approach for precise 2D/3D semantic annotation of spatially-oriented images for in-situ visualization applications

Thanks to nowadays technologies, innovative tools afford to increase our knowledge of historic monuments, in the field of preservation and valuation of cultural heritage. These tools are aimed to help experts to create, enrich and share information on historical buildings. Among the various documentary sources, photographs contain a high level of details about shapes and colors. With the development of image analysis and image-based-modeling techniques, large sets of images can be spatially oriented towards a digital mock-up. For these reasons, digital photographs prove to be an easy to use, affordable and flexible support, for heritage documentation. This article presents, in a first step, an approach for 2D/3D semantic annotations in a set of spatially-oriented photographs (whose positions and orientations in space are automatically estimated). In a second step, we will focus on a method for displaying those annotations on new images acquired by mobile devices in situ. Firstly, an automated image-based reconstruction method produces 3D information (specifically 3D coordinates) by processing a large images set. Then, images are semantically annotated and a process uses the previously generated 3D information inherent to images for the annotations transfer. As a consequence, this protocol provides a simple way to finely annotate a large quantity of images at once instead of one by one. As those images annotations are directly inherent to 3D information, they can be stored as 3D files. To bring up on screen the information related to a building, the user takes a picture in situ. An image processing method allows estimating the orientation parameters of this new photograph inside the already oriented large images base. Then the annotations can be precisely projected on the oriented picture and send back to the user. In this way a continuity of information could be established from the initial acquisition to the in situ visualization

An approach for precise 2D/3D semantic annotation of spatially-oriented images for in-situ visualization applications

Thanks to nowadays technologies, innovative tools afford to increase our knowledge of historic monuments, in the field of preservation and valuation of cultural heritage. These tools are aimed to help experts to create, enrich and share information on historical buildings. Among the various documentary sources, photographs contain a high level of details about shapes and colors. With the development of image analysis and image-based-modeling techniques, large sets of images can be spatially oriented towards a digital mock-up. For these reasons, digital photographs prove to be an easy to use, affordable and flexible support, for heritage documentation. This article presents, in a first step, an approach for 2D/3D semantic annotations in a set of spatially-oriented photographs (whose positions and orientations in space are automatically estimated). In a second step, we will focus on a method for displaying those annotations on new images acquired by mobile devices in situ. Firstly, an automated image-based reconstruction method produces 3D information (specifically 3D coordinates) by processing a large images set. Then, images are semantically annotated and a process uses the previously generated 3D information inherent to images for the annotations transfer. As a consequence, this protocol provides a simple way to finely annotate a large quantity of images at once instead of one by one. As those images annotations are directly inherent to 3D information, they can be stored as 3D files. To bring up on screen the information related to a building, the user takes a picture in situ. An image processing method allows estimating the orientation parameters of this new photograph inside the already oriented large images base. Then the annotations can be precisely projected on the oriented picture and send back to the user. In this way a continuity of information could be established from the initial acquisition to the in situ visualization

Analyzing the evolution of deterioration patterns: A first step of an image-based approach for comparing multitemporal data sets

International audienceWhen documenting and analyzing cultural heritage, the monument states can be described by multitemporal data sets, which however present a complication for the elaboration and examination process. This difficulty leads to the necessity to improve the analyze process in order to expand the documentation process and help experts to enrich and share information about the historical buildings. Therefore an approach of change measurement, which supports the chronical comprehension of a building by visualizing and quantifying the dimensional temporal effects was elaborated, where the analyze process of a multitemporal data set was based on the interpretation of depth map images. These maps were obtained by generating ortho images of an object that was created on purpose by setting up an experimentation to acquire a multitemporal data set. This approach is the first step of a wider ongoing research about change detection processes on multitemporal data sets. Index Terms-Change measurements, multitemporal data set, depth map, ortho image, evolution of deterioration patterns

Estudio técnico de las pinturas murales de Germolles: la contribución de las técnicas de imagen

[EN] The Château de Germolles is one of the rare palace in France dating from the 14th century. The noble floor is decorated with wall paintings that are a unique example of courtly love spirit that infused the princely courts of the time. After being concealed sometime in the 19th century, the paintings were rediscovered and uncovered in the middle of the 20th century and partly restored at the end of the 1990s. No scientific documentation accompanied these interventions and important questions, such as the level of authenticity of the mural decorations and the original painting technique(s) used in the medieval times remained unanswered. The combined scientific and financial supports of COSCH Cost Action and DRAC-Burgundy enabled to study Germolles’ wall paintings using some of the most innovative imaging and analytical techniques and to address some of the questions raised. The study provided significant information on the material used in the medieval times and on the conservation condition of the paintings. The data collected is vast and varied and exposed the owners of the property to the challenges of data management.[ES] El castillo de Germolles es uno de los raros palacios principescos en Francia que data del siglo XIV. La planta noble está decorada con pinturas murales que son un ejemplo único del amor cortés, ese espíritu que se divulgó en las cortes de la época.Ocultadas desde el fin del siglo XIX, las pinturas fueron descubiertas en la mitad del siglo XXy fueron parcialmente restauradas al finalde la década de 1990. No hay documentación científica queacompañelas intervenciones, y cuestiones importantesse quedaronsin repuesta, en particular el nivel de autenticidad de las decoraciones de las paredes, así como lastécnicaspictóricasutilizadasen laépoca medieval. El apoyo científico y económico de la Acción Cost COSCH y de la DRAC de Borgoña permitió elestudio delas pinturas murales de Germolles con algunas de las técnicas de imagen y analíticasmás innovadoras, con tal de responder a algunas de las cuestiones planteadas. El estudio proporcionó informaciónrelevante en lo que se refiere al material utilizado durante la Edad Mediay sobreel estado de conservación de las pinturas. La toma de datos es ampliay variada, y expuso a los dueños de la propiedad al desafío de la gestión de datos.This project would not have been possible without the financial support by DRAC-Burgundy and the COST Action TD1201: Colour and Space in Cultural Heritage (COSCH) (www.cosch.info) which the authors wish to sincerely thank.Degrigny, C.; Piqué, F.; Papiashvili, N.; Guery, J.; Mansouri, A.; Le Goïc, G.; Detalle, V.... (2016). Technical study of Germolles’ wall paintings: the input of imaging technique. Virtual Archaeology Review. 7(15):1-8. https://doi.org/10.4995/var.2016.5831SWORD18715Giovannoni, S., Matteini, M., & Moles, A. (1990). Studies and developments concerning the problem of altered lead pigments in wall painting. Studies in Conservation, 35(1), 21-25. doi:10.1179/sic.1990.35.1.21Manuel, A., Gattet, E., De Luca, L., & Veron, P. (2013). An approach for precise 2D/3D semantic annotation of spatially-oriented images for in situ visualization applications. 2013 Digital Heritage International Congress (DigitalHeritage). doi:10.1109/digitalheritage.2013.6743752Wefers, S., Reich, T., Tietz, B. and Boochs, F. 2016. SIVT – Processing, Viewing, and Analysis of 3D Scans of the Porthole Slab and Slab B2 of Züschen I. In: S. Campana, R. Sopigno, G. Carpentiero and M. Cirillo, eds, CAA2015. Keep the Revolution Going. Proceedings of the 43rd Annual Conference on Computer Applications and Quantitative Methods In Archaeology. Oxford : Archaeopress Publishing Ltd, pp. 1067-1080

Annotation sémantique 2D/3D d'images spatialisées pour la documentation et l'analyse d'objets patrimoniaux

In the field of architecture and historic preservation , the information and communication technologies enable the acquisition of large amounts of data introducing analysis media for different purposes and at different levels of details ( photographs, point cloud, scientific imaging, ...). The organization and the structure of these resources is now a major problem for the description, the analysis and the understanding of cultural heritage objects. However the existing solutions in semantic annotations on images or on 3D model are insufficient, especially in the linking of different analysis media.This thesis proposes an approach for conducting annotations on different two-dimensional media while allowing the propagation of these annotations between different representations (2D or 3D) of the object. The objective is to identify solutions to correlate (from a spatial, temporal and semantic point of view) sets of annotations within sets of images. Thus, the system is based on the principle of data spatialization for establishing a relationship between the 3D representations, incorporating all the geometric complexity of the object and therefore to the metric information extraction, and 2D representations of object. The approach seeks to the establishment of an information continuity from the image acquisition to the construction of 3D representations semantically enhanced by incorporating multi-media and multi-temporal aspects. This work resulted in the definition and the development of a set of software modules that can be used by specialists of conservation of architectural heritage as by the general public.Dans le domaine de l’architecture et de la conservation du patrimoine historique, les technologies de l’information et de la communication permettent l’acquisition de grandes quantités de données introduisant des supports d’analyses pour différentes finalités et à différents niveaux de détails (photographies, nuages de points, imagerie scientifique, …). L’organisation et la structuration de ces ressources est aujourd’hui un problème majeur pour la description, l’analyse et la compréhension d’objets patrimoniaux. Cependant les solutions existantes d’annotations sémantiques d’images ou de modèle 3D se révèlent insuffisantes notamment sur l’aspect de mise en relation des différents supports d’analyse.Cette thèse propose une approche permettant de conduire des annotations sur les différents supports bidimensionnels tout en permettant la propagation de ces annotations entre les différentes représentations (2D ou 3D) de l’objet. L’objectif est d’identifier des solutions pour corréler (d’un point de vue spatial, temporel et sémantique) des jeux d’annotations au sein d’un jeu d’images. Ainsi le système repose sur le principe de spatialisation des données permettant d’établir une relation entre les représentations 3D, intégrant toute la complexité géométrique de l’objet et par conséquent permettant l’extraction d’informations métriques, et les représentations 2D de l’objet. L’approche cherche donc à la mise en place d’une continuité informationnelle depuis l’acquisition d’images jusqu’à la construction de représentations 3D sémantiquement enrichies en intégrant des aspects multi-supports et multi-temporels. Ce travail a abouti à la définition et le développement d’un ensemble de modules informatiques pouvant être utilisés par des spécialistes de la conservation d’un patrimoine architectural comme par le grand public

Digital Techniques for Documenting and Preserving Cultural Heritage

In this unique collection the authors present a wide range of interdisciplinary methods to study, document, and conserve material cultural heritage. The methods used serve as exemplars of best practice with a wide variety of cultural heritage objects having been recorded, examined, and visualised. The objects range in date, scale, materials, and state of preservation and so pose different research questions and challenges for digitization, conservation, and ontological representation of knowledge. Heritage science and specialist digital technologies are presented in a way approachable to non-scientists, while a separate technical section provides details of methods and techniques, alongside examples of notable applications of spatial and spectral documentation of material cultural heritage, with selected literature and identification of future research. This book is an outcome of interdisciplinary research and debates conducted by the participants of the COST Action TD1201, Colour and Space in Cultural Heritage, 2012–16 and is an Open Access publication available under a CC BY-NC-ND licence.https://scholarworks.wmich.edu/mip_arc_cdh/1000/thumbnail.jp

Digital Techniques for Documenting and Preserving Cultural Heritage

This book presents interdisciplinary approaches to the examination and documentation of material cultural heritage, using non-invasive spatial and spectral optical technologies