The intangibility of tangible objects: re-telling artefact stories through spatial multimedia annotations and 3D objects

An interdisciplinary team at the University of Cologne just released Kompakkt, an open-source online-tool for linking 3D objects to multimedia content and for gathering information through annotations in 3D space more generally. It enables users to share, explore, and collaboratively annotate objects in standard modern web browsers. The 3D representation of an object serves as the hub of an open-ended collection of heterogeneous information established through the use of multimedia annotations. The annotations are flexible (meta)data complementing what one usually finds in collection management systems in the GLAM sector. Through personalised and group level collections of 3D models, images, sounds and videos Kompakkt enables a novel solution for gathering and generating artefact information. The third dimension of objects highlights the perspective of annotations in a new way: annotations are not only linked to a specific location in space, the corresponding point of view chosen by the user is also relevant. Linking and ranking annotations leads to moving from one annotation (and a specific perspective) to another, which implies a movement through space in time. That allows new ways of annotation-based storytelling, where annotations can be used for presentations in which movement in VR- and AR-applications is embedded

An approach for precise 2D/3D semantic annotation of spatially-oriented images for in-situ visualization applications

Thanks to nowadays technologies, innovative tools afford to increase our knowledge of historic monuments, in the field of preservation and valuation of cultural heritage. These tools are aimed to help experts to create, enrich and share information on historical buildings. Among the various documentary sources, photographs contain a high level of details about shapes and colors. With the development of image analysis and image-based-modeling techniques, large sets of images can be spatially oriented towards a digital mock-up. For these reasons, digital photographs prove to be an easy to use, affordable and flexible support, for heritage documentation. This article presents, in a first step, an approach for 2D/3D semantic annotations in a set of spatially-oriented photographs (whose positions and orientations in space are automatically estimated). In a second step, we will focus on a method for displaying those annotations on new images acquired by mobile devices in situ. Firstly, an automated image-based reconstruction method produces 3D information (specifically 3D coordinates) by processing a large images set. Then, images are semantically annotated and a process uses the previously generated 3D information inherent to images for the annotations transfer. As a consequence, this protocol provides a simple way to finely annotate a large quantity of images at once instead of one by one. As those images annotations are directly inherent to 3D information, they can be stored as 3D files. To bring up on screen the information related to a building, the user takes a picture in situ. An image processing method allows estimating the orientation parameters of this new photograph inside the already oriented large images base. Then the annotations can be precisely projected on the oriented picture and send back to the user. In this way a continuity of information could be established from the initial acquisition to the in situ visualization

A semi-automatic 2D/3D annotation framework for the geometric analysis of heritage artefacts

International audienceDocumentation and monitoring of heritage objects involve many actors on multidisciplinary aspects. The progress made over the years in the field of digital technologies has enabled many tools for analysis, management and dissemination of information gathered around an object. These tools must allow users to semantically describe the object while allowing them to grasp its morphological complexity and the heterogeneity of the available analysis supports. This article introduces an approach for the semantic annotation of heritage objects by using the bijective relationship that can be established between a 3D representation of an object and the set of oriented images towards it, while maintaining a continuum of information between all phases of observation and description, from acquisition to visualization of semantically enriched representations. The main idea is to offer a versatile environment to help extraction of relevant information from images using geometric descriptors and semi-automatic point cloud processing methods

2D/3D semantic annotation towards a set of spatially-oriented photographs

In the domain of conservation and promotion of cultural heritage, the development of new information technologies offers new tools for sharing knowledge on heritage building. These tools are destined to help experts to enrich and access information about buildings. This article proposes an approach allowing the automatic transfer of annotations in a set of spatially-oriented photographs (whose positions and orientations in space are estimated) by using 3D information. First of all, an automated image-based 3D reconstruction method produces 3D information (specifically 3D coordinates) by processing photographs of the set. Then, the process of annotations’ transfer between images uses this generated 3D information. Finally, this process allows the implementation of the annotations modification. As a consequence, this process provides a simple way to annotate blocs of images all at once instead of one by one

Web based presentation of semantically tagged 3D content for public sculptures and monuments in the UK

Copyright © 2009 by the Association for Computing Machinery, Inc. Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, to republish, to post on servers, or to redistribute to lists, requires prior specific permission and/or a fee

An approach for precise 2D/3D semantic annotation of spatially-oriented images for in-situ visualization applications

Thanks to nowadays technologies, innovative tools afford to increase our knowledge of historic monuments, in the field of preservation and valuation of cultural heritage. These tools are aimed to help experts to create, enrich and share information on historical buildings. Among the various documentary sources, photographs contain a high level of details about shapes and colors. With the development of image analysis and image-based-modeling techniques, large sets of images can be spatially oriented towards a digital mock-up. For these reasons, digital photographs prove to be an easy to use, affordable and flexible support, for heritage documentation. This article presents, in a first step, an approach for 2D/3D semantic annotations in a set of spatially-oriented photographs (whose positions and orientations in space are automatically estimated). In a second step, we will focus on a method for displaying those annotations on new images acquired by mobile devices in situ. Firstly, an automated image-based reconstruction method produces 3D information (specifically 3D coordinates) by processing a large images set. Then, images are semantically annotated and a process uses the previously generated 3D information inherent to images for the annotations transfer. As a consequence, this protocol provides a simple way to finely annotate a large quantity of images at once instead of one by one. As those images annotations are directly inherent to 3D information, they can be stored as 3D files. To bring up on screen the information related to a building, the user takes a picture in situ. An image processing method allows estimating the orientation parameters of this new photograph inside the already oriented large images base. Then the annotations can be precisely projected on the oriented picture and send back to the user. In this way a continuity of information could be established from the initial acquisition to the in situ visualization

An approach for precise 2D/3D semantic annotation of spatially-oriented images for in-situ visualization applications

Thanks to nowadays technologies, innovative tools afford to increase our knowledge of historic monuments, in the field of preservation and valuation of cultural heritage. These tools are aimed to help experts to create, enrich and share information on historical buildings. Among the various documentary sources, photographs contain a high level of details about shapes and colors. With the development of image analysis and image-based-modeling techniques, large sets of images can be spatially oriented towards a digital mock-up. For these reasons, digital photographs prove to be an easy to use, affordable and flexible support, for heritage documentation. This article presents, in a first step, an approach for 2D/3D semantic annotations in a set of spatially-oriented photographs (whose positions and orientations in space are automatically estimated). In a second step, we will focus on a method for displaying those annotations on new images acquired by mobile devices in situ. Firstly, an automated image-based reconstruction method produces 3D information (specifically 3D coordinates) by processing a large images set. Then, images are semantically annotated and a process uses the previously generated 3D information inherent to images for the annotations transfer. As a consequence, this protocol provides a simple way to finely annotate a large quantity of images at once instead of one by one. As those images annotations are directly inherent to 3D information, they can be stored as 3D files. To bring up on screen the information related to a building, the user takes a picture in situ. An image processing method allows estimating the orientation parameters of this new photograph inside the already oriented large images base. Then the annotations can be precisely projected on the oriented picture and send back to the user. In this way a continuity of information could be established from the initial acquisition to the in situ visualization

A Web Information System for the Semantic-Based Analysis of Architectural Heritage

This article focuses on the fields of architectural documentation and digital representation. It concerns the development of an information system at the scale of architecture, taking into account the relationships that can be established between the representation of buildings (shape, dimension, state of conservation, hypothetical restitution) and heterogeneous information about various fields (such as the technical, the documentary or still the historical one). The proposed approach aims to organize multiple representations (and associated information) around a semantic description model with the goal of defining a web information system for the multi-field analysis of heritage buildings