Semantic and geometric enrichment of 3D geo-spatial models with captioned photos and labelled illustrations

Abstract

There are many 3D digital models of buildings with cultural heritage interest, but most of them lack semantic annotation that could be used to inform users of mobile and desktop applications about their origins and architectural features. We describe methods in an ongoing project for enriching 3D models with generic annotation, derived from examples of images of building components and from labelled plans and diagrams, and with object-specific descriptions obtained from photo captions. This is the first stage of research that aims to annotate 3D models with facts extracted from the text of authoritative architectural guides