Modelling and interpretation of architecture from several images

This paper describes the automatic acquisition of three dimensional architectural models from short image sequences. The approach is Bayesian and model based. Bayesian methods necessitate the formulation of a prior distribution; however designing a generative model for buildings is a difficult task. In order to overcome this a building is described as a set of walls together with a ‘Lego’ kit of parameterised primitives, such as doors or windows. A prior on wall layout, and a prior on the parameters of each primitive can then be defined. Part of this prior is learnt from training data and part comes from expert architects. The validity of the prior is tested by generating example buildings using MCMC and verifying that plausible buildings are generated under varying conditions. The same MCMC machinery can also be used for optimising the structure recovery, this time generating a range of possible solutions from the posterior. The fact that a range of solutions can be presented allows the user to select the best when the structure recovery is ambiguous

Automatic Image Selection in Photogrammetric Multi-view Stereo Methods

This paper brings together a team of specialists in optical metrology, museum curation, collection digitization and 3D development to describe and illustrate by example a method for the selection of the most suitable camera views, vantage viewpoints, from a large image dataset intended for metric 3D artefact reconstruction. The presented approach is capable of automatically identifying and processing the most appropriate images from a multi-image photogrammetric network captured by an imaging specialist. The aim is to produce a 3D model suited to a wide range of museum uses, including visitor interactives. The approach combines off-the-shelf imaging equipment with rigorous photogrammetric bundle adjustment and multi-view stereo (MVS), supported by an image selection process that is able to take into account range-related and visibility-related constraints. The paper focusses on the two key steps of image clustering and iterative image selection. The developed method is illustrated by the 3D recording of four ancient Egyptian artefacts from the Petrie Museum of Egyptian Archaeology at UCL, with an analysis taking into account completeness, coordination uncertainty and required number of images. Comparison is made against the baseline of the established CMVS (Clustering Views for Multi-view Stereo), which is a free package for selecting vantage images within a huge image collection. For the museum, key outputs from the 3D recording process are visitor interactives which are built around high quality textured mesh models. The paper therefore considers the quality of the output from each process as input to texture model generation. Results demonstrate that whilst both methods can provide high quality records, our new method, Image Network Designer (IND), can provide a better image selection for MVS than CMVS in terms of coordination uncertainty and completeness of the final model for the museum recording of artefacts. Furthermore, the improvements gained, particularly in model completeness, minimise the significant overhead in mesh editing needed to provide a more direct and economical route to 3D model output

Towards an automated photogrammetry-based approach for monitoring and controlling construction site activities

© 2018 Elsevier B.V. The construction industry has a poor productivity record, which was predominantly ascribed to inadequate monitoring of how a project is progressing at any given time. Most available approaches do not offer key stakeholders a shared understanding of project performance in real-time, which as a result fail to identify any project slippage on the original schedule. This paper reports on the development of a novel automatic system for monitoring, updating and controlling construction site activities in real-time. The proposed system seeks to harness advances in close-range photogrammetry to deliver an original approach that is capable of continuous monitoring of construction activities, with progress status determined, at any given time, throughout the construction lifecycle. The proposed approach has the potential to identify any deviation of as planned construction schedules, so prompt action can be taken because of an automatic notification system, which informs decision-makers via emails and SMS. This system was rigorously tested in a real-life case study of an in-progress construction site. The findings revealed that the proposed system achieved a significant high level of accuracy and automation, and was relatively cheap and easier to operate

Image selection in photogrammetric multi-view stereo methods for metric and complete 3D reconstruction

Multi-View Stereo (MVS) as a low cost technique for precise 3D reconstruction can be a rival for laser scanners if the scale of the model is resolved. A fusion of stereo imaging equipment with photogrammetric bundle adjustment and MVS methods, known as photogrammetric MVS, can generate correctly scaled 3D models without using any known object distances. Although a huge number of stereo images (e.g. 200 high resolution images from a small object) captured of the object contains redundant data that allows detailed and accurate 3D reconstruction, the capture and processing time is increased when a vast amount of high resolution images are employed. Moreover, some parts of the object are often missing due to the lack of coverage of all areas. These problems demand a logical selection of the most suitable stereo camera views from the large image dataset. This paper presents a method for clustering and choosing optimal stereo or optionally single images from a large image dataset. The approach focusses on the two key steps of image clustering and iterative image selection. The method is developed within a software application called Imaging Network Designer (IND) and tested by the 3D recording of a gearbox and three metric reference objects. A comparison is made between IND and CMVS, which is a free package for selecting vantage images. The final 3D models obtained from the IND and CMVS approaches are compared with datasets generated with an MMDx Nikon Laser scanner. Results demonstrate that IND can provide a better image selection for MVS than CMVS in terms of surface coordinate uncertainty and completeness. © 2013 SPIE

Automatic semantic and geometric enrichment of CityGML building models using HoG-based template matching

Semantically rich 3D building models give the potential for a wealth of rich geo-spatially-enabled applications such as cultural heritage augmented reality, urban planning, radio network planning and personal navigation. However, the majority of existing building models lack much if any semantic detail. This work demonstrates a novel method for automatically locating subclasses of windows and doors, using computer vision techniques including the histogram of oriented gradient (HoG) template matching, and automatically creating enriched CityGML content for the matched windows and doors. Good results were achieved for class identification with potential for further refinement of subclasses of windows and doors and other architectural features. It is part of a wider project to bring even richer semantic content to 3D geo-spatial building models

Semantic evaluation of 3D city models

The automatic generation of 3D urban models from geospa-tial data is now a standard procedure. However, practitioners still have to visually assess, at city-scale, the correctness of these models and detect inevitable reconstruction errors. Such a process relies on experts, and is highly time-consuming (2 h/km 2 /expert). In this work, we propose an approach for automatically evaluating the quality of 3D building models. Potential errors are compiled in a hierarchical, versatile and parameter-izable taxonomy. This allows for the first time to disentangle fidelity and modeling errors, whatever the level of details of the modeled buildings. The quality of models is predicted using the geometric properties of buildings and, when available, image and depth data. A baseline of handcrafted, yet generic features, is fed to a Random Forest classifier. Both multi-class and multi-label cases are considered. Due to the interdependence between classes of errors, we have the ability to retrieve all errors at the same time while predicting erroneous buildings. We tested our framework on an urban area with more than 1,000 building models. We can satisfactorily detect, on average 96% of the most frequent errors