22 research outputs found
A New Method of Gold Foil Damage Detection in Stone Carving Relics Based on Multi-Temporal 3D LiDAR Point Clouds
The timely detection of gold foil damage in gold-overlaid stone carvings and the associated maintenance of these relics pose several challenges to both the research and heritage protection communities internationally. This paper presents a new method for detecting gold foil damage by making use of multi-temporal 3D LiDAR point clouds. By analyzing the errors involved in the detection process, a formula is developed for calculation of the damage detection threshold. An improved division method for the linear octree that only allocates memory to the non-blank nodes, is proposed, which improves storage and retrieval efficiency for the point clouds. Meanwhile, the damage-occurrence regions are determined according to Hausdorff distances. Using a triangular mesh, damaged regions can be identified and measured in order to determine the relic’s total damaged area. Results demonstrate that this method can effectively detect gold foil damage in stone carvings. The identified surface area of damaged regions can provide the information needed for subsequent restoration and protection of relics of this type
Extraction of Hidden Information under Sootiness on Murals Based on Hyperspectral Image Enhancement
Changes in the environment and human activities can cause serious deterioration of murals. Hyperspectral imaging technology can observe murals in the range of visible to near infrared light, providing a scientific and non-destructive way for mural digital preservation. An effective method to extract hidden information from the sootiness of murals in order to enhance the visual value of patterns in ancient murals using hyperspectral imaging is proposed in this paper. Firstly, Minimum Noise Fraction transform was applied to reduce sootiness features in the background of the mural. Secondly, analysis of spectral characteristics and image subtraction were used to achieve feature enhancement of the murals. Finally, density slicing was performed to extract the patterns under the sootiness. The results showed that the extraction of hidden information was achieved with an overall accuracy of 88.97%
Knowledge graph representation method for semantic 3D modeling of Chinese grottoes
Abstract The integration of 3D geometric models with semantic information significantly improves the applicability and comprehensibility of cultural heritage. The semantic 3D modeling of Chinese grottoes poses challenges for individuals without expertise in cultural heritage due to gaps in domain knowledge and discrepancies in understanding. However, the existing domain ontology and knowledge graph provide an insufficient representation of the knowledge of Chinese grottoes. To overcome these obstacles, we propose a knowledge graph representation method to provide explicit knowledge for participants at different stages of semantic 3D modeling of Chinese grottoes, which includes schema layer construction and data layer construction. On the schema layer, we design a domain ontology named ChgOnto (Chinese Grottoes Ontology) that consists of four high-level concept classes: spatial object, informational object, digital device, and temporal object. Among the classes in the ChgOnto, the components (e.g., cliff wall, cave roof, cliff wall footing), elements (e.g., primary Buddha statue, pedestal, decoration), the properties (e.g., length, width, depth) of caves and niches in Chinese grottoes as well as the spatial relationships between them are all precisely defined. ChgOnto also reuse the classes from the renowned CIDOC CRM ontology in the cultural heritage field and GeoSPARQL in the geospatial domain, facilitating integration between the two subjects. Considering the schema layer as the conceptual data model, the data layer extracts knowledge from unstructured text through natural language processing tools to instantiate the abstract classes and fill the properties of the schema layer. Finally, the knowledge required for semantic 3D modeling of Chinese grottoes is expressed in the data layer by a knowledge graph in a fixed expression form. Dazu Rock Carvings, a World Heritage site in China, is selected as a case study to validate the practicality and effectiveness of the proposed method. The results reveal that our method offers a robust knowledge-sharing platform for the semantic 3D modeling of Chinese grottoes and demonstrates excellent scalability. The method proposed in this paper can also serve as an informative reference for other types of cultural heritage
The Point Cloud Semantic Segmentation Method for the Ming and Qing Dynasties’ Official-Style Architecture Roof Considering the Construction Regulations
Point cloud semantic segmentation has played an important role in the scan-to-BIM process of the Ming and Qing Dynasties’ official-style architecture roof. To overcome the complexity of roof components’ shape and the scale differences between different roof component types, a point cloud semantic segmentation method for the MQDOAs roof considering the construction regulations is proposed in this paper. This method is composed of two stages. In the first stage, the features from the construction rules of MQDOAs, including the normalized symmetrical distance (NSD), relative height (RH) and local height difference (LHD), are extracted alongside the regular geometric features. To lower the influence of scale differences, a multi-scale feature connection strategy is also applied to construct the feature classification vector. In the second stage, RF method is applied to classify the point cloud. To verify the efficiency of the proposed method, we took the Hall of Complete Harmony as the study case. The experiments showed that our method achieved segmentation result in overall classification accuracy and reached 96.8%
Three-Dimensional Point Cloud Semantic Segmentation for Cultural Heritage: A Comprehensive Review
In the cultural heritage field, point clouds, as important raw data of geomatics, are not only three-dimensional (3D) spatial presentations of 3D objects but they also have the potential to gradually advance towards an intelligent data structure with scene understanding, autonomous cognition, and a decision-making ability. The approach of point cloud semantic segmentation as a preliminary stage can help to realize this advancement. With the demand for semantic comprehensibility of point cloud data and the widespread application of machine learning and deep learning approaches in point cloud semantic segmentation, there is a need for a comprehensive literature review covering the topics from the point cloud data acquisition to semantic segmentation algorithms with application strategies in cultural heritage. This paper first reviews the current trends of acquiring point cloud data of cultural heritage from a single platform with multiple sensors and multi-platform collaborative data fusion. Then, the point cloud semantic segmentation algorithms are discussed with their advantages, disadvantages, and specific applications in the cultural heritage field. These algorithms include region growing, model fitting, unsupervised clustering, supervised machine learning, and deep learning. In addition, we summarized the public benchmark point cloud datasets related to cultural heritage. Finally, the problems and constructive development trends of 3D point cloud semantic segmentation in the cultural heritage field are presented
Reconstruction of Complex Roof Semantic Structures from 3D Point Clouds Using Local Convexity and Consistency
Three-dimensional (3D) building models are closely related to human activities in urban environments. Due to the variations in building styles and complexity in roof structures, automatically reconstructing 3D buildings with semantics and topology information still faces big challenges. In this paper, we present an automated modeling approach that can semantically decompose and reconstruct the complex building light detection and ranging (LiDAR) point clouds into simple parametric structures, and each generated structure is an unambiguous roof semantic unit without overlapping planar primitive. The proposed method starts by extracting roof planes using a multi-label energy minimization solution, followed by constructing a roof connection graph associated with proximity, similarity, and consistency attributes. Furthermore, a progressive decomposition and reconstruction algorithm is introduced to generate explicit semantic subparts and hierarchical representation of an isolated building. The proposed approach is performed on two various datasets and compared with the state-of-the-art reconstruction techniques. The experimental modeling results, including the assessment using the International Society for Photogrammetry and Remote Sensing (ISPRS) benchmark LiDAR datasets, demonstrate that the proposed modeling method can efficiently decompose complex building models into interpretable semantic structures
A study on the detection of bulging disease in ancient city walls based on fitted initial outer planes from 3D point cloud data
Abstract Bulging is a common disease suffered by ancient city walls, especially clay brick walls. Bulging affects or even threatens the stability of outer structures of ancient city walls. Therefore, accurate identification of bulges is one of the urgent issues to be addressed in ancient city wall conservation. In this study, a novel method is proposed for detecting and identifying bulge information using point cloud data collected from the outer surface of an ancient city wall. The non-bulging points are identified in the sliced point cloud of a city wall, and then the initial plane of the city wall is fitted more accurately with the aid of spatial constraints. Finally, the bulging damage is identified and extracted by comparing the initial plane with the original point cloud. This method was applied to the project of ancient city wall conservation and was compared with other existing methods in effectiveness and accuracy. The results show that the proposed method can detect efficiently budging disease in ancient city walls for architectural heritage conservation
Modeling and Processing of Smart Point Clouds of Cultural Relics with Complex Geometries
The digital documentation of cultural relics plays an important role in archiving, protection, and management. In the field of cultural heritage, three-dimensional (3D) point cloud data is effective at expressing complex geometric structures and geometric details on the surface of cultural relics, but lacks semantic information. To elaborate the geometric information of cultural relics and add meaningful semantic information, we propose a modeling and processing method of smart point clouds of cultural relics with complex geometries. An information modeling framework for complex geometric cultural relics was designed based on the concept of smart point clouds, in which 3D point cloud data are organized through the time dimension and different spatial scales indicating different geometric details. The proposed model allows smart point clouds or a subset to be linked with semantic information or related documents. As such, this novel information modeling framework can be used to describe rich semantic information and high-level details of geometry. The proposed information model not only expresses the complex geometric structure of the cultural relics and the geometric details on the surface, but also has rich semantic information, and can even be associated with documents. A case study of the Dazu Thousand-Hand Bodhisattva Statue, which is characterized by a variety of complex geometries, reveals that our proposed framework is capable of modeling and processing the statue with excellent applicability and expansibility. This work provides insights into the sustainable development of cultural heritage protection globally
Design and Implementation of A New-type Cloud Computing Examination System
With the rapid development of network technology, large enterprises have established their own online learning and examination system respectively. However, as those network examination systems are dispersive, closed and disconnected, so various resources are unable to be utilized in a balanced way, which may cause substantial waste of enterprise resources. To solve such a problem, the emerging cloud computing technology with the characteristics of service on demand and dynamic expansion capability, provides a possibility of a shared network examination system with lower cost, named as cloud exam support service. A feasible solution for the application of the cloud computing technology in the network examination, which combines the theoretical analysis, system design and technical implementation, is put forward in this paper. The design, development, and pilot application of the cloud examination system described in this paper show that this study is highly practical, operable, and worthy of application and popularization