A benchmark suite for evaluating the performance of the WebODE Ontology Engineering Platform

Ontology tools play a key role in the development and maintenance of the Semantic Web. Hence, we need in one hand to objectively evaluate these tools, in order to analyse whether they can deal with actual and future requirements, and in the other hand to develop benchmark suites for performing these evaluations. In this paper, we describe the method we have followed to design and implement a benchmark suite for evaluating the performance of the WebODE ontology engineering workbench, along with the conclusions obtained after using this benchmark suite for evaluating WebODE

Towards a benchmark of the ODE API methods for accessing ontologies in the WebODE platform

Ontology editors and ontology engineering platforms allow creating and maintaining ontologies and using them in a wide range of applications, but there are neither specific benchmark for evaluating ontology platforms nor for evaluating their ontology access services. In this paper we present how we have designed and structured a benchmark for the ontology access services of the WebODE platform. We also present some results and analysis of the benchmark suite execution

Benchmarking ontology tools. A case study for the WebODE platform

As the Semantic Web grows the number of tools that support it increases, and a new need arises: the assessment of these tools in order to analyse whether they can deal with actual and future performance requirements. In order to evaluate ontology tools’ performance, the development and use of benchmark suites for these tools is needed. In this paper we describe the design and execution of a benchmark suite for assessing the performance of the WebODE ontology engineering workbench

Benchmarking Semantic Web Technology

This paper summarises the research problem that the PhD thesis I am currently writing addresses. It presents an overview of the thesis, its goals taking into account the deciencies of the State of the Art, the approach followed, and the work performed for the thesis since its beginning in 2004

The state of semantic technology today - overview of the first SEALS evaluation campaigns

This paper describes the first five SEALS Evaluation Campaigns over the semantic technologies covered by the SEALS project (ontology engineering tools, ontology reasoning tools, ontology matching tools, semantic search tools, and semantic web service tools). It presents the evaluations and test data used in these campaigns and the tools that participated in them along with a comparative analysis of their results. It also presents some lessons learnt after the execution of the evaluation campaigns and draws some final conclusions

Infraestructura tecnológica de servicios semánticos para la Web Semántica

This project aims at creating a network of distributed interoperable semantic services for building more complex ones. These services will be available in semantic Web service libraries, so that they can be invoked by other systems (e.g., semantic portals, software agents, etc.). Thus, to accomplish this objective, the project proposes: a) To create specific technology for developing and composing Semantic Web Services. b) To migrate the WebODE ontology development workbench to this new distributed interoperable semantic service architecture. c) To develop new semantic services (ontology learning, ontology mappings, incremental ontology evaluation, and ontology evolution). d) To develop technological support that eases semantic portal interoperability, using Web services and Semantic Web Services. The project results will be open source, so as to improve their technological transfer. The quality of these results is ensured by a benchmarking process. Keywords: Ontologies and Semantic We

Architecture and usability of OntoKeeper, an ontology evaluation tool

Abstract Background The existing community-wide bodies of biomedical ontologies are known to contain quality and content problems. Past research has revealed various errors related to their semantics and logical structure. Automated tools may help to ease the ontology construction, maintenance, assessment and quality assurance processes. However, there are relatively few tools that exist that can provide this support to knowledge engineers. Method We introduce OntoKeeper as a web-based tool that can automate quality scoring for ontology developers. We enlisted 5 experienced ontologists to test the tool and then administered the System Usability Scale to measure their assessment. Results In this paper, we present usability results from 5 ontologists revealing high system usability of OntoKeeper, and use-cases that demonstrate its capabilities in previous published biomedical ontology research. Conclusion To the best of our knowledge, OntoKeeper is the first of a few ontology evaluation tools that can help provide ontology evaluation functionality for knowledge engineers with good usability.https://deepblue.lib.umich.edu/bitstream/2027.42/152214/1/12911_2019_Article_859.pd

An ontology-based semantic building post-occupancy evaluation framework and its application

This thesis was submitted for the award of Doctor of Philosophy and was awarded by Brunel University LondonCatering to sustainable development in Architecture, Engineering and Construction (AEC) industry, many building performance evaluation (BPE) schemas have been developed to support building assessment and aim to narrow down the performance gap. Post-Occupancy Evaluation (POE), viewed as a sub-process of BPE, is a systematic method to obtain feedback on building performance in use. However, building evaluation is a complex and knowledge-intensive process with scattered and fragmented knowledge, it is time-consuming and error-prone to acquire explicit knowledge. Benefiting from the advantages of Semantic Web technology in knowledge conceptualization, ontology, as the core of the Semantic Web, has been widely taken as an effective method for knowledge management, information representation and extraction, and logical inference in the AEC industry, especially in the BPE field. However, most of the existing ontologies in the AEC industry are lightweight ontologies that mainly focus on building a structured system to represent the specific domain knowledge or information, without developing formal axioms and constraints to provide higher expressivity. Moreover, the research focus of ontology in building assessment is mainly on energy-related fields, and there is not a comprehensive POE ontology yet, especially with the focus on building occupant satisfaction, which is the starting point of this research. This research develops an ontology-based post-occupancy evaluation framework dedicated to building performance assessment, with the ultimate aim of optimizing building operation and improving building occupants' use experience quality and well-being. In the developed framework, a heavyweight ontology is developed to structure the fragmented building performance assessment knowledge in the POE domain. In POE ontology, the building occupants' needs for building performance are generalized and classified, and the corresponded building performance assessment knowledge is formalized. In addition, a set of SWRL (Semantic Web Rule Language) rules and SQWRL (Semantic Query-Enhanced Web Rule Language) query rules are developed based on the benchmarking evaluation axioms to enable automatic rule-based reasoning and query in different identified application scenarios. This ontology model enables effective POE-related knowledge retrieving and sharing, and promotes its implementation in the POE domain. To validate the developed framework, a case study is carried out facilitated by the Building Use Studies (BUS) Methodology to illustrate its feasibility and effectiveness in different application scenarios. This research concludes that the proposed ontology-based POE framework has the capability to conduct a multi-objective and multi-criteria POE assessment at the building operation stage and provide a multi-criteria optimised solution

A Prototype Method and Tool to Facilitate Knowledge Sharing in the New Product Development Process

New Product Development (NPD) plays a critical role in the success of manufacturing firms. Activities in the product development process are dependent on the exchange of knowledge among NPD project team members. Increasingly, many organisations consider effective knowledge sharing to be a source of competitive advantage. However, the sharing of knowledge is often inhibited in various ways. This doctoral research presents an exploratory case study conducted at a multinational physical goods manufacturer. This investigation uncovered three, empirically derived and theoretically informed, barriers to knowledge sharing. They have been articulated as the lack of an explicit definition of information about the knowledge used and generated in the product development process, and the absence of mechanisms to make this information accessible in a multilingual environment and to disseminate it to NPD project team members. Collectively, these barriers inhibit a shared understanding of product development process knowledge. Existing knowledge management methodologies have focused on the capture of knowledge, rather than providing information about the knowledge and have not explicitly addressed issues regarding knowledge sharing in a multilingual environment. This thesis reports a prototype method and tool to facilitate knowledge sharing that addresses all three knowledge sharing barriers. Initially the research set out to identify and classify new product development process knowledge and then sought to determine what information about specific knowledge items is required by project teams. Based on the exploratory case findings, an ontology has been developed that formally defines information about this knowledge and allows it to be captured in a knowledge acquisition tool, thereby creating a knowledge base. A mechanism is provided to permit language labels to be attached to concepts and relations in the ontology, making it accessible to speakers of different languages. A dissemination tool allows the ontology and knowledge base to be viewed via a Web browser client. Essentially, the ontology and mechanisms facilitate a knowledge sharing capability. Some initial validation was conducted to better understand implementation issues and future deployment of the prototype method and tool in practice