Benchmarking the RDF(S) interoperability of ontology tools

The number of ontology tools, such as ontology editors and repositories, is constantly rising. Ideally, one could use them all seamlessly and thus benefit from all the functionalities they offer. As shown in previous EON workshops, interoperability among different development tools is not straightforward since ontology editors rely on specific internal knowledge models which are translated into common formats such as RDF(S). This paper addresses the urgent need for interoperability by providing an exhaustive set of RDF(S) benchmarks and demonstrating in an extensive field study the state-of-the-art of interoperability among six ontology tools. From the field study we have compiled a comprehensive set of best practices which may serve as guidelines. Tool developers benefit from having guidelines to design their import and export functionalities and a concrete set of benchmarks against which they can evaluate their import and export functionalities. Ontology engineers benefit from our work by having an overview to which extend interoperability is ensured for combinations of specific tools

Interoperability results for Semantic Web technologies using OWL as the interchange language

Using Semantic Web technologies in complex scenarios requires that such technologies correctly interoperate by interchanging ontologies using the RDF(S) and OWL languages. This interoperability is not straightforward because of the high heterogeneity in Semantic Web technologies and, while the number of such technologies grows, affordable mechanisms for evaluating Semantic Web technology interoperability are needed to comprehend the current and future interoperability of Semantic Web technologies. This paper presents the OWL Interoperability Benchmarking, an international benchmarking activity that involved the evaluation of the interoperability of different Semantic Web technologies using OWL as the interchange language. It describes the evaluation resources used in this benchmarking activity, the OWL Lite Import Benchmark Suite and the IBSE tool, and presents how to use them for evaluating the OWL interoperability of Semantic Web technologies. Moreover, the paper offers an overview of the OWL interoperability results of the eight tools participating in the benchmarking: one ontology-based annotation tool (GATE), three ontology frameworks (Jena, KAON2, and SWI-Prolog), and four ontology development tools (Protégé Frames, Protégé OWL, SemTalk, and WebODE)

Benchmarking in the Semantic Web

The Semantic Web technology needs to be thoroughly evaluated for providing objective results and obtaining massive improvement in its quality; thus, the transfer of this technology from research to industry will speed up. This chapter presents software benchmarking, a process that aims to improve the Semantic Web technology and to find the best practices. The chapter also describes a specific software benchmarking methodology and shows how this methodology has been used to benchmark the interoperability of ontology development tools, employing RDF(S) as the interchange language

The SEALS Yardsticks for Ontology Management

This paper describes the rst SEALS evaluation campaign over ontology engineering tools (i.e., the SEALS Yardsticks for Ontology Management). It presents the dierent evaluation scenarios dened to evaluate the conformance, interoperability and scalability of these tools, and the test data used in these scenarios

An open standard for the exchange of information in the Australian timber sector

The purpose of this paper is to describe business-to-business (B2B) communication and the characteristics of an open standard for electronic communication within the Australian timber and wood products industry. Current issues, future goals and strategies for using business-to-business communication will be considered. From the perspective of the Timber industry sector, this study is important because supply chain efficiency is a key component in an organisation's strategy to gain a competitive advantage in the marketplace. Strong improvement in supply chain performance is possible with improved business-to-business communication which is used both for building trust and providing real time marketing data. Traditional methods such as electronic data interchange (EDI) used to facilitate B2B communication have a number of disadvantages, such as high implementation and running costs and a rigid and inflexible messaging standard. Information and communications technologies (ICT) have supported the emergence of web-based EDI which maintains the advantages of the traditional paradigm while negating the disadvantages. This has been further extended by the advent of the Semantic web which rests on the fundamental idea that web resources should be annotated with semantic markup that captures information about their meaning and facilitates meaningful machine-to-machine communication. This paper provides an ontology using OWL (Web Ontology Language) for the Australian Timber sector that can be used in conjunction with semantic web services to provide effective and cheap B2B communications

RDF(S) Interoperability Results for Semantic Web Technologies

Interoperability among different development tools is not a straightforward task since ontology editors rely on specific internal knowledge models which are translated into common formats such as RDF(S). This paper addresses the urgent need for interoperability by providing an exhaustive set of benchmark suites for evaluating RDF(S) import, export and interoperability. It also demonstrates, in an extensive field study, the state of-the-art of interoperability among six Semantic Web tools. From this field study we have compiled a comprehensive set of practices that may serve as recommendations for Semantic Web tool developers and ontology engineers

Large-scale benchmarking of the OWL interoperability of Semantic Web technologies

--

Interoperability of Protégé using RDF(S) as Interchange Language

--

Defining a Benchmark Suite for Evaluating the Import of OWL Lite Ontologies

SemanticWeb tools should be able to correctly interchange ontologies and, therefore, to interoperate. This interchange is not always a straightforward task if tools have different underlying knowledge representation paradigms. This paper describes the process followed to define a benchmark suite for evaluating the OWL import capabilities of ontology development tools in a benchmarking activity in progress in the Knowledge Web European Network of Excellence

IBSE: An OWL Interoperability Evaluation Infrastructure

The technology that supports the Semantic Web presents a great diversity and, whereas all the tools use different types of ontologies, not all of them share a common knowledge representation model, which may pose problems when they try to interoperate. The Knowledge Web European Network of Excellence is organizing a benchmarking of interoperability of ontology tools using OWL as interchange language with the goal of assessing and improving tool interoperability. This paper presents the development of IBSE, an evaluation infrastructure that allows executing automatically the benchmarking experiments and provides an easy way of analysing the results. Thus,including new tools into the evaluation infrastructure will be simple and straightforward