Leveraging Semantic Web Service Descriptions for Validation by Automated Functional Testing

Recent years have seen the utilisation of Semantic Web Service descriptions for automating a wide range of service-related activities, with a primary focus on service discovery, composition, execution and mediation. An important area which so far has received less attention is service validation, whereby advertised services are proven to conform to required behavioural specifications. This paper proposes a method for validation of service-oriented systems through automated functional testing. The method leverages ontology-based and rule-based descriptions of service inputs, outputs, preconditions and effects (IOPE) for constructing a stateful EFSM specification. The specification is subsequently utilised for functional testing and validation using the proven Stream X-machine (SXM) testing methodology. Complete functional test sets are generated automatically at an abstract level and are then applied to concrete Web services, using test drivers created from the Web service descriptions. The testing method comes with completeness guarantees and provides a strong method for validating the behaviour of Web services

Discovery and Selection of Certified Web Services Through Registry-Based Testing and Verification

Reliability and trust are fundamental prerequisites for the establishment of functional relationships among peers in a Collaborative Networked Organisation (CNO), especially in the context of Virtual Enterprises where economic benefits can be directly at stake. This paper presents a novel approach towards effective service discovery and selection that is no longer based on informal, ambiguous and potentially unreliable service descriptions, but on formal specifications that can be used to verify and certify the actual Web service implementations. We propose the use of Stream X-machines (SXMs) as a powerful modelling formalism for constructing the behavioural specification of a Web service, for performing verification through the generation of exhaustive test cases, and for performing validation through animation or model checking during service selection

Enabling Proactive Adaptation through Just-in-time Testing of Conversational Services

Service-based applications (SBAs) will increasingly be composed of third-party services available over the Internet. Reacting to failures of those third-party services by dynamically adapting the SBAs will become a key enabler for ensuring reliability. Determining when to adapt an SBA is especially challenging in the presence of conversational (aka. stateful) services. A conversational service might fail in the middle of an invocation sequence, in which case adapting the SBA might be costly; e.g., due to the necessary state transfer to an alternative service. In this paper we propose just-in-time testing of conversational services as a novel approach to detect potential problems and to proactively trigger adaptations, thereby preventing costly compensation activities. The approach is based on a framework for online testing and a formal test-generation method which guarantees functional correctness for conversational services. The applicability of the approach is discussed with respect to its underlying assumptions and its performance. The benefits of the approach are demonstrated using a realistic example

The state of semantic technology today - overview of the first SEALS evaluation campaigns

This paper describes the first five SEALS Evaluation Campaigns over the semantic technologies covered by the SEALS project (ontology engineering tools, ontology reasoning tools, ontology matching tools, semantic search tools, and semantic web service tools). It presents the evaluations and test data used in these campaigns and the tools that participated in them along with a comparative analysis of their results. It also presents some lessons learnt after the execution of the evaluation campaigns and draws some final conclusions

An extensible architecture for run-time monitoring of conversational web services

Trust in Web services will be greatly enhanced if these are subject to run-time verification, even if they were previously tested, since their context of execution is subject to continuous change; and services may also be upgraded without notifying their consumers in advance. Conversational Web services introduce added complexity when it comes to run-time verification, since they follow a conversation protocol and they have a state bound to the session of each consumer accessing them. Furthermore, conversational Web services have different policies on how they maintain their state. Access to states can be private or shared; and states may be transient or persistent. These differences must be taken into account when building a scalable architecture for run-time verification through monitoring. This paper, building on a previously proposed theoretical framework for run-time verification of conversational Web services, presents the design, implementation and validation of a novel run-time monitoring architecture for conversational services, which aims to provide a holistic monitoring framework enabling the integration of different verification tools. The architecture is validated by running a sequence of test scenarios, based on a realistic example. The experimental results revealed that the monitoring activities have a tolerable overhead on the operation of a Web service

A Services\u27 Frameworks And Support Services For Environmental Information Communities

For environmental datasets to be used effectively via the Internet, they must present standardized data and metadata services and link the two. The Open Geospatial Consortium\u27s (OGC) web services (WFS, WMS, CSW etc.), have seen widespread use over many years however few organizations have deployed information architectures based solely on OGC standards for all their datasets. Collections of organizations within a thematically-based community certainly cannot realistically be expected to do so. To enable service use flexibility we present a services framework - a Data Brokering Layer (DBL). A DBL presents access to data and metadata services for datasets, and links between them, in a standardized manner based on Linked Data and Semantic Web principles. By specifying regular access methods to any data or metadata service relevant for a dataset, community organizers allow a wide range of services for use within their community. Additionally, a community service profile testing service – a Conformance Service – may be run that reveals the day-to-day status of all of a community’s services to be known allowing both better end-user experiences and also that data providers’ data is acceptable to a community and continues to remains available for use. We present DBL and Conformance Service designs as well as a whole-of-community architecture that facilitates the use of the two. We describe implementations of them within two Australian environmental information communities: eReefs and Bioregional Assessments and plans for wider deployment

Análisis de Enfoques de Model Based Testing para Pruebas Funcionales orientados a Aplicaciones Web

En los últimos años las aplicaciones web han ido incrementando en número y a la vez en complejidad debido a la incorporación de nueva tecnología. Esto ha repercutido en un aumento de complejidad de la fase de pruebas dentro del ciclo de vida del desarrollo de software, la cual nos permite asegurar la calidad del producto desarrollado. Esta fase representa un mayor costo y esfuerzo. Con otro tipo de aplicaciones no se le asignaba el tiempo ni esfuerzo necesario. Sin embargo, debido al impacto que puede tener una aplicación web mal probada durante la puesta en marcha de la aplicación, han surgido diversas investigaciones en técnicas para la simplificación de la fase de pruebas. Una de estas técnicas es model based testing, que mediante la representación del comportamiento esperado de la aplicación, genera automáticamente los casos de prueba, incluso permite la ejecución automática de los mismos y su evaluación. El presente trabajo presenta una revisión analítica de los enfoques en model based testing para aplicaciones web orientados a pruebas funcionales, identificando para ello los enfoques existentes dentro de este contexto y realizando un esquema de caracterización para el análisis de las principales características, herramientas y documentación disponible para la aplicación de los enfoques.Universidad de Sevilla. Master Universitario en Ingeniería y Tecnología del Softwar