Leveraging Semantic Web Service Descriptions for Validation by Automated Functional Testing

Recent years have seen the utilisation of Semantic Web Service descriptions for automating a wide range of service-related activities, with a primary focus on service discovery, composition, execution and mediation. An important area which so far has received less attention is service validation, whereby advertised services are proven to conform to required behavioural specifications. This paper proposes a method for validation of service-oriented systems through automated functional testing. The method leverages ontology-based and rule-based descriptions of service inputs, outputs, preconditions and effects (IOPE) for constructing a stateful EFSM specification. The specification is subsequently utilised for functional testing and validation using the proven Stream X-machine (SXM) testing methodology. Complete functional test sets are generated automatically at an abstract level and are then applied to concrete Web services, using test drivers created from the Web service descriptions. The testing method comes with completeness guarantees and provides a strong method for validating the behaviour of Web services

Many-core compiler fuzzing

We address the compiler correctness problem for many-core systems through novel applications of fuzz testing to OpenCL compilers. Focusing on two methods from prior work, random differential testing and testing via equivalence modulo inputs (EMI), we present several strategies for random generation of deterministic, communicating OpenCL kernels, and an injection mechanism that allows EMI testing to be applied to kernels that otherwise exhibit little or no dynamically-dead code. We use these methods to conduct a large, controlled testing campaign with respect to 21 OpenCL (device, compiler) configurations, covering a range of CPU, GPU, accelerator, FPGA and emulator implementations. Our study provides independent validation of claims in prior work related to the effectiveness of random differential testing and EMI testing, proposes novel methods for lifting these techniques to the many-core setting and reveals a significant number of OpenCL compiler bugs in commercial implementations

Development Mathematical Problem Solving Problems At Junior High School

This is development researched which aims at (1) constructing valid and practical mathematical test items based on some problem-solving skills for junior high school students, and (2) finding out the potential effects of such test items after their third or final prototype construction. Those test item were tested to 41 ninth grade students of the state junior high school number 9 in Palembang in academic year 2010/2011. The data were collected through “walk-through” for the test validation by experts. Their validation will result in accurate tests. In addition, the application of small group testing will result in practical potential positive effects for mathematical problem solving skill. Finally, this study reached good level as shown by the mean score “71”. Key words: development research, mathematical problem solvin

Falsification testing for usability inspection method assessment

We need more reliable usability inspection methods (UIMs), but assessment of UIMs has been unreliable [5]. We can only reliably improve UIMs if we have more reliable assessment. When assessing UIMs, we need to code analysts’ predictions as true or false positives or negatives, or as genuinely missed problems. Defenders of UIMs often claim that false positives cannot be accurately coded, i.e., that a prediction is true but has never shown up through user testing or other validation approaches. We show this and similar claims to be mistaken by briefly reviewing methods for reliable coding of each of five types of prediction outcome. We focus on falsification testing, which allows confident coding of false positives

Development of an experimental space station model for structural dynamics research

Design, analysis, and testing of an experimental space station scale model is presented. The model contains hardware components with dynamic characteristics similar to those expected for other large space structures. Validation of analysis models is achieved through correlation with dynamic tests of hardware components and representative assembly configurations. A component mode synthesis analysis method is examined through comparisons with results from fully mated system models. Selection of input requirements for accurate component synthesis analysis predictions are assessed

Putting formal specifications under the magnifying glass: Model-based testing for validation

A software development process is effectively an abstract form of model transformation, starting from an end-user model of requirements, through to a system model for which code can be automatically generated. The success (or failure) of such a transformation depends substantially on obtaining a correct, well-formed initial model that captures user concerns. Model-based testing automates black box testing based on the model of the system under analysis. This paper proposes and evaluates a novel model-based testing technique that aims to reveal specification/requirement-related errors by generating test cases from a test model and exercising them on the design model. The case study outlined in the paper shows that a separate test model not only increases the level of objectivity of the requirements, but also supports the validation of the system under test through test case generation. The results obtained from the case study support the hypothesis that there may be discrepancies between the formal specification of the system modeled at developer end and the problem to be solved, and using solely formal verification methods may not be sufficient to reveal these. The approach presented in this paper aims at providing means to obtain greater confidence in the design model that is used as the basis for code generation

Gamifying Information System Testing–Qualitative Validation through Focus Group Discussion

This paper presents the evaluation of a developed gamified Information System Testing platform through results obtained from focus group sessions with software developers and testers. The purpose of this study is to understand if the developed tool and platform can help Information System Testing to be interesting while increasing the engagement of software testers in a rewarding testing environment. Findings suggest that choosing suitable game elements to design a gamified environment for performing serious tasks is very important. Moreover, findings suggest that the developed tool and gamification may be a solution to increase testers’ engagement and testing experience. Furthermore, participants suggested that game elements such as feedback and comparison may increase testing motivation, engagement and experience of software testers. The majority of participants rated the feedback element as a vital element in a gamified Information System Testing environment