2 research outputs found
Towards an Automated Unified Framework to Run Applications for Combinatorial Interaction Testing
Combinatorial interaction testing (CIT) is a well-known technique, but the
industrial experience is needed to determine its effectiveness in different
application domains. We present a case study introducing a unified framework
for generating, executing and verifying CIT test suites, based on the
open-source Avocado test framework. In addition, we present a new industrial
case study to demonstrate the effectiveness of the framework. This evaluation
showed that the new framework can generate, execute, and verify effective
combinatorial interaction test suites for detecting configuration failures
(invalid configurations) in a virtualization system.Comment: The 23rd International Conference on Evaluation and Assessment in
Software Engineering (EASE2019
Avocado: Open-Source Flexible Constrained Interaction Testing for Practical Application
This paper presents the outcome of a research collaboration between academia
and industry to implement and utilize the capabilities of constrained
interaction testing for an open-source tool for industrial-scale application.
The project helps promote flexibility in generating constrained interaction
test suites, executing them, and setting up a test oracle to report them--all
within the same tool called Avocado. Avocado employs a constraint solver with
computational algorithms to generate constrained interaction test suites. The
environment of the application under test can be set up to execute the
generated test suite with minimum effort. A test oracle can be set up by the
tool to report the status and the results of the executed test cases. Avocado
represents a comprehensive and flexible solution for conducting combinatorial
interaction testing (CIT) and constrained CIT on an industrial application. In
this paper, we present the structure of the tool and our method of implementing
the algorithms in detail.Comment: 6 page