Trade-off between automated and manual testing: A production possibility curve cost model

Testing is always important for Software Quality Assurance (SQA) activities and key cost multiplier in software development. The decision to automate or not to automate a test case is critical. In this paper we discuss the possibility of test automation and in relation to the trade-off between manual and automated test cases. We purpose a Production cost frontier based technique to distinguish the point of automation and manual test within the cost constraints. Our objective is to identify the facts that up to what extant a testing process can be automated. In this paper a cost model is proposed for deciding the proportion of automated and manual testing. The objective is to find best possible combination of these two and production possibility in one type by eliminating the other type of testin

Visualizing test diversity to support test optimisation

Diversity has been used as an effective criteria to optimise test suites for cost-effective testing. Particularly, diversity-based (alternatively referred to as similarity-based) techniques have the benefit of being generic and applicable across different Systems Under Test (SUT), and have been used to automatically select or prioritise large sets of test cases. However, it is a challenge to feedback diversity information to developers and testers since results are typically many-dimensional. Furthermore, the generality of diversity-based approaches makes it harder to choose when and where to apply them. In this paper we address these challenges by investigating: i) what are the trade-off in using different sources of diversity (e.g., diversity of test requirements or test scripts) to optimise large test suites, and ii) how visualisation of test diversity data can assist testers for test optimisation and improvement. We perform a case study on three industrial projects and present quantitative results on the fault detection capabilities and redundancy levels of different sets of test cases. Our key result is that test similarity maps, based on pair-wise diversity calculations, helped industrial practitioners identify issues with their test repositories and decide on actions to improve. We conclude that the visualisation of diversity information can assist testers in their maintenance and optimisation activities

Automated Image Analysis of Offshore Infrastructure Marine Biofouling

Supplementary Materials: The following are available online at www.mdpi.com/2077-1312/6/1/2/s1 Acknowledgments: This project was funded by the Natural Environmental Research Council (NERC) project No.: NE/N019865/1. The authors would like to thank Melanie Netherway and Don Orr, from our project partner (company requested to remain anonymous) for the provision of survey footage and for supporting the project. In addition, many thanks to Oscar Beijbom, University California Berkley for providing guidance and support to the project. Additional thanks to Calum Reay, Bibby Offshore; George Gair, Subsea 7; and Alan Buchan, Wood Group Kenny for help with footage collection and for allowing us to host workshops with them and their teams, their feedback and insights were very much appreciated.Peer reviewedPublisher PD