The Co-Evolution of Test Maintenance and Code Maintenance through the lens of Fine-Grained Semantic Changes

Automatic testing is a widely adopted technique for improving software quality. Software developers add, remove and update test methods and test classes as part of the software development process as well as during the evolution phase, following the initial release. In this work we conduct a large scale study of 61 popular open source projects and report the relationships we have established between test maintenance, production code maintenance, and semantic changes (e.g, statement added, method removed, etc.). performed in developers' commits. We build predictive models, and show that the number of tests in a software project can be well predicted by employing code maintenance profiles (i.e., how many commits were performed in each of the maintenance activities: corrective, perfective, adaptive). Our findings also reveal that more often than not, developers perform code fixes without performing complementary test maintenance in the same commit (e.g., update an existing test or add a new one). When developers do perform test maintenance, it is likely to be affected by the semantic changes they perform as part of their commit. Our work is based on studying 61 popular open source projects, comprised of over 240,000 commits consisting of over 16,000,000 semantic change type instances, performed by over 4,000 software engineers.Comment: postprint, ICSME 201

On test sets for checking morphism equivalence on languages with fair distribution of letters

AbstractA test set for a language L is a finite subset T of L with the property that each pair of morphisms that agrees on T also agrees on L. Some results concerning test sets for languages with fair distribution of letters are presented. The first result is that every D0L language with fair distribution of letters has a test set. The second result shows that every language L with fair distribution has a test set relative to morphisms g, h which have bounded balance on L. These results are generalizations of results of Culik II and Karhumäki (1983)