Using Vapnik–Chervonenkis Dimension to Analyze the Testing Complexity of Program Segments

AbstractWe examine the complexity of testing different program constructs. We do this by defining a measure of testing complexity known as VCP-dimension, which is similar to the Vapnik–Chervonenkis dimension, and applying it to classes of programs, where all programs in a class share the same syntactic structure. VCP-dimension gives bounds on the number of test points needed to determine that a program is approximately correct, so by studying it for a class of programs we gain insight into the difficulty of testing the program construct represented by the class. We investigate the VCP-dimension of straight line code, if–then–else statements, and for loops. We also compare the VCP-dimension of nested and sequential if–then–else statements as well as that of two types of for loops with embedded if–then–else statements. Finally, we perform an empirical study to estimate the expected complexity of straight line code

Mobilo lietotņu testēšana.

Darbā ir sniegts pārskats par programmatūras testēšanu metalīmenī. Autors ir izpētījis aspektus, kas ietekmē funkcionālo testēšanu jo īpaši iOS lietotnēm, kā arī mobilajām lietotnēm kopumā. Darbā ir izpētītas arī drošības iespējas un izstrādes/testēšanas “pārpalikumi”, kas bieži tiek atstāti bez ievērības un nesakārtoti lietotņu ātrākai pieejamībai tirgū. Atsevišķa nodaļa ir veltīta mobilo lietotāju saskarņu automātisko testēšanas rīku pētīšanai un klasterizācijai. “Ārā no kastes” Apple UIAutomation rīka ierobežojumu pārvarēšana ir apvienota tTap ietvarā, kuru izstrādāja autors. Analizējot paveikto, tika izveidots “ideāla” starpplatformu mobilo lietotāja saskarnes testēšanas automatizācijas rīka priekšlikums. Promocijas darbam piemīt praktiskais raksturs. Visa ar mobilo lietotņu testēšanas saistītā informācija tika savākta vai pārbaudīta reālo mobilo lietotņu projektu izstrādes laikā.The thesis gives an overview of software testing on the meta-level. Aspects that influence functional testing of iOS apps in particular, and mobile – in general, were investigated by the author. The thesis also exposes the security capabilities and development/ testing leftovers that often are neglected and not cleaned up in favor of time to market rush. A separate chapter of the thesis deals with mobile UI test automation tools investigation and clustering. Solutions aimed at overcoming the limitations of out of the box Apple UIAutomation are united in tTap framework developed by the author. The analysis performed on mobile UI test automation tools united with the solutions used in tTap framework resulted in the ideal cross-platform mobile UI test automation tool proposal. The whole thesis has a practical flavor. All mobile testing related information has been verified or gathered during the real mobile software development projects executio