Avoiding coincidental correctness in boundary value analysis

In partition analysis we divide the input domain to form subdomains on which the system's behaviour should be uniform. Boundary value analysis produces test inputs near each subdomain's boundaries to find failures caused by incorrect implementation of the boundaries. However, boundary value analysis can be adversely affected by coincidental correctness---the system produces the expected output, but for the wrong reason. This article shows how boundary value analysis can be adapted in order to reduce the likelihood of coincidental correctness. The main contribution is to cases of automated test data generation in which we cannot rely on the expertise of a tester

Boundary Value Analysis for Input Variables with Functional Dependency

Software in today’s world is used more and in different ways as well than ever before. From microwaves and vehicles to space rockets and smart cards. Usually, a software programmer goes through a certain process to establish a software that will follow a given specification. Despite the hard work of the programmer, sometimes they make mistakes or sometimes they forget to include all the possibilities of the question for which they are writing the program, which is very humanly in nature. And for those mistakes, a testing unit is always there. There are numerous techniques of Software Testing, one of which is Boundary Value Analysis. A modified version of Boundary Value Analysis using input parameters with functional dependency is proposed in this work. The idea is derived from the inter dependency of functions among the input parameters. With this modified algorithm, an automated testing tool is created and implemented. This testing tool shows the advantages of the modified algorithm developed over the Functional Tree Approach and reduces a significant amount of test cases that leads to an exhaustive testing. This modified method will test almost every possible required test case increasing the system’s efficiency. This method will be a very good help for any product based company saving a huge amount of money and time. Generalized BVA generates 5*n number of test cases where n is number of variables while Function Tree method generates the highest of all three that is n*5^(n-1) and the modified approach generates 7*n + k number of test cases where k is the number of mutants killed at each step. So, it shows that the number of test cases in case of modified algorithm is significantly lower than the Function Tree algorithm while almost similar as regular BVA but it covers more functionalities and feature

PENGUJIAN SOFTWARE MENGGUNAKAN METODE BOUNDARY VALUE ANALYSIS DAN DECISION TABLE TESTING

ABSTRAKKualitas produk sangat penting dalam industri pembuatan software. Kualitas produk yang dihasilkan sangat dipengaruhi oleh pengujian software sebelum suatu software dideploy ke pelanggan. Jika suatu software telah lulus uji, maka akan dapat diminimalisir terjadinya kendala pada saat software dipergunakan atau dioperasikan. Terdapat banyak metode pengujian software yang dapat digunakan, dari jenis Black Box Testing maupun jenis White Box Testing. Pada penelitian ini digunakan metode dari jenis Black Box Testing, yaitu Boundary Value Analysis dan Decision Table Testing. Sampel form yang diuji merupakan bagian dari software yang dipergunakan untuk pengelolaan Dana Pensiun untuk suatu lembaga pegelolaan dana pensiun karyawan. Sampel form yang diuji adalah form Pengajuan Klaim Manfaat Pensiun Berkala. Lalu dilakukan pengujian dengan menggunakan metode Boundary Value Analysis dan Decision Table Testing. Berdasarkan aturan proses bisnis entri dan validasi form, dibuat skenario pengujian dan data yang akan digunakan untuk menguji. Setelah melalui proses pengujian diperoleh hasil bahwa masih ada yang harus diperbaiki pada sampel form tersebut.Kata Kunci : Pengujian; Software; Boundary Value Analysis; Decision Table Testing; STL

PENGUJIAN APLIKASI TRANSAKSI PERDAGANGAN MENGGUNAKAN BLACK BOX TESTING BOUNDARY VALUE ANALYSIS

The information system is one of the needs that is often used to facilitate human work. Jobs that often use information systems are office jobs, both in government and private agencies. Companies generally need an information system to simplify work such as creating cooperation documents, contract documents with external parties, as well as to help make monitoring and evaluation sheets for internal management. Like a system, to be able to store and display data as it should. Information system testing is needed in order to know the shortcomings of a system. The drawbacks of a system can be in the form of features that don't work properly or there are differences between the features expected and the features available. One of the tests of information systems is testing the Black Box method system by means of Boundary Value Analysis. Boundary Value Analysis is a method of testing by determining the lower and upper limit values ​​of the data to be tested. This test is carried out on the function of adding new goods data to the trade transaction application. The test results are still lacking when validating the data entered into the system, causing the data stored in the database to not match what was expected. The results of this test can be an input to improve the application so that the eligibility requirements of the information system are better in accordance with the expected data entered into the system

Improving our fitnesse: From concrete executions to partial specification

Fitnesse and FIT [5] allow systems tests to be written by non-programmers using a Wiki or HTML style of input. However, there is little support for syntactic and semantic checks as the tests are being designed. This paper describes a support tool for designing table-based test cases that gives deep semantic analysis about a set of test cases. It uses a variety of strategies such as pairwise analysis, boundary value analysis and test case subsumption to suggest missing test cases and to generalise concrete tests into more abstract tests. The goal is to interactively improve the quality of test suites during the test design phase

Pengujian Aplikasi dengan Metode Blackbox Testing Boundary Value Analysis (Studi Kasus: Kantor Digital Politeknik Negeri Lampung)

Software testing phase is one of a critical element in determining the quality of a software. These tests include design, specification, and coding. This study aims to test the digital office software at Lampung State Polytechnic. The testing process is done to determine the level of error that occurs in the software. The test used a black box testing Boundary Value Analysis. Boundary Value Analysis is a type of test case by determine the normal value, minimum value and maximum value of the tested data. The applications resulted from this research are capable to handling data, both normal and abnormal data with a 91, 67% success rate

Automated Black-Box Boundary Value Detection

The input domain of software systems can typically be divided into sub-domains for which the outputs are similar. To ensure high quality it is critical to test the software on the boundaries between these sub-domains. Consequently, boundary value analysis and testing has been part of the toolbox of software testers for long and is typically taught early to students. However, despite its many argued benefits, boundary value analysis for a given specification or piece of software is typically described in abstract terms which allow for variation in how testers apply it. Here we propose an automated, black-box boundary value detection method to support software testers in systematic boundary value analysis with consistent results. The method builds on a metric to quantify the level of boundariness of test inputs: the program derivative. By coupling it with search algorithms we find and rank pairs of inputs as good boundary candidates, i.e. inputs close together but with outputs far apart. We implement our AutoBVA approach and evaluate it on a curated dataset of example programs. Our results indicate that even with a simple and generic program derivative variant in combination with broad sampling over the input space, interesting boundary candidates can be identified

An Automated Framework for Structural Test-data Generation

Structural testing criteria are mandated in many software development standards and guidelines. The process of generating test data to achieve 100% coverage of a given structural coverage metric is labour-intensive and expensive. This paper presents an approach to automate the generation of such test data. The test-data generation is based on the application of a dynamic optimisation-based search for the required test data. The same approach can be generalised to solve other test-data generation problems. Three such applications are discussed-boundary value analysis, assertion/run-time exception testing, and component re-use testing. A prototype tool-set has been developed to facilitate the automatic generation of test data for these structural testing problems. The results of preliminary experiments using this technique and the prototype tool-set are presented and show the efficiency and effectiveness of this approac

Pengujian Aplikasi Sistem Informasi Akademik menggunakan Metode Blackbox dengan Teknik Boundary Value Analysis

Pengujian perangkat lunak adalah aspek krusial dalam riset untuk memastikan mutu dan perkembangan aplikasi. Dalam konteks pengujian sistem informasi akademik, pentingnya desain yang baik memungkinkan deteksi kesalahan yang cepat, menghemat waktu dalam proses pengujian, dan membangun kepercayaan pengguna terhadap aplikasi. Penelitian terkait mengidentifikasi masalah dalam aplikasi, seperti kesalahan input informasi, yang memicu strategi pengujian yang difokuskan pada memastikan kesesuaian dan akurasi informasi. Metode pengujian seperti Black Box Testing dengan Boundary Value Analysis digunakan untuk mengevaluasi kualitas aplikasi dan mengidentifikasi area untuk perbaikan. Kesimpulan dari penelitian ini menunjukkan bahwa aplikasi berhasil hanya sekitar 60% dari jumlah percobaan maka penting dilakukan peningkatan kualitas aplikasi, dengan fokus pada memastikan bahwa aplikasi berfungsi sebagaimana mestinya dan dapat mengatasi berbagai skenario penggunaa

Measuring Information System-Based Village Administration Service Performance Using Boundary Value Analysis Techniques

Application development often does not have a significant impact on users, especially various application functions that make it difficult for users to take advantage of the system optimally. System testing plays an important role in an application development. Tests are carried out to ensure that all programs run properly before an application is released. This study discusses the measurement of performance on the administration service website application with the Black Box Testing method. Functional testing is carried out using the Boundary Value Analysis technique. Boundary Value Analysis technique is one of the techniques of Black Box testing that identifies errors from the outside or inside of a system. With this technique, the success of an input data value is tested based on the upper and lower limit values. The result of the measurement of the administrative service application is the optimal system functionality and in accordance with the user's business process needs. The percentage of success rate for fields on the Register Account menu is 91.67% and Login is 75%. Meanwhile, on the Daftar Surat Izin Keramaian menu, it has a success rate of 80%