AUnit - a testing framework for alloy

textWriting declarative models of software designs and analyzing them to detect defects is an effective methodology for developing more dependable software systems. However, writing such models correctly can be challenging for practitioners who may not be proficient in declarative programming, and their models themselves may be buggy. We introduce the foundations of a novel test automation framework, AUnit, which we envision for testing declarative models written in Alloy -- a first-order, relational language that is supported by its SAT-based analyzer. We take inspiration from the success of the family of xUnit frameworks that are used widely in practice for test automation, albeit for imperative or object-oriented programs. The key novelty of our work is to define a basis for unit testing for Alloy, specifically, to define the concepts of test case and test coverage as well as coverage criteria for declarative models. We reduce the problems of declarative test execution and coverage computation to partial evaluation without requiring SAT solving. Our vision is to blend how developers write unit tests in commonly used programming languages with how Alloy users formulate their models in Alloy, thereby facilitating the development and testing of Alloy models for both new Alloy users as well as experts. We illustrate our ideas using a small but complex Alloy model. While we focus on Alloy, our ideas generalize to other declarative languages (such as Z, B, ASM).Electrical and Computer Engineerin

WEBSITE-BASED COMPETENCE CERTIFICATION INFORMATION SYSTEM USING RAPID APPLICATION DEVELOPMENT (RAD) METHOD

Information system is a series of information systems that are overall and organized and rationally capable of transforming data into information. Competency Test Place (TUK) is a unit implementing competency standard testing, competency certification in a professional field and has responsibility for the implementation, guidance and development of competency standards and competency certification. Based on the results of interviews with the TUK unit manager, there are several obstacles in their services, namely, the certification registration process which has not been effective in serving prospective competency test participants, then certification information related to certification is still difficult for students to obtain directly. Based on these problems, it is necessary to have a Competency Certification information system that has a function as a medium for sharing information as well as a media for registration of certification. This study aims to build a Certification Information System and measure the level of conformity. The method that will be used in this research is RAD (Rapid Application Development). RAD was chosen because this model emphasizes the short development cycle of software development. UAT Operational Acceptance Testing was chosen because the level of acceptance of a system by users can be a benchmark for assessing the acceptance of an information technology by users and requires users to use the system or software that has been created. The test results using Operational Acceptance Testing type UAT on the system have obtained valid results which are accepted by 24 respondents who have tried the competency certification information system

DEVELOPING INTERACTIVE LEARNING MULTIMEDIA OF ‘EFFECTIVE COMMUNICATION’ ENGLISH TEXTBOOK FOR THE ELEMENTARY LEVEL STUDENTS OF SMK MUHAMMADIYAH 1 WONOSARI, GUNUNGKIDUL

This study aims to develop interactive multimedia program of Effective Communication English textbook to facilitate the teaching and learning process for the elementary level students of SMK. This study belongs to research and development (R&D). It was conducted in SMK Muhammadiyah 1 Wonosari. The data were collected using observation, questionnaire, and interview. The research procedures were adopted from the model proposed by Allesi and Trolip. It consists of planning, design, and development. Planning phase deals with the administration preparation of the research. Design phase concerns with the preparation of developing the media software. Development phase deals with process of developing media software and the validation. The validation involved two kinds of tests, alpha testing and beta testing. Alpha testing involves multimedia and material experts while beta testing involves 36 students. They were asked to give feedback to the interactive multimedia by filling out the questionnaires. And then, the interview was done to support the data. Revisions were made as necessary based on the data obtained. Based on the data analysis, the result of the research shows that the effective interactive multimedia design of interactive multimedia has some feature i.e. home, user’s guide, map of the media, unit description (unit introduction, goal, spoken cycle activities, written cycle activities), grammar, summary, and semester review. The design is considered applicable and acceptable through the mean of the students’ questionnaire that ranges from 3,11 to 3,58 (4 point Likert scale). The interactive multimedia that has been developed is integrated in a compact disc (CD) so that it can be used by the students at school as personally at home

A Framework for Testing Concurrent Programs

This study proposes a new framework that can effectively apply unit testing to concurrent programs, which are difficult to develop and debug. Test-driven development, a practice enabling developers to detect bugs early by incorporating unit testing into the development process, has become wide-spread, but it has only been effective for programs with a single thread of control. The order of operations in different threads is essentially non-deterministic, making it more complicated to reason about program properties in concurrent programs than in single-threaded programs. Because hardware, operating systems, and compiler optimizations influence the order in which operations in different threads are executed, debugging is problematic since a problem often cannot be reproduced on other machines. Multi-core processors, which have replaced older single-core designs, have exacerbated these problems because they demand the use of concurrency if programs are to benefit from new processors. The existing tools for unit testing programs are either flawed or too costly. JUnit , for instance, assumes that programs are single-threaded and therefore does not work for concurrent programs; ConTest and rstest predate the revised Java memory model and make incorrect assumptions about the operations that affect synchronization. Approaches such as model checking or comprehensive schedule-based execution are too costly to be used frequently. All of these problems prevent software developers from adopting the current tools on a large scale. The proposed framework (i) improves JUnit to recognize errors in all threads, a necessary development without which all other improvements are futile, (ii) places some restrictions on the programs to facilitate automatic testing, (iii) provides tools that reduce programmer mistakes, and (iv) re-runs the unit tests with randomized schedules to simulate the execution under different conditions and on different machines, increasing the probability that errors are detected. The improvements and restrictions, shown not to seriously impede programmers, reliably detect problems that the original JUnit missed. The execution with randomized schedules reveals problems that rarely occur under normal conditions. With an effective testing tool for concurrent programs, developers can test programs more reliably and decrease the number of errors in spite of the proliferation of concurrency demanded by modern processors

Evaluating the Impact of Critical Factors in Agile Continuous Delivery Process: A System Dynamics Approach

Continuous Delivery is aimed at the frequent delivery of good quality software in a speedy, reliable and efficient fashion – with strong emphasis on automation and team collaboration. However, even with this new paradigm, repeatability of project outcome is still not guaranteed: project performance varies due to the various interacting and inter-related factors in the Continuous Delivery 'system'. This paper presents results from the investigation of various factors, in particular agile practices, on the quality of the developed software in the Continuous Delivery process. Results show that customer involvement and the cognitive ability of the QA have the most significant individual effects on the quality of software in continuous delivery

Software component testing : a standard and the effectiveness of techniques

This portfolio comprises two projects linked by the theme of software component testing, which is also often referred to as module or unit testing. One project covers its standardisation, while the other considers the analysis and evaluation of the application of selected testing techniques to an existing avionics system. The evaluation is based on empirical data obtained from fault reports relating to the avionics system. The standardisation project is based on the development of the BC BSI Software Component Testing Standard and the BCS/BSI Glossary of terms used in software testing, which are both included in the portfolio. The papers included for this project consider both those issues concerned with the adopted development process and the resolution of technical matters concerning the definition of the testing techniques and their associated measures. The test effectiveness project documents a retrospective analysis of an operational avionics system to determine the relative effectiveness of several software component testing techniques. The methodology differs from that used in other test effectiveness experiments in that it considers every possible set of inputs that are required to satisfy a testing technique rather than arbitrarily chosen values from within this set. The three papers present the experimental methodology used, intermediate results from a failure analysis of the studied system, and the test effectiveness results for ten testing techniques, definitions for which were taken from the BCS BSI Software Component Testing Standard. The creation of the two standards has filled a gap in both the national and international software testing standards arenas. Their production required an in-depth knowledge of software component testing techniques, the identification and use of a development process, and the negotiation of the standardisation process at a national level. The knowledge gained during this process has been disseminated by the author in the papers included as part of this portfolio. The investigation of test effectiveness has introduced a new methodology for determining the test effectiveness of software component testing techniques by means of a retrospective analysis and so provided a new set of data that can be added to the body of empirical data on software component testing effectiveness