A survey on software testability

Context: Software testability is the degree to which a software system or a unit under test supports its own testing. To predict and improve software testability, a large number of techniques and metrics have been proposed by both practitioners and researchers in the last several decades. Reviewing and getting an overview of the entire state-of-the-art and state-of-the-practice in this area is often challenging for a practitioner or a new researcher. Objective: Our objective is to summarize the body of knowledge in this area and to benefit the readers (both practitioners and researchers) in preparing, measuring and improving software testability. Method: To address the above need, the authors conducted a survey in the form of a systematic literature mapping (classification) to find out what we as a community know about this topic. After compiling an initial pool of 303 papers, and applying a set of inclusion/exclusion criteria, our final pool included 208 papers. Results: The area of software testability has been comprehensively studied by researchers and practitioners. Approaches for measurement of testability and improvement of testability are the most-frequently addressed in the papers. The two most often mentioned factors affecting testability are observability and controllability. Common ways to improve testability are testability transformation, improving observability, adding assertions, and improving controllability. Conclusion: This paper serves for both researchers and practitioners as an "index" to the vast body of knowledge in the area of testability. The results could help practitioners measure and improve software testability in their projects

Why Judges Applying the Daubert Trilogy Need to Know About the Social, Institutional, and Rhetorical - And Not Just the Methodological - aspects of Science

In response to the claim that many judges are deficient in their understanding of scientific methodology, this Article identifies in recent cases (1) a pragmatic perspective on the part of federal appellate judges when they reverse trial judges who tend to idealize science (i.e., who do not appreciate the local and practical goals and limitations of science), and (ii) an educational model of judicial gatekeeping that results in reversal of trial judges who defer to the social authority of science (i.e., who mistake authority for reliability). Next, this Article observes that courts (in the cases it analyzes) are not interested in pragmatically constructing legal science, but rather attempt to ensure that science itself, conceived pragmatically (i.e., without idealizing science), is appropriated in law. This Article concludes that trial judges who fail to appreciate the social, institutional, and rhetorical aspects of science tend to reject reliable—albeit pragmatic—science, welcome unreliable—albeit authoritative— science, and thereby create a body of legal science that is out of sync with mainstream science

Exploring regression testing and software product line testing - research and state of practice

In large software organizations with a product line development approach a selective testing of product variants is necessary in order to keep pace with the decreased development time for new products, enabled by the systematic reuse. The close relationship between products in product line indicates an option to reduce the testing effort due to redundancy. In many cases test selection is performed manually, based on test leaders’ expertise. This makes the cost and quality of the testing highly dependent on the skills and experience of the test leaders. There is a need in industry for systematic approaches to test selection. The goal of our research is to improve the control of the testing and reduce the amount of redundant testing in the product line context by applying regression test selection strategies. In this thesis, the state of art of regression testing and software product line testing are explored. Two extensive systematic reviews are conducted as well as an industrial survey of regression testing state of practice and an industrial evaluation of a pragmatic regression test selection strategy. Regression testing is not an isolated one-off activity, but rather an activity of varying scope and preconditions, strongly dependent on the context in which it is applied. Several techniques for regression test selection are proposed and evaluated empirically but in many cases the context is too specific for a technique to be easily applied directly by software developers. In order to improve the possibility for generalizing empirical results on regression test selection, guidelines for reporting the testing context are discussed in this thesis. Software product line testing is a relatively new research area. The understanding about challenges is well established but when looking for solutions to these challenges, we mostly find proposals, and empirical evaluations are sparse. Regression test selection strategies proposed in literature are not easily applicable in the product line context. Instead, control may be increased by increased visibility of the effects of testing and proper measurements of software quality. Focus of our future work will be on how to guide the planning and assessment of regression testing activities in large, complex reuse based systems, by visualizing the quality achieved in different parts of the system and evaluating the effects of different selection strategies when applied in various regression testing situations

An overview of process model quality literature - The Comprehensive Process Model Quality Framework

The rising interest in the construction and the quality of (business) process models resulted in an abundancy of emerged research studies and different findings about process model quality. The lack of overview and the lack of consensus hinder the development of the research field. The research objective is to collect, analyse, structure, and integrate the existing knowledge in a comprehensive framework that strives to find a balance between completeness and relevance without hindering the overview. The Systematic Literature Review methodology was applied to collect the relevant studies. Because several studies exist that each partially addresses this research objective, the review was performed at a tertiary level. Based on a critical analysis of the collected papers, a comprehensive, but structured overview of the state of the art in the field was composed. The existing academic knowledge about process model quality was carefully integrated and structured into the Comprehensive Process Model Quality Framework (CPMQF). The framework summarizes 39 quality dimensions, 21 quality metrics, 28 quality (sub)drivers, 44 (sub)driver metrics, 64 realization initiatives and 15 concrete process model purposes related to 4 types of organizational benefits, as well as the relations between all of these. This overview is thus considered to form a valuable instrument for both researchers and practitioners that are concerned about process model quality. The framework is the first to address the concept of process model quality in such a comprehensive way

Vocational tertiary education of young adults in Kenya: model development

The purpose of this study is to create a model of tertiary vocational education in Kenya. Despite considerable progress in Kenya over the last 20 years, current education models, low attendance, and low academic proficiency levels preclude many vulnerable learners from becoming employable. Utilizing semi-structured interviews of eight Kenyan participants, this study explores the testable design principles necessary to create such a micro-trade model. Utilizing Epistemic Network Analysis (ENA), a quantitative ethnographic technique, to model the structure of connections in data, this study attempts to systematically identify a set of constructs, as they are recorded in interview codes, connected to one another within these interviews. Two intellectual parallels emerged pertaining to the lack of fundamental and essential needs many Kenyans experience as well as salient issues of corruption often hindering the development of Kenya\u27s politics, economy, and democracy. It was imperative that a targeted approach to education was maintained and underpinned the trajectory of the micro-trade model when identifying the design principles for this study. This study reports the finding that a fresh model of tertiary vocational education, micro-trade, could impact the ability of vulnerable youth to become economically independent. It proposes such a model appearing in Chapter 4, schematizing barriers to tertiary education, microtrade as a response to those barriers through the lens of Kirkpatrick\u27s model of education, and aspirational results from careful design and blend of Kirkpatrick\u27s model with microtrade. Such design and blending through design-based research constitute proposed next steps for this effort

Finding a suitable performance testing tool

Abstract. The pursuit of finding the most suitable testing software for each project is a difficult task as there are a lot of software effective finding certain kind of problems but completely missing others in the field of stress and load testing. A silver bullet solving all problems in a cost effective and reliable way has not yet been found. This project was done as a systematic literature review to find whether there are solutions documented capable of testing everything in a cost-effective way. The document starts with an introduction of the task, originating from a real software testing company’s suggestion of finding suitable test software that can, cost effectively and reliably, fulfil the needs of the company. A history section is describing the reason of testing importance, basics of testing and what others have found in their studies of the area. The research method is described in detail followed by results describing tools found during the research divided in sections by license type. The sectioning by license type was selected for the benefit of testing companies that are interested in further developing tools found to their own interest. Findings and answered research questions were presented and discussed followed by possible implications and further research suggestions to future scholars interested in the matter. The systematic literature review found a total of 40 different tools identified during the data extraction process. One complete software system was available commercially including heavy support and help functions for the customer. A different approach linking open source and relatively inexpensive pieces of software together to achieve a composite solution was also identified. The solution included the most common and most popular individual piece of software identified by the study. All found pieces of software were listed and commented briefly mainly with information originating from the authors’ home pages