Evaluating software testing techniques and tools

Case studies can help companies to evaluate the benefi ts of testing techniques and tools before their possible incorporation into the testing processes. Although general guidelines and organizational frameworks exist describing what a case study should consist of, no general methodological framework exists that can be instantiated to easily design case studies to evaluate different testing techniques. In this paper we de nfine a fi rst version of a general methodological framework for evaluating software testing techniques, that focusses on the evaluation of eff ectiveness and efficiency. Using this framework, (1) software testing practitioners can more easily de fine case studies through an instantiation of the framework, (2) results can be better compared since they are all executed according to a similar design, and (3) the gap in existing work on methodological evaluation frameworks will be narrowed.Peer ReviewedPostprint (published version

The Disunity of Consciousness

It is commonplace for both philosophers and cognitive scientists to express their allegiance to the "unity of consciousness". This is the claim that a subject’s phenomenal consciousness, at any one moment in time, is a single thing. This view has had a major influence on computational theories of consciousness. In particular, what we call single-track theories dominate the literature, theories which contend that our conscious experience is the result of a single consciousness-making process or mechanism in the brain. We argue that the orthodox view is quite wrong: phenomenal experience is not a unity, in the sense of being a single thing at each instant. It is a multiplicity, an aggregate of phenomenal elements, each of which is the product of a distinct consciousness-making mechanism in the brain. Consequently, cognitive science is in need of a multi-track theory of consciousness; a computational model that acknowledges both the manifold nature of experience, and its distributed neural basis

An empirical approach for evaluating the usability of model-driven tools

MDD tools are very useful to draw conceptual models and to automate code generation. Even though this would bring many benefits, wide adoption of MDD tools is not yet a reality. Various research activities are being undertaken to find why and to provide the required solutions. However, insufficient research has been done on a key factor for the acceptance of MDD tools: usability. With the help of end-users, this paper presents a framework to evaluate the usability of MDD tools. The framework will be used as a basis for a family of experiments to get clear insights into the barriers to usability that prevent MDD tools from being widely adopted in industry. To illustrate the applicability of our framework, we instantiated it for performing a usability evaluation of a tool named INTEGRANOVA. Furthermore, we compared the outcome of the study with another usability evaluation technique based on ergonomic criteria.This work has been developed with the support of the Intra European Marie Curie Fellowship Grant 50911302 PIEF-2010, MICINN (TIN2008-00555, PROS-Req TIN2010-19130-C02-02), GVA (ORCA PROMETEO/2009/015), and co-financed with ERDF. We also acknowledge the support of the ITEA2 Call 3 UsiXML (20080026) and financed by the MITYC under the project TSI-020400-2011-20. Our thanks also to Ignacio Romeu for the video data gathering setup.Condori-Fernandez, N.; Panach Navarrete, JI.; Baars, AI.; Vos, TE.; Pastor López, O. (2013). An empirical approach for evaluating the usability of model-driven tools. Science of Computer Programming. 78(11):2245-2258. https://doi.org/10.1016/j.scico.2012.07.017S22452258781

Towards an Experimental Framework for Measuring Usability of Model-Driven Tools 1

Abstract. According to the Model-Driven Development (MDD) paradigm, analysts can substantially improve the software development process concentrating their efforts on a conceptual model, which can be transformed into code by means of transformation rules applied by a model compiler. However, MDD tools are not widely used in industry. One of the reasons for this poor adoption is the lack of usability of MDD tools. This paper presents a framework to evaluate the usability of such tools. The framework will be used as a basis for a family of experiments to get clear insights into the barriers to usability that prevent MDD tools from being widely adopted in industry

Symbolic search-based testing

We present an algorithm for constructing fitness functions that improve the efficiency of search-based testing when trying to generate branch adequate test data. The algorithm combines symbolic information with dynamic analysis and has two key advantages: It does not require any change in the underlying test data generation technique and it avoids many problems traditionally associated with symbolic execution, in particular the presence of loops. We have evaluated the algorithm on industrial closed source and open source systems using both local and global search-based testing techniques, demonstrating that both are statistically significantly more efficient using our approach. The test for significance was done using a one-sided, paired Wilcoxon signed rank test. On average, the local search requires 23.41% and the global search 7.78% fewer fitness evaluations when using a symbolic execution based fitness function generated by the algorithm

How dangerousness evolves after court-ordered compulsory psychiatric admission: explorative prospec

Background Compulsory admission is commonly regarded as necessary and justified for patients whose psychiatric condition represents a severe danger to themselves and others. However, while studies on compulsory admissions have reported on various clinical and social outcomes, little research has focused specifically on dangerousness, which in many countries is the core reason for compulsory admission. Aims To study changes in dangerousness over time in adult psychiatric patients admitted by compulsory court order, and to relate these changes to these patients' demographic and clinical characteristics. Method In this explorative prospective observational cohort study of adult psychiatric patients admitted by compulsory court order, demographic and clinical data were collected at baseline. At baseline and at 6 and 12 month follow-up, dangerousness was assessed using the Dangerousness Inventory, an instrument based on the eight types of dangerousness towards self or others specified in Dutch legislation on compulsory admissions. We used descriptive statistics and logistic regression to analyse the data. Results We included 174 participants with a court-ordered compulsory admission. At baseline, the most common dangerousness criterion was inability to cope in society. Any type of severe or very severe dangerousness decreased from 86.2% at baseline to 36.2% at 6 months and to 28.7% at 12 months. Being homeless at baseline was the only variable which was significantly associated with persistently high levels of dangerousness. Conclusions Dangerousness decreased in about two-thirds of the patients after court-ordered compulsory admission. It persisted, however, in a substantial minority (approximately one-third). Declaration of interest None

Flexibel met Pensioen

Dit rapport is het eindproduct van de projectgroep “Flexibel met pensioen”. We gaan na in hoeverre mensen nu flexibel met pensioen kunnen en wat de overwegingen zijn voor toekomstig beleid rondom flexibilisering van de pensioenleeftijd. Gegeven de verhoging van de AOW-leeftijd richten we ons in dit rapport vooral op restricties om eerder uit te treden en kijken we nauwelijks naar de beperkingen om later uit te treden dan op de AOW leeftijd. Verder houden we ons in dit rapport vooral bezig met lange termijn en niet met de transitieproblemen op kortere termijn

Flexibel met Pensioen

Dit rapport is het eindproduct van de projectgroep “Flexibel met pensioen”. We gaan na in hoeverre mensen nu flexibel met pensioen kunnen en wat de overwegingen zijn voor toekomstig beleid rondom flexibilisering van de pensioenleeftijd. Gegeven de verhoging van de AOW-leeftijd richten we ons in dit rapport vooral op restricties om eerder uit te treden en kijken we nauwelijks naar de beperkingen om later uit te treden dan op de AOW leeftijd. Verder houden we ons in dit rapport vooral bezig met lange termijn en niet met de transitieproblemen op kortere termijn

The Clinical Spectrum of Missense Mutations of the First Aspartic Acid of cbEGF-like Domains in Fibrillin-1 Including a Recessive Family

Marfan syndrome (MFS) is a dominant disorder with a recognizable phenotype. In most patients with the classical phenotype mutations are found in the fibrillin-1 gene (FBN1) on chromosome 15q21. It is thought that most mutations act in a dominant negative way or through haploinsufficiency. In 9 index cases referred for MFS we detected heterozygous missense mutations in FBN1 predicted to substitute the first aspartic acid of different calcium-binding Epidermal Growth Factor-like (cbEGF) fibrillin-1 domains. A similar mutation was found in homozygous state in 3 cases in a large consanguineous family. Heterozygous carriers of this mutation had no major skeletal, cardiovascular or ophthalmological features of MFS. In the literature 14 other heterozygous missense mutations are described leading to the substitution of the first aspartic acid of a cbEGF domain and resulting in a Marfan phenotype. Our data show that the phenotypic effect of aspartic acid substitutions in the first position of a cbEGF domain can range from asymptomatic to a severe neonatal phenotype. The recessive nature with reduced expression of FBN1 in one of the families suggests a threshold model combined with a mild functional defect of this specific mutation. © 2010 Wiley-Liss, Inc