Metamorphic testing: a review of challenges and opportunities

Metamorphic testing is an approach to both test case generation and test result verification. A central element is a set of metamorphic relations, which are necessary properties of the target function or algorithm in relation to multiple inputs and their expected outputs. Since its first publication, we have witnessed a rapidly increasing body of work examining metamorphic testing from various perspectives, including metamorphic relation identification, test case generation, integration with other software engineering techniques, and the validation and evaluation of software systems. In this paper, we review the current research of metamorphic testing and discuss the challenges yet to be addressed. We also present visions for further improvement of metamorphic testing and highlight opportunities for new research

Overexpression of Pax6 results in microphthalmia, retinal dysplasia and defective retinal ganglion cell axon guidance

Background: The transcription factor Pax6 is expressed by many cell types in the developing eye. Eyes do not form in homozygous loss-of-function mouse mutants (Pax6(Sey/Sey)) and are abnormally small in Pax6(Sey/+) mutants. Eyes are also abnormally small in PAX77 mice expressing multiple copies of human PAX6 in addition to endogenous Pax6; protein sequences are identical in the two species. The developmental events that lead to microphthalmia in PAX77 mice are not well-characterised, so it is not clear whether over- and under-expression of Pax6/PAX6 cause microphthalmia through similar mechanisms. Here, we examined the consequences of over-expression for the eye and its axonal connections. Results: Eyes form in PAX77(+/+) embryos but subsequently degenerate. At E12.5, we found no abnormalities in ocular morphology, retinal cell cycle parameters and the incidence of retinal cell death. From E14.5 on, we observed malformations of the optic disc. From E16.5 into postnatal life there is progressively more severe retinal dysplasia and microphthalmia. Analyses of patterns of gene expression indicated that PAX77(+/+) retinae produce a normal range of cell types, including retinal ganglion cells (RGCs). At E14.5 and E16.5, quantitative RT-PCR with probes for a range of molecules associated with retinal development showed only one significant change: a slight reduction in levels of mRNA encoding the secreted morphogen Shh at E16.5. At E16.5, tract-tracing with carbocyanine dyes in PAX77(+/+) embryos revealed errors in intraretinal navigation by RGC axons, a decrease in the number of RGC axons reaching the thalamus and an increase in the proportion of ipsilateral projections among those RGC axons that do reach the thalamus. A survey of embryos with different Pax6/PAX6 gene dosage (Pax6(Sey/+), Pax6(+/+), PAX77(+) and PAX77(+/+)) showed that (1) the total number of RGC axons projected by the retina and (2) the proportions that are sorted into the ipsilateral and contralateral optic tracts at the optic chiasm vary differently with gene dosage. Increasing dosage increases the proportion projecting ipsilaterally regardless of the size of the total projection. Conclusion: Pax6 overexpression does not obviously impair the initial formation of the eye and its major cell-types but prevents normal development of the retina from about E14.5, leading eventually to severe retinal degeneration in postnatal life. This sequence is different to that underlying microphthalmia in Pax6(+/-) heterozygotes, which is due primarily to defects in the initial stages of lens formation. Before the onset of severe retinal dysplasia, Pax6 overexpression causes defects of retinal axons, preventing their normal growth and navigation through the optic chiasm

Guidelines for the use and interpretation of assays for monitoring autophagy (3rd edition)

In 2008 we published the first set of guidelines for standardizing research in autophagy. Since then, research on this topic has continued to accelerate, and many new scientists have entered the field. Our knowledge base and relevant new technologies have also been expanding. Accordingly, it is important to update these guidelines for monitoring autophagy in different organisms. Various reviews have described the range of assays that have been used for this purpose. Nevertheless, there continues to be confusion regarding acceptable methods to measure autophagy, especially in multicellular eukaryotes. For example, a key point that needs to be emphasized is that there is a difference between measurements that monitor the numbers or volume of autophagic elements (e.g., autophagosomes or autolysosomes) at any stage of the autophagic process versus those that measure fl ux through the autophagy pathway (i.e., the complete process including the amount and rate of cargo sequestered and degraded). In particular, a block in macroautophagy that results in autophagosome accumulation must be differentiated from stimuli that increase autophagic activity, defi ned as increased autophagy induction coupled with increased delivery to, and degradation within, lysosomes (inmost higher eukaryotes and some protists such as Dictyostelium ) or the vacuole (in plants and fungi). In other words, it is especially important that investigators new to the fi eld understand that the appearance of more autophagosomes does not necessarily equate with more autophagy. In fact, in many cases, autophagosomes accumulate because of a block in trafficking to lysosomes without a concomitant change in autophagosome biogenesis, whereas an increase in autolysosomes may reflect a reduction in degradative activity. It is worth emphasizing here that lysosomal digestion is a stage of autophagy and evaluating its competence is a crucial part of the evaluation of autophagic flux, or complete autophagy. Here, we present a set of guidelines for the selection and interpretation of methods for use by investigators who aim to examine macroautophagy and related processes, as well as for reviewers who need to provide realistic and reasonable critiques of papers that are focused on these processes. These guidelines are not meant to be a formulaic set of rules, because the appropriate assays depend in part on the question being asked and the system being used. In addition, we emphasize that no individual assay is guaranteed to be the most appropriate one in every situation, and we strongly recommend the use of multiple assays to monitor autophagy. Along these lines, because of the potential for pleiotropic effects due to blocking autophagy through genetic manipulation it is imperative to delete or knock down more than one autophagy-related gene. In addition, some individual Atg proteins, or groups of proteins, are involved in other cellular pathways so not all Atg proteins can be used as a specific marker for an autophagic process. In these guidelines, we consider these various methods of assessing autophagy and what information can, or cannot, be obtained from them. Finally, by discussing the merits and limits of particular autophagy assays, we hope to encourage technical innovation in the field

Iron Behaving Badly: Inappropriate Iron Chelation as a Major Contributor to the Aetiology of Vascular and Other Progressive Inflammatory and Degenerative Diseases

The production of peroxide and superoxide is an inevitable consequence of aerobic metabolism, and while these particular "reactive oxygen species" (ROSs) can exhibit a number of biological effects, they are not of themselves excessively reactive and thus they are not especially damaging at physiological concentrations. However, their reactions with poorly liganded iron species can lead to the catalytic production of the very reactive and dangerous hydroxyl radical, which is exceptionally damaging, and a major cause of chronic inflammation. We review the considerable and wide-ranging evidence for the involvement of this combination of (su)peroxide and poorly liganded iron in a large number of physiological and indeed pathological processes and inflammatory disorders, especially those involving the progressive degradation of cellular and organismal performance. These diseases share a great many similarities and thus might be considered to have a common cause (i.e. iron-catalysed free radical and especially hydroxyl radical generation). The studies reviewed include those focused on a series of cardiovascular, metabolic and neurological diseases, where iron can be found at the sites of plaques and lesions, as well as studies showing the significance of iron to aging and longevity. The effective chelation of iron by natural or synthetic ligands is thus of major physiological (and potentially therapeutic) importance. As systems properties, we need to recognise that physiological observables have multiple molecular causes, and studying them in isolation leads to inconsistent patterns of apparent causality when it is the simultaneous combination of multiple factors that is responsible. This explains, for instance, the decidedly mixed effects of antioxidants that have been observed, etc...Comment: 159 pages, including 9 Figs and 2184 reference

Prospective, multicentre study of screening, investigation and management of hyponatraemia after subarachnoid haemorrhage in the UK and Ireland

Background: Hyponatraemia often occurs after subarachnoid haemorrhage (SAH). However, its clinical significance and optimal management are uncertain. We audited the screening, investigation and management of hyponatraemia after SAH. Methods: We prospectively identified consecutive patients with spontaneous SAH admitted to neurosurgical units in the United Kingdom or Ireland. We reviewed medical records daily from admission to discharge, 21 days or death and extracted all measurements of serum sodium to identify hyponatraemia (<135 mmol/L). Main outcomes were death/dependency at discharge or 21 days and admission duration >10 days. Associations of hyponatraemia with outcome were assessed using logistic regression with adjustment for predictors of outcome after SAH and admission duration. We assessed hyponatraemia-free survival using multivariable Cox regression. Results: 175/407 (43%) patients admitted to 24 neurosurgical units developed hyponatraemia. 5976 serum sodium measurements were made. Serum osmolality, urine osmolality and urine sodium were measured in 30/166 (18%) hyponatraemic patients with complete data. The most frequently target daily fluid intake was >3 L and this did not differ during hyponatraemic or non-hyponatraemic episodes. 26% (n/N=42/164) patients with hyponatraemia received sodium supplementation. 133 (35%) patients were dead or dependent within the study period and 240 (68%) patients had hospital admission for over 10 days. In the multivariable analyses, hyponatraemia was associated with less dependency (adjusted OR (aOR)=0.35 (95% CI 0.17 to 0.69)) but longer admissions (aOR=3.2 (1.8 to 5.7)). World Federation of Neurosurgical Societies grade I–III, modified Fisher 2–4 and posterior circulation aneurysms were associated with greater hazards of hyponatraemia. Conclusions: In this comprehensive multicentre prospective-adjusted analysis of patients with SAH, hyponatraemia was investigated inconsistently and, for most patients, was not associated with changes in management or clinical outcome. This work establishes a basis for the development of evidence-based SAH-specific guidance for targeted screening, investigation and management of high-risk patients to minimise the impact of hyponatraemia on admission duration and to improve consistency of patient care

Introduction to the Special Issue on Test Oracles

Software testing is the de facto technique for correctness verification. Although there are different motivations and approaches to testing, fundamentally, it involves the running of test cases against the software under test. An important aspect is the ability to tell whether the execution results agree with the expected outcomes. The mechanism to determine the correctness of the results is called a test oracle. Unfortunately, such a mechanism does not always exist or may exist but cannot be feasibly used, which is known as the oracle problem. This is a major challenge to software testers, severely curtailing the application of testing approaches and methods to practical situations. In spite of the vast amount of interest in software testing, studies on test oracles drew much less attention than other aspects of software testing until quite recently. The increasing number of research activities surrounding the oracle problem reflects a growing interest in the area. This special issue documents some of the new contributions in software test oracles. We received a total of 19 submissions. Each submission has been reviewed by at least three reviewers. Six papers have been accepted for publication. In general, test oracle issues may involve identifying the expected program properties, test case generation, test sequencing and concurrency, test output verification, and fault localization. To deal with the identification of expected program properties, paper 1 titled “Automated Inference of Likely Metamorphic Relations for Model Transformations” by Troya et al. proposes a method of automatically inferring likely metamorphic relations, in the context of metamorphic testing, for the verification of model transformations. To handle test case generation and conduct run-time assertion checking, paper 2 titled “Contract-Based Testing for PHP with Praspel” by Dadeau et al. makes use of contracts, which enable the automation of these processes. To tackle the test sequencing question, paper 3 titled “Temporal Algebraic Query of Test Sequences” by Prasetya studies the question of test sequences using formalism based on algebraic relations and linear temporal logic. Paper 4 titled “Stateless Techniques for Generating Global and Local Test Oracles for Message-Passing Concurrent Programs” by Carver and Lei considers the state explosion problem of test sequences and proposes a stateless method to generate test oracles for concurrent programs. To address the test output verification problem, paper 5 titled “VISOR: A Fast Image Processing Pipeline with Scaling and Translation Invariance for Test Oracle Automation of Visual Output Systems” by Kıraç et al. focuses on the verification of visual output and introduces an automated test oracle that avoids false positives in image comparison caused by scaling and translation. To investigate software fault localization in the face of the oracle problem, paper 6 titled “Exploring the Usefulness of Unlabelled Test Cases in Software Fault Localization” by Zhang et al. develops an approach based on a core idea of test classification. We would like to thank the authors for their contributions, and the reviewers for their invaluable comments

Error trapping and metamorphic testing for spreadsheet failure detection

This study deepens the research on error trapping (ET) and metamorphic testing (MT) for detecting spreadsheet failures. It is observed that some spreadsheet developers and testers are confused between ET and MT, because the two techniques are similar to each other in some aspects. Inspired by the observation, this paper first outlines the main concepts of ET and MT using several examples for illustration. This is followed by discussing an experiment with a view to investigating and comparing the failure detection capabilities of the two techniques. The results of the experiment indicate that neither technique is sufficient in spreadsheet testing. Rather, ET and MT are complementary and they should be used together in spreadsheet testing whenever possible

Classification-tree restructuring methodologies: a new perspective

The classification-tree method developed by Grochtmann et al. provided a useful approach for constructing test cases from functional specifications. It was automated by Chen and Poou through their tree construction methodology. In a follow-up study, Chen and Poon found that the cffectiveness of constructing lcgitimate test cases could be improved under certain circumstances via a classification-tree restructuring algorithm. We develop another tree restructuring algorithm to cater for other situations not covered previously. The algorithms complement each other. We also compare the relative effectiveness of these algorithms and provide guidelines on applying them in practice