A Characteristic Study of Parameterized Unit Tests in .NET Open Source Projects

In the past decade, parameterized unit testing has emerged as a promising method to specify program behaviors under test in the form of unit tests. Developers can write parameterized unit tests (PUTs), unit-test methods with parameters, in contrast to conventional unit tests, without parameters. The use of PUTs can enable powerful test generation tools such as Pex to have strong test oracles to check against, beyond just uncaught runtime exceptions. In addition, PUTs have been popularly supported by various unit testing frameworks for .NET and the JUnit framework for Java. However, there exists no study to offer insights on how PUTs are written by developers in either proprietary or open source development practices, posing barriers for various stakeholders to bring PUTs to widely adopted practices in software industry. To fill this gap, we first present categorization results of the Microsoft MSDN Pex Forum posts (contributed primarily by industrial practitioners) related to PUTs. We then use the categorization results to guide the design of the first characteristic study of PUTs in .NET open source projects. We study hundreds of PUTs that open source developers wrote for these open source projects. Our study findings provide valuable insights for various stakeholders such as current or prospective PUT writers (e.g., developers), PUT framework designers, test-generation tool vendors, testing researchers, and testing educators

SmartUnit: Empirical Evaluations for Automated Unit Testing of Embedded Software in Industry

In this paper, we aim at the automated unit coverage-based testing for embedded software. To achieve the goal, by analyzing the industrial requirements and our previous work on automated unit testing tool CAUT, we rebuild a new tool, SmartUnit, to solve the engineering requirements that take place in our partner companies. SmartUnit is a dynamic symbolic execution implementation, which supports statement, branch, boundary value and MC/DC coverage. SmartUnit has been used to test more than one million lines of code in real projects. For confidentiality motives, we select three in-house real projects for the empirical evaluations. We also carry out our evaluations on two open source database projects, SQLite and PostgreSQL, to test the scalability of our tool since the scale of the embedded software project is mostly not large, 5K-50K lines of code on average. From our experimental results, in general, more than 90% of functions in commercial embedded software achieve 100% statement, branch, MC/DC coverage, more than 80% of functions in SQLite achieve 100% MC/DC coverage, and more than 60% of functions in PostgreSQL achieve 100% MC/DC coverage. Moreover, SmartUnit is able to find the runtime exceptions at the unit testing level. We also have reported exceptions like array index out of bounds and divided-by-zero in SQLite. Furthermore, we analyze the reasons of low coverage in automated unit testing in our setting and give a survey on the situation of manual unit testing with respect to automated unit testing in industry.Comment: In Proceedings of 40th International Conference on Software Engineering: Software Engineering in Practice Track, Gothenburg, Sweden, May 27-June 3, 2018 (ICSE-SEIP '18), 10 page

PEER Testbed Study on a Laboratory Building: Exercising Seismic Performance Assessment

From 2002 to 2004 (years five and six of a ten-year funding cycle), the PEER Center organized the majority of its research around six testbeds. Two buildings and two bridges, a campus, and a transportation network were selected as case studies to “exercise” the PEER performance-based earthquake engineering methodology. All projects involved interdisciplinary teams of researchers, each producing data to be used by other colleagues in their research. The testbeds demonstrated that it is possible to create the data necessary to populate the PEER performancebased framing equation, linking the hazard analysis, the structural analysis, the development of damage measures, loss analysis, and decision variables. This report describes one of the building testbeds—the UC Science Building. The project was chosen to focus attention on the consequences of losses of laboratory contents, particularly downtime. The UC Science testbed evaluated the earthquake hazard and the structural performance of a well-designed recently built reinforced concrete laboratory building using the OpenSees platform. Researchers conducted shake table tests on samples of critical laboratory contents in order to develop fragility curves used to analyze the probability of losses based on equipment failure. The UC Science testbed undertook an extreme case in performance assessment—linking performance of contents to operational failure. The research shows the interdependence of building structure, systems, and contents in performance assessment, and highlights where further research is needed. The Executive Summary provides a short description of the overall testbed research program, while the main body of the report includes summary chapters from individual researchers. More extensive research reports are cited in the reference section of each chapter

Mathematics Exercise Generator: the language of parameterized exercises

Nowadays, the process of teaching and learning is changing from a traditional model in which teachers were the source of information for a model in which teachers appear as advisors who carefully observe students, assist in the selection of information by identifying their learning needs and support students in their autonomous study. In this chapter, the authors describe an approach used in curricular units of first year in Science and Engineer degrees, which results from a connection of three projects born in University of Aveiro: MEGUA, SIACUA and PmatE, and the interconnections of their informatics platforms. Although any scientific area besides mathematics can use this tool, the authors focus in a case study using an example on a specific topic of Calculus courses for first year students on Engineering: Sequences and Series of Functions. The methodology described allows teachers to achieve further goals on learning strategies and students to have enough material to practice.publishe

Requirements to Testing of Power System Services Provided by DER Units

The present report forms the Project Deliverable ‘D 2.2’ of the DERlab NoE project, supported by the EC under Contract No. SES6-CT-518299 NoE DERlab. The present document discuss the power system services that may be provided from DER units and the related methods to test the services actually provided, both at component level and at system level

Does the Danube exist? Versions of reality given by various regional climate models and climatological datasets

We present an intercomparison and verification analysis of several regional climate models (RCMs) nested into the same run of the same Atmospheric Global Circulation Model (AGCM) regarding their representation of the statistical properties of the hydrological balance of the Danube river basin for 1961-1990. We also consider the datasets produced by the driving AGCM, from the ECMWF and NCEP-NCAR reanalyses. The hydrological balance is computed by integrating the precipitation and evaporation fields over the area of interest. Large discrepancies exist among RCMs for the monthly climatology as well as for the mean and variability of the annual balances, and only few datasets are consistent with the observed discharge values of the Danube at its Delta, even if the driving AGCM provides itself an excellent estimate. Since the considered approach relies on the mass conservation principle and bypasses the details of the air-land interface modeling, we propose that the atmospheric components of RCMs still face difficulties in representing the water balance even on a relatively large scale. Their reliability on smaller river basins may be even more problematic. Moreover, since for some models the hydrological balance estimates obtained with the runoff fields do not agree with those obtained via precipitation and evaporation, some deficiencies of the land models are also apparent. NCEP-NCAR and ERA-40 reanalyses result to be largely inadequate for representing the hydrology of the Danube river basin, both for the reconstruction of the long-term averages and of the seasonal cycle, and cannot in any sense be used as verification. We suggest that these results should be carefully considered in the perspective of auditing climate models and assessing their ability to simulate future climate changes.Comment: 25 pages 8 figures, 5 table