Using the ISO/IEC 9126 product quality model to classify defects : a Controlled Experiment

Background: Existing software defect classification schemes support multiple tasks, such as root cause analysis and process improvement guidance. However, existing schemes do not assist in assigning defects to a broad range of high level software goals, such as software quality characteristics like functionality, maintainability, and usability. Aim: We investigate whether a classification based on the ISO/IEC 9126 software product quality model is reliable and useful to link defects to quality aspects impacted. Method: Six different subjects, divided in two groups with respect to their expertise, classified 78 defects from an industrial web application using the ISO/IEC 9126 quality main characteristics and sub-characteristics, and a set of proposed extended guidelines. Results: The ISO/IEC 9126 model is reasonably reliable when used to classify defects, even using incomplete defect reports. Reliability and variability is better for the six high level main characteristics of the model than for the 22 sub- characteristics. Conclusions: The ISO/IEC 9126 software quality model provides a solid foundation for defect classification. We also recommend, based on the follow up qualitative analysis performed, to use more complete defect reports and tailor the quality model to the context of us

Using Automatic Static Analysis to Identify Technical Debt

The technical debt (TD) metaphor describes a tradeoff between short-term and long-term goals in software development. Developers, in such situations, accept compromises in one dimension (e.g. maintainability) to meet an urgent demand in another dimension (e.g. delivering a release on time). Since TD produces interests in terms of time spent to correct the code and accomplish quality goals, accumulation of TD in software systems is dangerous because it could lead to more difficult and expensive maintenance. The research presented in this paper is focused on the usage of automatic static analysis to identify Technical Debt at code level with respect to different quality dimensions. The methodological approach is that of Empirical Software Engineering and both past and current achieved results are presented, focusing on functionality, efficiency and maintainabilit

Evaluating Open Source Software Quality Models against ISO 25010

Quite a number of open source software quality models exist today. These models emerged as a result of the need to measure quality in open source software, which is quite unlike closed source, or proprietary software. ISO 9126 standard forms the basis from which most of these models derive. However, ISO 9126 standard has been replaced by ISO 25010. Therefore, as research endeavors progress towards evolving the “silver bullet” open source software quality model, it is the aim of this paper to evaluate existing open source software quality models against the ISO 25010 standard. The findings from this study reveal a candidate model (from among the existing models) that can be leveraged in deriving a generic open source software quality model

Evaluation of software quality attributes for Vessel Tracking Management System (VTMS)

Software quality and assurance becomes inevitable as the non-functional requirements continue to gain more popularity than functional requirements. Even some system could resolve some problem, but if nonfunctional requirements been neglected, at that point the solution may be impractical.The system with least features and quality characteristics will lead to low demand and failed-to-market.The aim of this study was to evaluate the quality in use attributes for Vessel Tracking and Management System (VTMS) adopted from the latest ISO/IEC 25010 quality model in the perspective of users’ satisfaction.Five properties of quality in use are explicitly evaluated which are effectiveness, efficiency, satisfaction, freedom from risk and context coverage.A study was conducted through observation and survey to evaluate all five quality in use attributes of VTMS and to explore the relationship between each quality in use attribute to determine the overall users’ satisfaction.Generally, this study provides an early empirical evaluation of the practical value of case study method. Firstly, from the VTMS perspective, the system provide a great 100% in functions coverage (completeness) although there are two (2) functions need to take immediate action in terms of accuracy so make up total 98.4% for effectiveness.On the other hand, the efficiency which measure the response time for each VTMS main tasks was 92.83%.It is concluded that all five (5) quality in use attributes scores more than 75% which are above the MMEA’s minimum requirement on overall users’ satisfaction

A Quality Model for Actionable Analytics in Rapid Software Development

Background: Accessing relevant data on the product, process, and usage perspectives of software as well as integrating and analyzing such data is crucial for getting reliable and timely actionable insights aimed at continuously managing software quality in Rapid Software Development (RSD). In this context, several software analytics tools have been developed in recent years. However, there is a lack of explainable software analytics that software practitioners trust. Aims: We aimed at creating a quality model (called Q-Rapids quality model) for actionable analytics in RSD, implementing it, and evaluating its understandability and relevance. Method: We performed workshops at four companies in order to determine relevant metrics as well as product and process factors. We also elicited how these metrics and factors are used and interpreted by practitioners when making decisions in RSD. We specified the Q-Rapids quality model by comparing and integrating the results of the four workshops. Then we implemented the Q-Rapids tool to support the usage of the Q-Rapids quality model as well as the gathering, integration, and analysis of the required data. Afterwards we installed the Q-Rapids tool in the four companies and performed semi-structured interviews with eight product owners to evaluate the understandability and relevance of the Q-Rapids quality model. Results: The participants of the evaluation perceived the metrics as well as the product and process factors of the Q-Rapids quality model as understandable. Also, they considered the Q-Rapids quality model relevant for identifying product and process deficiencies (e.g., blocking code situations). Conclusions: By means of heterogeneous data sources, the Q-Rapids quality model enables detecting problems that take more time to find manually and adds transparency among the perspectives of system, process, and usage.Comment: This is an Author's Accepted Manuscript of a paper to be published by IEEE in the 44th Euromicro Conference on Software Engineering and Advanced Applications (SEAA) 2018. The final authenticated version will be available onlin

Methodology of Evaluating the Sufficiency of Information for Software Quality Assessment According to ISO 25010

The research is devoted to the development of the formalized and ontological models of the software quality according to ISO 25010. These models provide the possibility of the formalization of the software quality assessment according to ISO 25010. This standard would benefit from a formal description. The paper proves that information sufficiency is a critical aspect of software quality assessment. The methods and system of evaluating the sufficiency of the information for software quality assessment according to ISO 25010 are developed. The developed methods and tools provide the increasing the veracity of software quality assessment. The conducted experiments confirm that the developed methodology of evaluating the sufficiency of information for software quality assessment increased the veracity of the software quality assessment in 12% for the automated system for large-format photo print

A social and technical sustainability requirements catalogue

Isabel Sofia Brito is a Coordinator Professor at Polytechnic Institute of Beja, Portugal, and a member of the Centre of Technology and Systems (CTS-UNINOVA). Her main research interests are Requirements Engineering and Sustainability Requirements, Model and Data-Driven Development, Multi-Criteria Decision Making and, Big Data. She has published several papers on these topics. She has been involved in several national and international research projects (e.g., COMPETISOF, Petri-Rig, U-Bike Project). Currently, she is involved in the international applied research project HIBA—Hub Iberia Agrotech, an initiative funded by Digital Innovation Hub (DIH) and “Portugal INCoDe.2030”. She is or was involved as organiser, conference chair and program committee member in several international conferences (e.g., IEEE RE, ACM SAC, CISTI, QUATIC, CIbSE, ICT4S) and in several smaller and regional ones. Publisher Copyright: © 2022 The Author(s)Climate change calls for action from all sectors of our global economy, including ICT. Therefore, it is important to change the way we develop software to address the challenges posed by sustainability. Our goal is to contribute with a reusable sustainability requirements catalogue that helps developers be aware of sustainability-related properties worth considering during software development. The information for this catalogue was gathered via a systematic mapping study, whose results were synthesised in feature models and then modelled using iStar for a more expressive and configurable representation. A qualitative evaluation of the catalogue's readability, interest, utility, and usefulness by 50 participants from the domain, showed that around 79% of the respondents found the catalogue “Good” or “Very Good”. However, more than 5% of the expert participants found weaknesses regarding most of the evaluated questions and around 25% are neutral in their overall evaluation. This led us to evolve the initial version of the catalogue for the social and technical dimensions of sustainability to improve its completeness and usefulness. This is achieved by aligning the information gathered in the systematic mapping study with the well-established quality model of the ISO/IEC 25010:2011, as we expect most of the experts are familiar with those qualities and respective hierarchies. During this process, we found information that led us to propose two additional qualities that were not covered by the ISO standard: fairness and legislation. We applied this evolved version of the catalogue to the U-Bike project comparing the requirements elicited without the catalogue with those identified using the catalogue. The result suggests that new sustainability requirements were worth considering from a sustainability point of view, supporting the usefulness of the catalogue.publishersversionpublishe

Test software quality issues and connections to international standards

This paper examines how ISO/IEC 9126-1 and ISO/IEC 25010 quality models can be applied to software testing products in industrial environment. We present a set of code smells for test systems written in TTCN-3 and their categorization according to quality model standards. We demonstrate our measurements on industrial and ETSI projects, and provide a method for estimating their effects on product risks in current projects