Supporting Defect Causal Analysis in Practice with Cross-Company Data on Causes of Requirements Engineering Problems

[Context] Defect Causal Analysis (DCA) represents an efficient practice to improve software processes. While knowledge on cause-effect relations is helpful to support DCA, collecting cause-effect data may require significant effort and time. [Goal] We propose and evaluate a new DCA approach that uses cross-company data to support the practical application of DCA. [Method] We collected cross-company data on causes of requirements engineering problems from 74 Brazilian organizations and built a Bayesian network. Our DCA approach uses the diagnostic inference of the Bayesian network to support DCA sessions. We evaluated our approach by applying a model for technology transfer to industry and conducted three consecutive evaluations: (i) in academia, (ii) with industry representatives of the Fraunhofer Project Center at UFBA, and (iii) in an industrial case study at the Brazilian National Development Bank (BNDES). [Results] We received positive feedback in all three evaluations and the cross-company data was considered helpful for determining main causes. [Conclusions] Our results strengthen our confidence in that supporting DCA with cross-company data is promising and should be further investigated.Comment: 10 pages, 8 figures, accepted for the 39th International Conference on Software Engineering (ICSE'17

Towards Guidelines for Preventing Critical Requirements Engineering Problems

Context] Problems in Requirements Engineering (RE) can lead to serious consequences during the software development lifecycle. [Goal] The goal of this paper is to propose empirically-based guidelines that can be used by different types of organisations according to their size (small, medium or large) and process model (agile or plan-driven) to help them in preventing such problems. [Method] We analysed data from a survey on RE problems answered by 228 organisations in 10 different countries. [Results] We identified the most critical RE problems, their causes and mitigation actions, organizing this information by clusters of size and process model. Finally, we analysed the causes and mitigation actions of the critical problems of each cluster to get further insights into how to prevent them. [Conclusions] Based on our results, we suggest preliminary guidelines for preventing critical RE problems in response to context characteristics of the companies.Comment: Proceedings of the 42th Euromicro Conference on Software Engineering and Advanced Applications, 201

Preventing Incomplete/Hidden Requirements: Reflections on Survey Data from Austria and Brazil

Many software projects fail due to problems in requirements engineering (RE). The goal of this paper is analyzing a specific and relevant RE problem in detail: incomplete/hidden requirements. We replicated a global family of RE surveys with representatives of software organizations in Austria and Brazil. We used the data to (a) characterize the criticality of the selected RE problem, and to (b) analyze the reported main causes and mitigation actions. Based on the analysis, we discuss how to prevent the problem. The survey includes 14 different organizations in Austria and 74 in Brazil, including small, medium and large sized companies, conducting both, plan-driven and agile development processes. Respondents from both countries cited the incomplete/hidden requirements problem as one of the most critical RE problems. We identified and graphically represented the main causes and documented solution options to address these causes. Further, we compiled a list of reported mitigation actions. From a practical point of view, this paper provides further insights into common causes of incomplete/hidden requirements and on how to prevent this problem.Comment: in Proceedings of the Software Quality Days, 201

Naming the pain in requirements engineering : Contemporary problems, causes, and effects in practice

Requirements Engineering (RE) has received much attention in research and practice due to its importance to software project success. Its interdisciplinary nature, the dependency to the customer, and its inherent uncertainty still render the discipline difficult to investigate. This results in a lack of empirical data. These are necessary, however, to demonstrate which practically relevant RE problems exist and to what extent they matter. Motivated by this situation, we initiated the Naming the Pain in Requirements Engineering (NaPiRE) initiative which constitutes a globally distributed, bi-yearly replicated family of surveys on the status quo and problems in practical RE. In this article, we report on the qualitative analysis of data obtained from 228 companies working in 10 countries in various domains and we reveal which contemporary problems practitioners encounter. To this end, we analyse 21 problems derived from the literature with respect to their relevance and criticality in dependency to their context, and we complement this picture with a cause-effect analysis showing the causes and effects surrounding the most critical problems. Our results give us a better understanding of which problems exist and how they manifest themselves in practical environments. Thus, we provide a first step to ground contributions to RE on empirical observations which, until now, were dominated by conventional wisdom only.Peer reviewe

Continuous and collaborative technology transfer : Software engineering research with real-time industry impact

Context: Traditional technology transfer models rely on the assumption that innovations are created in academia, after which they are transferred to industry using a sequential flow of activities. This model is outdated in contemporary software engineering research that is done in close collaboration between academia and industry and in large consortia rather than on a one-on-one basis. In the new setup, research can be viewed as continuous co-experimentation, where industry and academia closely collaborate and iteratively and jointly discover problems and develop, test, and improve solutions. Objective: The objective of the paper is to answer the following research questions: How can high-quality, ambitious software engineering research in a collaborative setup be conducted quickly and on a large scale? How can real-time business feedback to continuously improve candidate solutions be gained? Method: The proposed model has been created, refined, and evaluated in two large, national Finnish software research programs. For this paper, we conducted thematic interviews with representatives of four companies who participated in these programs. Results: The fundamental change is in the mindset of the participants from technology push by academia to technology pull by companies, resulting in co-creation. Furthermore, continuous cooperation between participants enables solutions to evolve in rapid cycles and forms a scalable model of interaction between research institutes and companies. Conclusions: The multifaceted nature of software engineering research calls for numerous approaches. In particular, when working with human-related topics such as company culture and development methods, many discoveries result from seamless collaboration between companies and research institutes.Peer reviewe

BIM-based decision support for building condition assessment

Building condition assessment requires the integration of various types of data such as building characteristics, the properties of elements/systems and maintenance records. Previous research has focused on identifying these data and developing a building condition risk assessment model based on Bayesian networks (BN). However, due to interoperability issues, the process of transferring the data is performed manually, which requires considerable time and effort. To address this issue, this paper presents a data model to integrate the building condition risk assessment model into BIM. The proposed data model is implemented in existing software as a case study and tested and evaluated on three scenarios. Addressing interoperability will leverage the BIM tool as a data re- pository to automate the data transfer process and improve its consistency and reliability. It will also enable BIM to be a more effective tool for building condition and causality analysis visualization.This work was supported by Agència de Gestió d’Ajuts Universitaris i de Recerca (AGAUR) from Generalitat de Catalunya under Grant 2019 FI_B00064Postprint (published version

Status Quo and Problems of Requirements Engineering for Machine Learning: Results from an International Survey

Systems that use Machine Learning (ML) have become commonplace for companies that want to improve their products and processes. Literature suggests that Requirements Engineering (RE) can help address many problems when engineering ML-enabled systems. However, the state of empirical evidence on how RE is applied in practice in the context of ML-enabled systems is mainly dominated by isolated case studies with limited generalizability. We conducted an international survey to gather practitioner insights into the status quo and problems of RE in ML-enabled systems. We gathered 188 complete responses from 25 countries. We conducted quantitative statistical analyses on contemporary practices using bootstrapping with confidence intervals and qualitative analyses on the reported problems involving open and axial coding procedures. We found significant differences in RE practices within ML projects. For instance, (i) RE-related activities are mostly conducted by project leaders and data scientists, (ii) the prevalent requirements documentation format concerns interactive Notebooks, (iii) the main focus of non-functional requirements includes data quality, model reliability, and model explainability, and (iv) main challenges include managing customer expectations and aligning requirements with data. The qualitative analyses revealed that practitioners face problems related to lack of business domain understanding, unclear goals and requirements, low customer engagement, and communication issues. These results help to provide a better understanding of the adopted practices and of which problems exist in practical environments. We put forward the need to adapt further and disseminate RE-related practices for engineering ML-enabled systems.Comment: Accepted for Publication at PROFES 202

Building information modeling for facility managers

A Decision Support System (DSS) can help facility managers to improve building performance, occupants’ comfort, and energy efficiency during the Operation and Maintenance (O&M) phase. These DSSs are normally data-intensive and have specific data requirements. Building Information Modeling (BIM) has the potential to advance and transform facilities O&M by providing facility managers with a digitalized virtual environment that allows them to retrieve, analyze, and process such data. However, the implementation of BIM in O&M phases is still limited. The majority of issues in the BIM-O&M context lie in the interoperability between different software that requires different data structures and formats. In a BIM environment, there are issues associated with extracting, storing, managing, integrating, and disseminating data so that interoperability is assured. Considering the aforementioned aspects, the aim of this thesis is to enable interoperability between BIM models and the DSSs for building performance aspects such as building condition, maintenance, and occupants’ comfort. This integration automatizes the data transfer process which can assist Facility Management (FM) team in properly establishing the necessary measurements to moderate the negative consequences on buildings and thereby improve their performance and occupants’ comfort. The approach can also provide FM teams with an effective platform for data visualization in a user-friendly manner that can assist in integrating digital insights into FM decision-making processes and converting them into positive strategic actions. The proposed approach is validated in existing software as a case study. It is possible to demonstrate the applicability of this approach by ensuring that its interactions and outcomes are feasible using case studies. Case studies also identify how much the task efficiencies are in comparison with the manual method, helping facility managers to optimize operation strategies of buildings in order to enhance their performance. Verification tests are also performed on the information exported from a software program. The results demonstrate an efficiency increase in high-quality FM data collection for different kinds of DSS, reducing the time and effort that the FM team spends on searching for information and entering data. A Dynamo script is designed to allow administrators to include as much information as they wish in BIM models. Moreover, a novel approach is proposed to create a new category in BIM to assist public and business administrations with managing assets efficiently. In addition, building performance aspects can also be analyzed using the proposed method of integrating occupants' feedback into BIM models. By implementing the proposed approach, FM teams are able to correctly establish measurements which can be applied to mitigate the negative effects on buildings, thus improving their performance and enhancing their occupants’ comfort. Besides, the proposed approach enables BIM to be a more useful tool for visualization by using the most appropriate charts and formatting.Un Sistema de Soporte de decisiones (SSD) puede ayudar a los gestores de edificios a mejorar su rendimiento, su eficiencia energética y el confort de sus ocupantes. Para el buen funcionamiento de los SSD se requieren muchos datos. El Building Information Modeling (BIM) permite mejorar la gestión de las operaciones y el mantenimiento de los edificios al proporcionar un entorno virtual digitalizado que permite recuperar, analizar y procesar los datos requeridos por los SSD. Sin embargo, la implementación de BIM en las fases de Operación y Mantenimimento (O&M) aún es escasa. La mayoría de los problemas en el contexto de BIM-O&M radican en la interoperabilidad entre diferentes programas que requieren diferentes estructuras y formatos de datos. En un entorno BIM, existen problemas asociados a la extracción, el almacenamiento, la gestión, la integración y la difusión de datos para garantizar la interoperabilidad. Teniendo en cuenta los aspectos antes mencionados, el objetivo de esta tesis es facilitar la interoperabilidad entre los modelos BIM y los SSD relacionados con el rendimiento de los edificios, su estado de conservación y el confort de los ocupantes. Esta integración automatiza el proceso de transferencia de datos que puede ayudar a los gestores de edificios a establecer correctamente las medidas necesarias para mejorar su rendimiento y el confort de sus ocupantes. Esta integración también va a proporcionar a los gestores de edificios una plataforma eficaz para la visualización de datos de una manera fácil de usar que puede ayudar a integrar resultados de los SSD y convertirlos en acciones estratégicas. Para demostrar la aplicabilidad y la eficiencia de este integración, ésta se valida a través de casos de estudio. También se realizan pruebas de verificación sobre la información exportada en los diferentes sistemas. Los resultados demuestran un aumento de la eficiencia en la recopilación de datos de alta calidad para diferentes tipos de DSS, lo que reduce el tiempo y el esfuerzo que los gestores de edificios dedican a buscar información e introducir datos en la diferentes aplicaciones. Un script de Dynamo está diseñado para permitir que los gestores incluyan tanta información como deseen en los modelos BIM. Además, se propone un enfoque novedoso para crear una nueva categoría en BIM para ayudar a las administraciones públicas y empresariales a gestionar los activos de manera eficiente. Además, los aspectos del rendimiento del edificio también se pueden analizar utilizando el método propuesto de integrar los comentarios de los ocupantes en los modelos BIM. Al implementar el enfoque propuesto, los gestores de edificios pueden establecer correctamente las medidas que se pueden aplicar para mitigar los efectos negativos en los edificios, mejorando así su rendimiento y el confort de sus ocupantes. Además, la integración propuesta permite que BIM sea una herramienta más útil para la visualización mediante el uso de los gráficos y las opciones de formato más apropiados, guiando a la toma de decisiones para gestionar los edificiosPostprint (published version

Towards quality programming in the automated testing of distributed applications

PhD ThesisSoftware testing is a very time-consuming and tedious activity and accounts for over 25% of the cost of software development. In addition to its high cost, manual testing is unpopular and often inconsistently executed. Software Testing Environments (STEs) overcome the deficiencies of manual testing through automating the test process and integrating testing tools to support a wide range of test capabilities. Most prior work on testing is in single-thread applications. This thesis is a contribution to testing of distributed applications, which has not been well explored. To address two crucial issues in testing, when to stop testing and how good the software is after testing, a statistics-based integrated test environment which is an extension of the testing concept in Quality Programming for distributed applications is presented. It provides automatic support for test execution by the Test Driver, test development by the SMAD Tree Editor and the Test Data Generator, test failure analysis by the Test Results Validator and the Test Paths Tracer, test measurement by the Quality Analyst, test management by the Test Manager and test planning by the Modeller. These tools are integrated around a public, shared data model describing the data entities and relationships which are manipulable by these tools. It enables early entry of the test process into the life cycle due to the definition of the quality planning and message-flow routings in the modelling. After well-prepared modelling and requirements specification are undertaken, the test process and the software design and implementation can proceed concurrently. A simple banking application written using Java Remote Method Invocation (RMI) and Java DataBase Connectivity (JDBC) shows the testing process of fitting it into the integrated test environment. The concept of the automated test execution through mobile agents across multiple platforms is also illustrated on this 3-tier client/server application.The National Science Council, Taiwan: The Ministry of National Defense, Taiwan