An Evaluation of Software Measurement Processes in Pakistani Software Industry

Implementing a successful measurement process is a challenging task. Most measurement studies report measurement models, experiences, and lessons learned based on pilot projects or case studies in a limited scope to overcome specific challenges. This paper identifies 14 basic measurement practices and proposes a model of 18 success factors for implementing measurement processes with respect to the identified measurement theories in our systematic literature review (SLR), i.e., A systematic literature review on software measurement programs, by Tahir et al. , 2016. In addition, a survey is conducted to evaluate the state of measurement practices and to validate the proposed model based on the feedback from 200 software professionals working in Pakistani software industry. The state of measurement practices in the industry is mostly not according to the identified measurement theories in the SLR. For instance, more than 50 measurement models reported in the literature but only 10% software organizations follow any measurement model. 75% of organizations do not follow any measurement standard. 80% software organizations do not use any measurement tool. The proposed model is validated by applying structural equation modeling on the survey data. Furthermore, among 18 success factors, it is statistically significant that Pakistani software professionals strongly believe in necessity of three factors for successful implementation of a measurement process, i.e., synchronization between measurement process and software process improvement, use of measurement standards, and use of measurement models. In addition, they also believe that a successful measurement process will improve prediction, monitoring and management of software projects, and support in achievement of individual and organization-wide objectives. Software organizations might consider this paper in planning and improving their measurement processes

A Framework for Implementing Software Measurement Programs in Small and Medium Enterprises

The economies of numerous nations, including New Zealand, rely heavily on the contributions of small and medium enterprises (SMEs). In the last decade a shift to the provision and use of software services, rather than products, has seen these offerings developed and delivered by multiple parties working in distributed and possibly transient networks, indicating that software SMEs could not only survive but can, in fact, thrive long-term at a small scale. Most research on software success and failure, however, has been conducted in large organizations working on large-scale projects. Given the new work context described above, it is imperative that we also understand the circumstances that enable SMEs to be successful in software development. In general terms, software measurement has been considered to be one of the keys to success. The use of measurement is common in everyday life, such as checking the shortest path to your destination or weighing your luggage before taking a flight. It is also accepted in many science and engineering disciplines such as electrical and mechanical engineering. In spite of its acknowledged importance and rather obvious benefits, the use of measurement in software engineering has been variable. Software measurement is particularly conceived as a complex procedure, and therefore as a challenging and potentially costly endeavour, by software SMEs (SSMEs). The aim of this research is to comprehensively understand and then contribute to more effective planning, deployment, operation and management of measurement programs specifically in the context of SMEs. The research reported in this thesis explores in detail the particular challenges that are encountered by SMEs when they embark on a software measurement initiative. It then proceeds to identify ways in which SMEs could effectively and efficiently implement light-weight software measurement programs (SMPs). In doing so the research combines elements of observation, design, intervention and evaluation under the umbrella of a Design Science Research (DSR) methodology. In three DSR the research conducts 1) problem identification through a literature review (via a mapping study) and an industrial review (via practitioners’ interviews), 2) solution design through field studies, and 3) evaluation through a survey. A mix of quantitative and qualitative methods is used as appropriate for each phase. In the first phase, a comprehensive systematic mapping study is first conducted to review prior literature that had addressed SMPI in SMEs, to understand the state-of-the-art. The mapping study leads to the identification of a research gap which is further investigated through an industrial review. In the industrial review, 22 face-to-face interviews are conducted with professionals from SMEs. Hereafter, data analysis methods based on Grounded Theory (GT) enable the development of exploratory frameworks of four aspects of software measurement program implementation – challenges, obstacles, benefits and success factors – which forms one of the primary contributions of this research. Based on these intermediate findings the second phase of this research involves the development of a novel framework which is intended to overcome (or at least reduce the severity of) measurement implementation challenges faced by SMEs. Implementing and sustaining a framework for the efficient planning and management of measurement programs remains a challenge for many software organizations, and particularly SMEs. Therefore, in this research phase, a comprehensive framework is proposed and refined, based on field studies that consider its adequacy in relation to the identified challenges and obstacles. The framework, referred to as the Software Measurement Framework for SMEs (SMF4SME), as developed and enhanced in the field over three cases, is a further novel contribution of this research. The last major research phase validates the SMF4SME by seeking the insights of a sample of software practitioners working in SMEs, with respect to its perceived usefulness. An industrial survey is designed and distributed to potential participants to get their feedback. More than 100 respondents provide favourable indications regarding the coverage and potential utility of the framework in SSMEs. Overall, this research work contributes to both theory and practice by providing an improved understanding of SMPI in SMEs along with a validated SMF4SME intended to overcome (or at least reduce the severity of) measurement implementation challenges in SMEs

In press: An Elicitation Instrument for Operationalising GQM+Strategies (GQM+S-EI)

Context: A recent approach for measurement program planning, GQM+Strategies, provides an important extension to existing approaches linking measurements and improvement activities to strategic goals and ways to achieve these goals. There is a need for instruments aiding in eliciting information from stakeholders to use GQM+Strategies. The success of GQM+Strategies highly depends on accurately identifying goals, strategies and information needs from stakeholders. Objective: The research aims at providing an instrument (called GQM+SEI), aiding practitioners to accurately elicit information needed by GQM+Strategies (capturing goals, strategies and information needs). Method: The research included two phases. In the first phase, using action research method, the GQM+S-EI was designed in three iterations in Ericsson AB. Thereafter, a case study was conducted to evaluate whether the information elicited with the designed instrument following the defined process was accurate and complete. Results: We identified that the industry requires elicitation instruments that are capable to elicit information from stakeholders, not having to know about the concepts (e.g. goals and strategies). The case study results showed that our proposed instrument is capable of accurately and completely capturing the needed information from the stakeholders. Conclusions: We conclude that GQM+S-EI can be used for accurately and completely eliciting the information needed by goal driven measurement frameworks. The instrument has been successfully transferred to Ericsson AB for measurement program planning

Architectural stability of self-adaptive software systems

This thesis studies the notion of stability in software engineering with the aim of understanding its dimensions, facets and aspects, as well as characterising it. The thesis further investigates the aspect of behavioural stability at the architectural level, as a property concerned with the architecture's capability in maintaining the achievement of expected quality of service and accommodating runtime changes, in order to delay the architecture drifting and phasing-out as a consequence of the continuous unsuccessful provision of quality requirements. The research aims to provide a systematic and methodological support for analysing, modelling, designing and evaluating architectural stability. The novelty of this research is the consideration of stability during runtime operation, by focusing on the stable provision of quality of service without violations. As the runtime dimension is associated with adaptations, the research investigates stability in the context of self-adaptive software architectures, where runtime stability is challenged by the quality of adaptation, which in turn affects the quality of service. The research evaluation focuses on the effectiveness, scale and accuracy in handling runtime dynamics, using the self-adaptive cloud architectures