A Framework for Implementing Software Measurement Programs in Small and Medium Enterprises

The economies of numerous nations, including New Zealand, rely heavily on the contributions of small and medium enterprises (SMEs). In the last decade a shift to the provision and use of software services, rather than products, has seen these offerings developed and delivered by multiple parties working in distributed and possibly transient networks, indicating that software SMEs could not only survive but can, in fact, thrive long-term at a small scale. Most research on software success and failure, however, has been conducted in large organizations working on large-scale projects. Given the new work context described above, it is imperative that we also understand the circumstances that enable SMEs to be successful in software development. In general terms, software measurement has been considered to be one of the keys to success. The use of measurement is common in everyday life, such as checking the shortest path to your destination or weighing your luggage before taking a flight. It is also accepted in many science and engineering disciplines such as electrical and mechanical engineering. In spite of its acknowledged importance and rather obvious benefits, the use of measurement in software engineering has been variable. Software measurement is particularly conceived as a complex procedure, and therefore as a challenging and potentially costly endeavour, by software SMEs (SSMEs). The aim of this research is to comprehensively understand and then contribute to more effective planning, deployment, operation and management of measurement programs specifically in the context of SMEs. The research reported in this thesis explores in detail the particular challenges that are encountered by SMEs when they embark on a software measurement initiative. It then proceeds to identify ways in which SMEs could effectively and efficiently implement light-weight software measurement programs (SMPs). In doing so the research combines elements of observation, design, intervention and evaluation under the umbrella of a Design Science Research (DSR) methodology. In three DSR the research conducts 1) problem identification through a literature review (via a mapping study) and an industrial review (via practitioners’ interviews), 2) solution design through field studies, and 3) evaluation through a survey. A mix of quantitative and qualitative methods is used as appropriate for each phase. In the first phase, a comprehensive systematic mapping study is first conducted to review prior literature that had addressed SMPI in SMEs, to understand the state-of-the-art. The mapping study leads to the identification of a research gap which is further investigated through an industrial review. In the industrial review, 22 face-to-face interviews are conducted with professionals from SMEs. Hereafter, data analysis methods based on Grounded Theory (GT) enable the development of exploratory frameworks of four aspects of software measurement program implementation – challenges, obstacles, benefits and success factors – which forms one of the primary contributions of this research. Based on these intermediate findings the second phase of this research involves the development of a novel framework which is intended to overcome (or at least reduce the severity of) measurement implementation challenges faced by SMEs. Implementing and sustaining a framework for the efficient planning and management of measurement programs remains a challenge for many software organizations, and particularly SMEs. Therefore, in this research phase, a comprehensive framework is proposed and refined, based on field studies that consider its adequacy in relation to the identified challenges and obstacles. The framework, referred to as the Software Measurement Framework for SMEs (SMF4SME), as developed and enhanced in the field over three cases, is a further novel contribution of this research. The last major research phase validates the SMF4SME by seeking the insights of a sample of software practitioners working in SMEs, with respect to its perceived usefulness. An industrial survey is designed and distributed to potential participants to get their feedback. More than 100 respondents provide favourable indications regarding the coverage and potential utility of the framework in SSMEs. Overall, this research work contributes to both theory and practice by providing an improved understanding of SMPI in SMEs along with a validated SMF4SME intended to overcome (or at least reduce the severity of) measurement implementation challenges in SMEs

Software engineering risk management : a method, improvement framework, and empirical evaluation

This dissertation presents a method for software risk management, its improvement framework, and results from its empirical evaluations. More specifically, our objectives were: Develop a comprehensive, theoretically sound, and practical method for software engineering risk management. Develop a framework and supporting software tools for the continuous improvement of software engineering risk management and for improving knowledge about risks. Evaluate the method in practice to provide information on its feasibility, effectiveness, advantages and disadvantages, and to improve it. Although risk management has been considered an important issue in software development and significant contributions to risk management have been made over the past decade, risk management is rarely actively and explicitly applied in practice. Furthermore, most risk management approaches in software engineering use simplistic approaches and fail to account for the biases common in risk perception. We have developed a method, called Riskit, that complements existing risk management approaches by supporting qualitative and structured analysis of risks through a graphical modeling formalism. The method supports multiple stakeholder views to risks by considering their potential utility losses. The Riskit method is comprehensive, i.e., it supports all aspects of risk analysis and risk management planning in a software development project. We propose that our method has a sound theoretical foundation, avoids common biases in risk evaluations, and results in a more thorough understanding of the risks than traditional approaches. Associated with the method, we have also developed a risk management improvement framework that supports continuous, systematic improvement of the risk management process. The improvement framework is based on the Quality Improvement Paradigm, and is supported by the eRiskit application. The eRiskit application supports the management of risks while simultaneously acting as a risk management repository that captures risk management data for improvement purposes. The eRiskit application also acted as a proof of concept for the correctness of the underlying concepts in the Riskit method. We have validated the feasibility and effectiveness of the Riskit method in a series of empirical studies. The empirical studies were designed to provide characterization information and feedback on the method, as well as to act as initial validation of the method. The empirical evaluations showed that the method is feasible in industrial context and it seemed to improve participants' confidence in risk management results. In addition, our research indicates that industry needs sound, systematic, yet cost effective methods for risk management, a common and customized approach to improve communications within an organization, and support and enforcement of the common approach.reviewe

A systematic approach for the analysis, design and implementation of Telecommunications-Supported Training (TST) systems

The objetive of the present thesis is to develop and test out a systematic approach to the analysis, design and implementation of Telecommunications-Supported Training (TST) systems. The Literature Review offers a set of approaches to similar problems in the field of Information Systems. Several other disciplines have also been considered: Psychology of Human Factors, Organizational and Innovation Theory, and applied research being currently carried out under the EU DELTA Programme. A global User-Centred Model of TST has been developed, based on the wellestablished principles of Systems Engineering and Soft Systems Methodology. The theoretical basis for this model is the concept of TST Architecture, conceived as a functional arrangement of technical components which are introduced in order to improve the performance of the actors involved in the system. The other key aspect is the design of a set of Adoption Strategies, aiming for the creation of the necessary conditions to achieve user acceptance of the technologies implemented. Following these principles, the ADAM (Architectural Design and Adoption Model) systematic approach is developed. It is structured in five stages: Context Analysis, System Analysis, System Design, System Implementation and System Maintenance. Each stage is structured into steps and activities, described in terms of key points, outcomes, deliverables, and roles involved. The ADAM approach has been tested out in its twofold dimension of analyzing already implemented TST systems and designing new ones. The first case discusses the application of ADAM to the EU Multimedia TeleSchool (MTS) TST system. The test is completed by discussing the design and implementation, performed by the author, of a TST system at the Universidad Politecnica de Madrid. The results confirm the usefulness of ADAM both for practitioners and researchers in the field. Also, the TST model is extended as regards the components of acceptance and adoption, and their impact on the introduction of technologies in organizations

Eco-innovation: Tools to facilitate early-stage workshops

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.This thesis presents research carried out into the use of creative tools at the early stages of eco-innovation. Eco-innovation is a practical approach aiming to develop new products and processes which significantly decrease our impact on the environment. Designers are trained to develop profitable products that increase production and consumption. Eco-innovation is a new discipline in which designers can radically reduce the environmental burdens of production and consumption through the innovation of new types of products and services. The main aim of this research was to develop an approach that would promote significant environmental improvements whilst remaining a practical, design-focused discipline. Problems and under-investigated aspects of eco-innovation were identified: • Creative approaches at early stages of eco-innovation were under-investigated and few tools had been developed for use at the early stages. • Empirical design research techniques had rarely been used to assess new eco-innovation tools or to inform their subsequent development. The focus of the research work was the development and testing of tools to facilitate workshops at the early stages of eco-innovation. Not only was the goal to facilitate the generation of radical ideas but also to ensure that these were developed into appropriate solutions having the potential to be taken up in industry. The development of the tools was based on literature research, worked examples and interviews. The tools were tested in controlled workshop experiments and the results were analysed using various empirical techniques. First, an idea-recording technique to improve the efficiency of generating and harvesting ideas in a team design process was developed. This novel tool was called the Product Ideas Tree (PIT) diagram. The tool was tested for its ability to facilitate design workshops. Secondly, a structured approach to innovation - the theory of inventive problem solving (TRIZ) - was investigated. Worked examples using some of the tools from TRIZ were presented and a limited number of tools were selected and simplified for testing in team design workshops. The PIT diagram and TRIZ tools experiments established which attributes of the tools and approaches were most beneficial. The development and testing of these specific tools provided the following general contributions to eco-innovation: • A model for eco-innovation that describes the factors influencing the discipline and the attributes of good practice. • A recommended process to transform radical ideas into appropriate solutions to improve their potential to be taken up in industry. • General insights into the use of tools in early-stage workshops such as: tool selection, integration into existing processes, system-level problem solving and providing thematic information. • Suggested improvements for testing tools in controlled workshop experiments.EPSR

Design research in the Netherlands 2010 : proceedings of the symposium held on 20-21 May 2010, Eindhoven University of Technology

Design Research in the Netherlands occurs every five years to take stock of the state-of-the-art in design research that takes place in all design disciplines in the Netherlands. How has our understanding of design developed through research on this phenomenon? What are the research and development methodologies used to acquire insight in design? What have we achieved in the past period, and what are out expectations for the coming period? Researchers and research groups outline their development over the past five years in position papers, addressing insights, methods, results, and problems. Design Research in the Netherlands 2010 is the fourth edition, following three symposia held in 1995, 2000, and 2005. The five-year cycle allows to take conceptual distance from everyday problems that are often project-specific, and to assess how the field is developing. The proceedings form a valuable cross-disciplinary overview of research on design

Proceedings ICPW'07: 2nd International Conference on the Pragmatic Web, 22-23 Oct. 2007, Tilburg: NL

Proceedings ICPW'07: 2nd International Conference on the Pragmatic Web, 22-23 Oct. 2007, Tilburg: N

A clustering based matrix for selecting optimal tools and techniques in quality management

The purpose of this research was to explore a systematic pattern for selecting quality tools and techniques in the manufacturing and service industries. This study asked, “What are the best DMAIC tools and techniques concerning circumstances of quality dimensions of products and services?” To answer this question, this research developed innovative, diagnostic matrices by mimicking the contradiction matrix of the Theory of Inventive Problem Solving (TRIZ). These innovative matrices are intended to help non-expert users to select the best sets of quality tools and techniques for solving different quality problems. By conducting a cluster analysis, the researcher uncovered homogeneous patterns of enough quality case studies, which ultimately provided the basis for selecting optimal groups of quality tools and techniques in different circumstances. Thus, the researcher examined the association and prevalence of different quality tools and techniques (independent variables) and the quality dimensions (dependent variables). The study developed the contradiction matrix for manufacturing, which includes the optimal 17 DMAIC lists of tools and techniques. Also, the study developed the contradiction matrix for service, which ultimately includes the optimal 15 DMAIC lists of tools and techniques. After developing and verifying the developed contradiction matrices, the researcher discussed their strengths and limitations as well as their roles for selecting the appropriate quality tools and techniques in the manufacturing and service industries. The results of this research can be used as a basis for many future investigations in the field of quality management and innovation

Proceedings of the 19th Annual Software Engineering Workshop

The Software Engineering Laboratory (SEL) is an organization sponsored by NASA/GSFC and created to investigate the effectiveness of software engineering technologies when applied to the development of applications software. The goals of the SEL are: (1) to understand the software development process in the GSFC environment; (2) to measure the effects of various methodologies, tools, and models on this process; and (3) to identify and then to apply successful development practices. The activities, findings, and recommendations of the SEL are recorded in the Software Engineering Laboratory Series, a continuing series of reports that include this document

An interpretive study of software risk management perspectives.

Thesis (M.Sc.)-University of Natal, Pietermaritzburg, 2002.This dissertation addresses risk management in the software development context. The discussion commences with the risks in software development and the necessity for a software risk management process. The emergent discourse is based on the shortfalls in current risk management practices, elaborated in the software risk management literature. This research proposes a framework for a field investigation of risk management in the context of a particular software development organization. It was experimentally tested within several companies. This framework was designed to provide an understanding of the software development risk phenomena from a project manager's perspective and to understand how this perspective affects their perception. This was done with respect to the consideration of the advantages and disadvantages of software risk management as regards its applicability or inapplicability, respectively. This study can be used as a precursor to improving research into the creation of new software risk management frameworks