Process Assessment Issues of the ISO/IEC 29110 emerging standard

International audienceThe emerging ISO/IEC 29110 standard "Software Engineering - Lifecycle Profiles for Very Small Entities (VSE)" is an ISO initiative to provide Very Small Entities (VSE) with a suitable set of profiles for Process Assessment and Process Improvement. The approach is conforming to ISO 15504 2-D model of process capability: a process dimension based on a Process Reference Model (PRM), and a capability dimension with a set of process attributes grouped into capability levels. The ISO/IEC 29110 standard is developing 4 profiles for VSEs developing generic software: Entry, Basic, Intermediate and Advanced. This paper establishes a reduced set of Base Practices profiled from ISO 15504-5 "An exemplar Process Assessment Model (PAM)". It applies recommendations of ISO/IEC 29110 DTR 29110-3 about assessment and questions the use of a separated capability dimension and its usability for a VSE

Blending process assessment and employees competencies assessment in very small entities

The ISO/IEC 29110 series aims to provide Very Small Entities (VSEs) with a set of standards based on subsets of existing standards. Process capability determination does not seem suitable for a VSE in terms of return on investment. Our approach proposes to move the viewpoint away from process and to the human resources. We propose a blended assessment model using the ISO/IEC 15504 for the level 1, but based on competency assessment for higher capability levels

Building an Observatory of Course-of-Action in Software Engineering: towards a Link between ISO/IEC Software Engineering standards and a Reflective Practice

International audienceAs a help to compete in an evolving market, small software companies may use an observatory of their course-of-action. The course of action considers the observable aspect of the actor's activity. Its analysis provides a description of actors' activity and it can express recommendations concerning both the individual situations and the collective situation. The observatory is an articulated set of data collecting methods supported with semantic wikis and a dedicated application. A case study, based on the activity of a team of 6 young software engineers, depicts some aspects of the building and the filling of the course-of-action observatory. As primary results of this work, we may think that observing and analyzing software engineer's activity help to reveal his/her theory-in-use - what governs engineers' behavior and tends to be tacit structures - That may help engineers to establish links between "Project Processes-in-use" and a simplified Process Reference Model and contribute to reduce the fit between a project-in-action and espoused SE standards

Exploring the relationship between software process adaptive capability and organisational performance

Software development is a complex socio-technical activity, with the result that software development organisations need to establish and maintain robust software development processes. While much debate exists regarding the effectiveness of various software development approaches, no single approach is perfectly suited to all settings and no setting is unchanging. The capability to adapt the software process is therefore essential to sustaining an optimal software process. We designed an exploratory study to concurrently examine software process adaptive capability and organisational performance in 15 software development organisations, finding that companies with greater software process adaptive capability are shown to also experience greater business success. While our exploratory study of the complex relationship between these phenomena is limited in some respects, the findings indicate that software process adaptive capability may be worthy of further integration into software process engineering techniques. Software process adaptive capability may be an important organisational strength when deriving competitive advantage, and those responsible for the creation and evolution of software process models and methodologies may want to focus some of their future efforts in this area

Investigating the relationship between software process improvement, situational change, and business success in software SMEs

While we have learned a great deal from Software Process Improvement (SPI) research to date, no earlier study has been designed from the outset to examine the relationship between SPI and business success in software development small- to- medium- sized companies (software SMEs). Since business processes are generally acknowledged as having an important role to play in supporting business success, it follows that the software development process (a large and complex component of the overall business process) has an important contribution to make in supporting business success in software development companies. However, to date we have very little evidence regarding the role of SPI in supporting business success, especially for software SMEs. The need for SPI is dependent on the extent of situational change in a software development setting, and therefore any examination of the relationship between SPI and business success would be deficient if it did not also examine the extent of situational change. Therefore, this thesis describes a novel approach to examining SPI, situational change and business success in software development companies. Furthermore, having discharged this new approach to 15 software SMEs, this thesis makes the important new discovery that the amount of SPI implemented in a software SME is positively associated with the extent of business success – especially when the degree of situational change is taken into account. This thesis describes the first published study to examine the relationship between SPI, situational change and business success in software SMEs. The findings suggest that there are business benefits to implementing SPI in software SMEs, with the degree of situational change being an important factor informing SPI initiatives. Furthermore, this research has yielded valuable new insights into the nature of SPI, situational change and business success in software SMEs

Process improvement in four small software companies

[Abstract]: For many small software companies, full-scale software process improvement (SPI) initiatives are often out of reach due to prohibitive costs and lack of SPI knowledge. However, to compete in the global market, software developers must improve their productivity, time to market and customer satisfaction. As part of an Australian National Industry Improvement Program, Software Engineering Australia (Qld) sponsored a process improvement program in which 26 of its member companies participated. A RAPID assessment method, based on SPiCE (ISO 15504), was developed and applied by researchers from the Software Quality Institute. As well as detailing the RAPID assessment method, this paper presents findings from the process improvement program as experienced by four small software companies. For each company, the initial assessment findings are presented followed by the outcome of the recommendations, as determined by follow-up meetings. The discussion which follows compares the capability of the four companies and links the findings from this case study to existing literature related to software process improvement success and failure

Monitoring oriented agile based web applications development methodology for small software firms in Jordan

Small software firms (SSF) is vital to the software industry in many countries as they provide substantial growth to their economy. In Jordan, most software companies that are involved with developing Web applications are small firms. However, the extent of applying best Web applications development and management practices in these firms is limited. Besides, the existing software development methods are still lack of monitoring the quality of process and product. As a result, the Web application being developed exceeds deadlines and budget, and not meeting user requirements. Therefore, this research aims to construct a new methodology referred as Monitoring Oriented Agile Based Web Applications Development (MOGWD) Methodology for SSF. This study introduced an Extended Agile Method by extending the Scrum method with Extreme Programming (XP) elements. The Extended Agile Method was improved by combining common steps of Web design method and incorporating the Goal Oriented Monitoring Method (GOMM). The GOMM has defined twenty goals. Each goal has one or more questions. The questions are answered through the defined metrics. There are 101 qualitative metrics for monitoring the process quality, and 37 quantitative metrics for monitoring the process and product quality. Moreover, the proposed MOGWD methodology defines four phases: Plan, Do, Check and Act. The MOGWD methodology was evaluated using expert review and case study. The evaluation results show that the MOGWD methodology has gained SSF practitioners’ satisfaction and found to be practical for the real environment. This study contributes to the field of Agile based development and Web applications measurement. It also provides SSF practitioners a development methodology that monitors the quality of the process and product for Web development

Methods to evaluate lightweight software process assessment methods based on evaluation theory and engineering design principles

Achieving a mature software development process has become essential for many software organizations. A mature development process permits software organizations to provide their customers with a high quality software product delivered on time and within budget. Software organizations have been struggling for decades to improve the quality of their products by improving their software development processes. Designing an improvement program for a software development process is a demanding and complex task. This task consists of two main processes: the assessment process and the improvement process. A successful improvement process requires first a successful assessment; failing to assess the organization's software development process could create unsatisfactory results. Software processes assessment (SPA) can be used either to determine the capability of another organization, for subcontracting purposes, or to determine and understand the status of the organization's current processes to initiate an improvement process. The increasing number of assessment approaches available; the ISO 15504 standard that sets out the requirements for process assessment; and the popularity of the CMMI model, illustrate the relevance of software process assessment for the software development industry. Currently, several methods are available to assess the maturity and capability of a software development process based on well-known software process assessment and improvement frameworks such as CMMI and ISO-15504. The success of these assessment methods and improvement frameworks is supported by post-development studies on the validity, reliability and effectiveness of these methods. Unfortunately, many researchers consider that such methods are too large to implement in SME organizations. As a result, many researchers have studied process assessment and improvement in SME organizations and proposed assessment methods, usually called lightweight SPA methods, suitable to the organizations' needs. The current research in the SPA field focuses on proposing convenient and easy-to-use assessment methods, without investigating to what extent the design of these methods is related to the engineering design perspective. This unclear alignment with the engineering discipline raises questions about the relevance and representativeness of the results produced by these methods from an engineering viewpoint. Moreover, although numerous SPA methods are currently available which offer help and guidance, unfortunately they only partially address evidences found essential for achieving an SPA success. This thesis presents and discusses the evaluation of lightweight SPA methods. The evaluation is two-fold: evaluating the SPA methods design using a top-down approach and based on engineering viewpoints and evaluating the success of SPA methods using a bottom-up approach. The evaluation theory concepts are used as a framework to formally develop both evaluation methods. To develop the first evaluation method using the top-down approach, an exploratory analytical study of SPA methods from an engineering design viewpoint has been conducted. Vincenti's classification has been used as a tool for this analysis. The aim of this exploratory study is to put the developed SPA methods into an engineering design framework, and use this framework as a guideline to put the new SPA methods to be designed into the same engineering design framework. To develop the second evaluation method using the bottom-up approach, a systematic literature review was conducted to extract the set of evidences for the success of the SPA method based on requirements, observations, lessons learned and recommendations which have been formulated within the industry and published in books, conferences and journals. The development process of the two evaluation methods has then been verified using a set of verification criteria and the proposed evaluation methods were tested by conducting three case studies. The first evaluation method would be useful mainly for the designers of new SPA methods during the design phase, while the second evaluation method would be useful for both designers and practitioners of SPA methods to verify the success of the assessment method in question. This research project forms an entry point to study the alignment of SPA methods design with engineering design principles and sheds light on achieving successful assessment results by studying the successful evidences that should be supported by assessment methods separated from the improvement process. The proposed evaluation methods in this thesis have great benefits for SPA methods designed mainly for SME organizations, because these assessments methods, contrary to well-known methods, lack comprehensive studies on their reliability and effectiveness

Experiences Gained from Applying ISO/IEC 15504 to

This paper describes some experiences gained from applying ISO/IEC 15504 for software process assessments focusing on process improvement in four small software companies in Brazil. The assessments have been realized in the context of the research project 15504MPE, which aims at the development of a customized assessment method based on the standard ISO/IEC 15504 adapted to small brazilian software companies. The paper reports some of our experiences regarding the application of the standard especially to this kind of company. Costs and benefits related to the assessments are also presented. 1 1