Achieving business excellence in software quality management

Many companies have had difficulties in achieving success with software process improvement initiatives or have had adverse experiences in implementing quality systems. With a plethora of standards available and the numerous frameworks to apply best practice, none appears to act as a panacea to guarantee fulfilment or realise a true Return-on-Investment. This paper proposes a holistic approach to software process improvement, describing a range of supporting tools and methods highlighting a true understanding of the customer base and associated cultures. The research aim was to develop and evaluate a demonstrably effective and efficient software quality management methodology suitable for a technical company. To be effective the methodology must deliver real process improvement conformance to the best practice quality standards. To be efficient the methodology must deliver a real Return-on-Investment. A range of case studies are described including audits, self-assessment, training, system design, marketing, and the people skills associated with a consultation process are all examined in detail. Each case study provided a further opportunity to measure and analyse the success or otherwise of that method for further refinement. The research methodology has demonstrated its success as the data collected during these case studies show that steady improvement in implementing the software quality system has occurred year on year. This success has been validated by third party ISO 9001 assessments and has led to an enhancement in reputation. The approach has overcome cultural resistance and changed working practices. With a philosophy of customer care, consultation, and active engagement, practitioners adopt best-practice quality management principles. The cost effectiveness of this methodology means its adoption could be considered by any organisation whether large or small

Achieving business excellence in software quality management

Many companies have had difficulties in achieving success with software process improvement initiatives or have had adverse experiences in implementing quality systems. With a plethora of standards available and the numerous frameworks to apply best practice, none appears to act as a panacea to guarantee fulfilment or realise a true Return-on-Investment. This thesis proposes a holistic approach to software process improvement, describing a range of supporting tools and methods highlighting a true understanding of the customer base and associated cultures. The research aim was to develop and evaluate a demonstrably effective and efficient software quality management methodology suitable for a technical company such as AWE plc. To be effective the methodology must deliver an improved conformance to the quality standards and deliver real process improvement. To be efficient the methodology must deliver a real Return-on-Investment. Case studies on the implementation of the quality system were carried out at AWE plc. Each case study provided a further opportunity to measure and analyse the success or otherwise of that method or tool for further refinement. Audits, self-assessment, training, system design, marketing, and the people skills associated with a consultation process are all examined in detail. The research methodology has demonstrated its success as case studies show that steady improvement in implementing the software quality system has occurred year on year. This success has been validated by third party ISO 9001 assessments and has led to an enhancement in AWE plc reputation as a centre of software excellence. The approach has overcome cultural resistance and changed working practices. With a philosophy of customer care, consultation, and active engagement, practitioners now adopt best-practice quality management principles. The cost effectiveness of this methodology means its adoption could be considered by any organisation whether large or small

A hierarchy of SPI activities for software SMEs: results from ISO/IEC 12207-based SPI assessments

In an assessment of software process improvement (SPI) in 15 software small- and –medium-sized enterprises (software SMEs), we applied the broad spectrum of software specific and system context processes in ISO/IEC 12207 to the task of examining SPI in practice. Using the data collected in the study, we developed a four-tiered pyramidal hierarchy of SPI for software SMEs, with processes in the higher tiers undergoing SPI in more companies than processes on lower level tiers. The development of the hierarchy of SPI activities for software SMEs can facilitate future evolutions of process maturity reference frameworks, such as ISO/IEC 15504, in better supporting software development in software SMEs. Furthermore, the findings extend our body of knowledge concerning the practice of SPI in software SMEs, a large and vital sector of the software development community that has largely avoided the implementation of established process maturity and software quality management standards

National curriculum assessments review report: 2010 key stage 2 tests

Executive summary The Office of Qualifications and Examinations Regulation (Ofqual) is the regulator of qualifications, examinations and assessments in England, and is committed to ensuring that standards are maintained and that learners get the results they deserve. We keep under review the National Curriculum assessments developed by the Qualifications and Curriculum Development Agency (QCDA), in relation to a Regulatory Framework and Code of Practice. This report presents the findings of our review of the 2010 National Curriculum key stage 2 tests, with a particular focus on the marking and standards setting processes. It considers the various meetings and other activity reviewed in 2010, and concludes as follows

An evaluation of the RAPID assessment-based process improvement method for small firms

[Abstract]: With increasing interest by the software development community in software process improvement (SPI), it is vital that SPI programs are evaluated and the reports of lessons learned disseminated. This paper presents an evaluation of a program in which low-rigour, one-day SPI assessments were offered at no cost to 22 small Australian software development firms. The assessment model was based on ISO/IEC 15504 (SPICE). About twelve months after the assessment, the firms were contacted to arrange a follow-up meeting to determine the extent to which they had implemented the recommendations from the assessment. Comparison of the process capability levels at the time of assessment and the follow-up meetings revealed that the process improvement program was effective in improving the process capability of many of these small software development firms. Analysis of the assessment and follow-up reports explored important issues relating to SPI: elapsed time from assessment to follow-up meeting, the need for mentoring, the readiness of firms for SPI, the role of the owner/manager, the advice provided by the assessors, and the need to record costs and benefits. Based on a meta-analysis of the program and its outcomes, advice and recommendations are provided to small firms and assessors. As well as providing validation of the assessment model and method, the outcomes from this research have the potential to better equip practitioners and consultants to undertake software process improvement, hence increasing the success of small software development firms in domestic and global markets

Enterprise information security policy assessment - an extended framework for metrics development utilising the goal-question-metric approach

Effective enterprise information security policy management requires review and assessment activities to ensure information security policies are aligned with business goals and objectives. As security policy management involves the elements of policy development process and the security policy as output, the context for security policy assessment requires goal-based metrics for these two elements. However, the current security management assessment methods only provide checklist types of assessment that are predefined by industry best practices and do not allow for developing specific goal-based metrics. Utilizing theories drawn from literature, this paper proposes the Enterprise Information Security Policy Assessment approach that expands on the Goal-Question-Metric (GQM) approach. The proposed assessment approach is then applied in a case scenario example to illustrate a practical application. It is shown that the proposed framework addresses the requirement for developing assessment metrics and allows for the concurrent undertaking of process-based and product-based assessment. Recommendations for further research activities include the conduct of empirical research to validate the propositions and the practical application of the proposed assessment approach in case studies to provide opportunities to introduce further enhancements to the approach

Tailoring Program Outcomes and Assessments for your Program: A Case Study of an Economic Program

Per requirements and standards of SACs\u27 principles and assessments, institutions must show ongoing, integrated planning and evaluation processes that incorporate a systematic review of mission and goals. Faculty generated student outcomes and assessments have received a greater focus in recent years in higher education, especially at the author\u27s university, Embry Riddle Aeronautical University Worldwide (ERAU). In an effort to answer to all the consumers of our products, ERAU values programs that focus on making student learning outcomes central to the assessment process. To immediately implement this philosophy of outcomes based objectives and assessments within a program and estimate the value of implementing them within a course, the author redesigned and updated her ECON 210, Undergraduate Microeconomics online course as a sample within a program. Of special note, Economics is not a full stand alone program, but part of the Humanities and Economics Program within the Department of Arts and Letters at ERAU. The author used the Arnold Economics text and Aplia.com as a software tool in the course. Once she mapped the course\u27s learning outcomes to University expectations and self-defined Program Goals, she could clearly indicate where students were held accountable for learning a specific learning objective and the feedback given. This process makes program improvement actionable. The author also shares the results of her analysis and implementation of indicated changes. Not all quantitative results were statistically significant, but qualitative data suggests overall positive results. This process was an enlightening exercise for the author at a minimum as a formal tool to improve the delivery and effectiveness of her course. In addition, this has served as a model for the Department of Arts and Letters pilot assessment process of student learning outcomes