Measuring the software process and product: Lessons learned in the SEL

The software development process and product can and should be measured. The software measurement process at the Software Engineering Laboratory (SEL) has taught a major lesson: develop a goal-driven paradigm (also characterized as a goal/question/metric paradigm) for data collection. Project analysis under this paradigm leads to a design for evaluating and improving the methodology of software development and maintenance

Software component testing : a standard and the effectiveness of techniques

This portfolio comprises two projects linked by the theme of software component testing, which is also often referred to as module or unit testing. One project covers its standardisation, while the other considers the analysis and evaluation of the application of selected testing techniques to an existing avionics system. The evaluation is based on empirical data obtained from fault reports relating to the avionics system. The standardisation project is based on the development of the BC BSI Software Component Testing Standard and the BCS/BSI Glossary of terms used in software testing, which are both included in the portfolio. The papers included for this project consider both those issues concerned with the adopted development process and the resolution of technical matters concerning the definition of the testing techniques and their associated measures. The test effectiveness project documents a retrospective analysis of an operational avionics system to determine the relative effectiveness of several software component testing techniques. The methodology differs from that used in other test effectiveness experiments in that it considers every possible set of inputs that are required to satisfy a testing technique rather than arbitrarily chosen values from within this set. The three papers present the experimental methodology used, intermediate results from a failure analysis of the studied system, and the test effectiveness results for ten testing techniques, definitions for which were taken from the BCS BSI Software Component Testing Standard. The creation of the two standards has filled a gap in both the national and international software testing standards arenas. Their production required an in-depth knowledge of software component testing techniques, the identification and use of a development process, and the negotiation of the standardisation process at a national level. The knowledge gained during this process has been disseminated by the author in the papers included as part of this portfolio. The investigation of test effectiveness has introduced a new methodology for determining the test effectiveness of software component testing techniques by means of a retrospective analysis and so provided a new set of data that can be added to the body of empirical data on software component testing effectiveness

Statistical analysis of EQ-5D profiles: does the use of value sets bias inference?

Health state profile data, such as those provided by the EQ-5D, are widely collected in clinical trials, population surveys and a growing range of other important health sector applications. However, these profile data are difficult to summarise to give an overall view of the health of a given population that can be analysed for differences between groups or within groups over time. A common way of short-cutting this problem is to transform profiles into a single number, or index, using sets of weights, often elicited from the general public in the form of values. Are there any problems with this procedure? In this paper we demonstrate the underlying effects of the use of value sets as a means of weighting profile data. We show that any set of weights introduces an exogenous source of variance to health profile data. These can distort findings about the significance of changes in health between groups or over time. No set of weights is neutral its effect. If a summary of patient reported outcomes is required, it may be better to use an instrument that yields this directly – such as the EQ VAS – along with the descriptive instrument. If this is not possible, researchers should have a clear rationale for their choice of weights; and be aware that those weighs may exert a non-trivial effect on their analysis. This paper focuses on the EQ-5D, but the arguments and their implications for statistical analysis are relevant to all health state descriptive systems

Applying a unified public relations evaluation model in a European context

The evaluation of public relations programmes has been a topic of keen interest to the public relations community for many years. A number of three level/stage models have been proposed to describe and explain the evaluation process. They have not been successful in terms of practitioner acceptance and have been criticised for being unrealistic and lacking feedback mechanisms. More recently the short-term and continuing models have been developed in response to these criticisms. This paper suggests a Unified Evaluation model which uses an established analysis of the communication/persuasion process as a framework to integrate and unify existing models that describe the public relations evaluation process. The proposed testing of this model in a European, transnational context is then outlined

Development and use of clinical performance indicators for ambulance services and prehospital care: a discussion paper for a clinical quality improvement framework for ambulance services

Clinical Performance Indicators for ambulance services should be developed in line with best evidence, in partnership with clinicians and service users, and linked to national structures for knowledge and evidence, clinical expertise and research and development. Their development should be guided by a performance monitoring protocol. Clinical Performance Indicators for ambulance services should be meaningful, measurable and realistic, aiming to address issues that matter to patients and clinicians, to benchmark performance, to reduce variations within and between health services and to bring about improvements in care for patients and users. Indicators should function as part of a planned clinical quality improvement framework that draws on modern improvement principles, methods, tools and techniques. Clinical Performance Indicators for ambulance services should be designed to provide safe, effective, patient centred, timely, efficient and equitable healthcare. Importantly, they should support clinicians and services in providing better care to their patients. Resources should be made available to trusts to undertake such measurements, to contribute to the national data set, to participate in future development and to deliver the aims of quality improvement

Performance measurement in the service business: the facilities management function

The nature of performance measurement has changed over the past few decades. Generally performance measurement indicates successful management in the fulfilment of organisation goals. In service businesses measuring customer satisfaction and service quality has become an industry standard and as FM is becomes more widely recognised as a component in the business value chain and corporate strategic objectives, the adoption of performance indicators that relate directly to the core business driver is key to success. This paper examines the state of knowledge of performance measurement in a facilities management context, expounds and reveals the role that performance measurement plays in the overall efficiency of the FM service function in relation to service business operation. The paper suggests that a fully developed performance measurement solution can deliver as a business tool whilst acting as a driver in the innovation process of service organisation

Cloud based testing of business applications and web services

This paper deals with testing of applications based on the principles of cloud computing. It is aimed to describe options of testing business software in clouds (cloud testing). It identifies the needs for cloud testing tools including multi-layer testing; service level agreement (SLA) based testing, large scale simulation, and on-demand test environment. In a cloud-based model, ICT services are distributed and accessed over networks such as intranet or internet, which offer large data centers deliver on demand, resources as a service, eliminating the need for investments in specific hardware, software, or on data center infrastructure. Businesses can apply those new technologies in the contest of intellectual capital management to lower the cost and increase competitiveness and also earnings. Based on comparison of the testing tools and techniques, the paper further investigates future trend of cloud based testing tools research and development. It is also important to say that this comparison and classification of testing tools describes a new area and it has not yet been done

Guidelines for physical weed control research: flame weeding, weed harrowing and intra-row cultivation

A prerequisite for good research is the use of appropriate methodology. In order to aggregate sound research methodology, this paper presents some tentative guidelines for physical weed control research in general, and flame weeding, weed harrowing and intra-row cultivation in particular. Issues include the adjustment and use of mechanical weeders and other equipment, the recording of impact factors that affect weeding performance, methods to assess effectiveness, the layout of treatment plots, and the conceptual models underlying the experimental designs (e.g. factorial comparison, dose response). First of all, the research aims need to be clearly defined, an appropriate experimental design produced and statistical methods chosen accordingly. Suggestions on how to do this are given. For assessments, quantitative measures would be ideal, but as they require more resources, visual classification may in some cases be more feasible. The timing of assessment affects the results and their interpretation. When describing the weeds and crops, one should list the crops and the most abundantly present weed species involved, giving their density and growth stages at the time of treatment. The location of the experimental field, soil type, soil moisture and amount of fertilization should be given, as well as weather conditions at the time of treatment. The researcher should describe the weed control equipment and adjustments accurately, preferably according to the prevailing practice within the discipline. Things to record are e.g. gas pressure, burner properties, burner cover dimensions and LPG consumption in flame weeding; speed, angle of tines, number of passes and direction in weed harrowing. The authors hope this paper will increase comparability among experiments, help less experienced scientists to prevent mistakes and essential omissions, and foster the advance of knowledge on non-chemical weed management

Research and Applications of the Processes of Performance Appraisal: A Bibliography of Recent Literature, 1981-1989

[Excerpt] There have been several recent reviews of different subtopics within the general performance appraisal literature. The reader of these reviews will find, however, that the accompanying citations may be of limited utility for one or more reasons. For example, the reference sections of these reviews are usually composed of citations which support a specific theory or practical approach to the evaluation of human performance. Consequently, the citation lists for these reviews are, as they must be, highly selective and do not include works that may have only a peripheral relationship to a given reviewer\u27s target concerns. Another problem is that the citations are out of date. That is, review articles frequently contain many citations that are fifteen or more years old. The generation of new studies and knowledge in this field occurs very rapidly. This creates a need for additional reference information solely devoted to identifying the wealth of new research, ideas, and writing that is changing the field