Framework for evaluating water quality information system performance

1994 Fall.Includes bibliographic references (pages 280-308).Water resource and water quality managers are being held increasingly accountable for the programs they manage. Much progress has been made in applying total systems perspectives to the design and operation of water quality monitoring and information programs, and towards rationalizing those programs with respect to management objectives and information needs. A recent example of that progress is the development of data analysis protocols to enhance the information system design process. However, further work is necessary to develop approaches which can help managers confront the water quality management environment of the future, which will be characterized by: (1) fewer purely technical questions, (2) more complex problems with social, economic, political and legal ramifications, and (3) actively managed and continuously improved water quality information systems. This research concludes that the management of water quality information systems for continuous improvement requires: (1) a competent system design process, (2) comprehensive documentation of system design and operation, and (3) a routine and thorough performance measurement and evaluation process. The framework for evaluating water quality information system performance presented in this dissertation integrates the experience of several disciplines into an instrument to help water quality managers accomplish these requirements. The framework embodies four phases: (1) evaluation planning, (2) watershed and management system analyses, (3) information system analysis, and (4) information system performance evaluation. The application of the framework is demonstrated in the evaluation of water quality monitoring programs associated with a unique municipal water transfer project. Water quality professionals of the U.S. Environmental Protection Agency and the U.S. Geological Survey are surveyed as to its potential application to large (e.g., regional or national) systems. Those exercises indicate the framework to be a convenient, economic, and flexible instrument useful towards enhancing water quality information system performance. Recommendations for future research to refine the framework and to extend its scope and utility are also presented

Early evaluation of security functionality in software projects - some experience on using the common criteria in a quality management process

This paper documents the experiences of assurance evaluation during the early stage of a large software development project. This project researches, contracts and integrates privacy-respecting software to business environments. While assurance evaluation with ISO 15408 Common Criteria (CC) within the certification schemes is done after a system has been completed, our approach executes evaluation during the early phases of the software life cycle. The promise is to increase quality and to reduce testing and fault removal costs for later phases of the development process. First results from the still-ongoing project suggests that the Common Criteria can define a framework for assurance evaluation in ongoing development projects.Dieses Papier dokumentiert den Versuch, mittels der Common Criteria nach ISO 15408 bereits während der Erstellung eines Softwaresystems dessen Sicherheitseigenschaften zu überprüfen. Dies geschieht im Gegensatz zur üblichen Post-Entwicklungs-Evaluation

A Survey on Evaluation Factors for Business Process Management Technology

Estimating the value of business process management (BPM) technology is a difficult task to accomplish. Computerized business processes have a strong impact on an organization, and BPM projects have a long-term cost amortization. To systematically analyze BPM technology from an economic-driven perspective, we are currently developing an evaluation framework in the EcoPOST project. In order to empirically validate the relevance of assumed evaluation factors (e.g., process knowledge, business process redesign, end user fears, and communication) we have conducted an online survey among 70 BPM experts from more than 50 industrial and academic organizations. This paper summarizes the results of this survey. Our results help both researchers and practitioners to better understand the evaluation factors that determine the value of BPM technology

Complexity stage model of the medical device development based on economic evaluation-MedDee

The development of a new product is essential for the progress and success of any company. The medical device market is very specific, which is challenging. Therefore, this paper assesses an economic model for medical device evaluation using the economic, health, technology regulatory, and present market knowledge to enable the cost-time conception for any applicant. The purpose of this study is to propose a comprehensive stage model of the medical device development to subsequently describe the financial expenditure of the entire development process. The identification of critical steps was based on the literature review, and analysis, and a comparison of the available medical device development stages and directives. Furthermore, a preliminary assessment of the medical device development steps and procedures on the basis of the interviews was performed. Six interviews were conducted with an average duration of one hour, focusing on areas: relevance and level of detail of the medical device development stages, involvement of economic methods, and applicability of the proposed model. Subsequently, the improvement and modification of the medical device investment process, based on respondents' responses, were conducted. The authors have proposed the complexity model MedDee-Medical Devices Development by Economic Evaluation. This model is comprised of six phases: initiation, concept, design, production, final verification, and market disposition in which the economic methods are incorporated.Web of Science125art. no. 175

D3.2 Cost Concept Model and Gateway Specification

This document introduces a Framework supporting the implementation of a cost concept model against which current and future cost models for curating digital assets can be benchmarked. The value built into this cost concept model leverages the comprehensive engagement by the 4C project with various user communities and builds upon our understanding of the requirements, drivers, obstacles and objectives that various stakeholder groups have relating to digital curation. Ultimately, this concept model should provide a critical input to the development and refinement of cost models as well as helping to ensure that the curation and preservation solutions and services that will inevitably arise from the commercial sector as ‘supply’ respond to a much better understood ‘demand’ for cost-effective and relevant tools. To meet acknowledged gaps in current provision, a nested model of curation which addresses both costs and benefits is provided. The goal of this task was not to create a single, functionally implementable cost modelling application; but rather to design a model based on common concepts and to develop a generic gateway specification that can be used by future model developers, service and solution providers, and by researchers in follow-up research and development projects.<p></p> The Framework includes:<p></p> • A Cost Concept Model—which defines the core concepts that should be included in curation costs models;<p></p> • An Implementation Guide—for the cost concept model that provides guidance and proposes questions that should be considered when developing new cost models and refining existing cost models;<p></p> • A Gateway Specification Template—which provides standard metadata for each of the core cost concepts and is intended for use by future model developers, model users, and service and solution providers to promote interoperability;<p></p> • A Nested Model for Digital Curation—that visualises the core concepts, demonstrates how they interact and places them into context visually by linking them to A Cost and Benefit Model for Curation.<p></p> This Framework provides guidance for data collection and associated calculations in an operational context but will also provide a critical foundation for more strategic thinking around curation such as the Economic Sustainability Reference Model (ESRM).<p></p> Where appropriate, definitions of terms are provided, recommendations are made, and examples from existing models are used to illustrate the principles of the framework

Study on Input/Output Accounting Systems on EU agricultural holdings

Of 241 questionnaires sent out to 20 countries 55 completed forms were returned. No information could be obtained about systems in Portugal or the USA. The subject of nutrients was covered by 91% of systems, pesticides 38%, energy 29% and other subjects including wastes 44%. Nearly half of the systems covered more than one subject, the most common single subject system was nutrients. The arable sector was covered most often by the systems (76%), with dairy (62%) and pig (56%) the most prominent of the livestock sectors. The respondents judged that 65% of systems were at least moderately effective in improving the ratio of inputs to outputs. The highest levels of ratio reduction tended to occur with systems which included the livestock sectors or protected horticultural crops. Over half (56%) of farmers had a good opinion of the system, indifferent or bad opinions were more likely to be due to effect on income than the type of system or who managed it. High uptake was more likely in compensated systems. Farm incomes in the arable and dairy sectors were most likely to be improved by systems, negative effects were most likely in the horticultural sector. Government was the main driving force in 38% of the systems, but government was not necessarily the driving force behind the 15% compulsory systems and only one of these was compensated. Increasing concern about environmental issues was the driving force behind development of each of the systems studied. In most cases a major part of the funding to develop the system or run pilot projects came from government. Benefits in terms of increased awareness of problem areas were identified by several systems originators. Anecdotal evidence suggests that farmers are encouraged to make actual changes to their management on the basis of the systems, if they receive detailed help from an adviser associated with the system, or if the system results in a marketing advantage. It seems likely that input output accounting systems could be used to increase awareness and provide evidence of the impact of management changes, they may need to be linked to supporting systems of technical advice. More than 40 IOA systems representing very different approaches have been developed and applied on farms in European countries with the aim of improving environmental performance. Major differences regard especially two characteristics: The no topics covered (single or multiple) and the way indicators are presented. In many systems the indicators used are presented as calculations of input related to output and are derived from accounts based data. Other systems present indicators that are transformed to a standard scale and often these indicators are based on a combination of practise and account data compared with norms for Good Agricultural Practices. Moreover, the systems differ in their origin and driving force: Only a few systems have been developed for mandatory use or for labelling and formal auditioning. Most systems have been developed for the use by advisory services on a voluntary basis. A number of very different systems seem to have been successful. Effectiveness is defined here as the combination of a system with high (potential) impact on the participating farmers in combination with high uptake in terms of the no of farmers willing to use the system. Generally documentation of effects and uptake is poor and more investigations into this are needed. It seems that many systems have not passed the pilot phase, even though some of them did get a positive evaluation by the farmers. In several examples the effort of researchers to develop a scientifically valid concept was not matched by efforts to secure the uptake by advisors or other institutions afterwards. The right institutional setting and political context seems to be more important than the character of the indicators used for the question of farmer uptake. But that does not mean that the choice of indicators is not important from another point of view. In none of the reviewed systems were the use of confidence intervals or variation coefficients an established part of the procedure. Only few reports exist that analyse the variation between farms or between years on specific farms in order to decide to which degree differences are due to systematically different management practices

A rework reduction model for construction projects

Rework is an endemic problem in building construction projects and is an area of research that has received limited attention. Recent research has shown that rework is the primary cause of time and schedule overruns in projects and that rework levels do not significantly differ between current procurement methods despite calls from government for the use of more integrated procurement approaches such as design-and-construct to improve project performance. To reduce the incidence of rework throughout the construction supply chain, data from 161 completed projects were gathered using a questionnaire survey. Stepwise multiple regression was used to determine the significant variables that contributed to rework in projects. In conjunction with previously reported research, these variables were used to develop an alternative procurement model for reducing rework in projects. It is suggested that the proposed model could be used to stimulate interorganizational relations and promote teambuilding during the formative stages of a project, which is essential for reducing design-related reworking