Performance evaluation of computer systems

N/

Model-driven performance evaluation for service engineering

Service engineering and service-oriented architecture as an integration and platform technology is a recent approach to software systems integration. Software quality aspects such as performance are of central importance for the integration of heterogeneous, distributed service-based systems. Empirical performance evaluation is a process of measuring and calculating performance metrics of the implemented software. We present an approach for the empirical, model-based performance evaluation of services and service compositions in the context of model-driven service engineering. Temporal databases theory is utilised for the empirical performance evaluation of model-driven developed service systems

The role of Criticism in the Dynamics of Performance Evaluation Systems

Drawing on the concept of « trial », developed by French sociologists, this article analyzes the dynamics of employees’ performance evaluation systems, particularly those involving accounting performance measures. A case study is presented as an illustration of our proposal to consider these systems as one of the major trials in the business world, that is, social arrangements organizing the testing of people and resulting in ordering them, and further in consistent social goods allocation. This analysis emphasizes the role of criticism in the dynamics and evolution of performance evaluation systems and enables us to revisit concepts like controllability or objectivity which have been presented for decades as cornerstones of performance evaluation systems either in management control or in human resource management fields.Criticism; performance evaluation systems; fairness; objectivity; controllability; legitimacy; bonus

An hierarchical approach to performance evaluation of expert systems

The number and size of expert systems is growing rapidly. Formal evaluation of these systems - which is not performed for many systems - increases the acceptability by the user community and hence their success. Hierarchical evaluation that had been conducted for computer systems is applied for expert system performance evaluation. Expert systems are also evaluated by treating them as software systems (or programs). This paper reports many of the basic concepts and ideas in the Performance Evaluation of Expert Systems Study being conducted at the University of Southwestern Louisiana

Critical considerations on defining and measuring performance in public organizations

Performance evaluation plays a central role in improving public service quality and increasing efficiency and accountability in the public sector. New Public Management recommends performance evaluation as a tool for rationalizing public budgeting, promoting better reporting systems and developing internal diagnosis systems. This paper aims to analyze the characteristics of performance evaluation and to highlight its influences in public organizations. The study is based on review and analysis of academic research, government documents and personal perspectives. The paper argues that managerial practices and tools for defining and evaluating performance can be used for cultivating the “achievement culture” in public sector organizations.Public management, performance, evaluation, indicators

Automating the mean-field method for large dynamic gossip networks

We investigate an abstraction method, called mean- field method, for the performance evaluation of dynamic net- works with pairwise communication between nodes. It allows us to evaluate systems with very large numbers of nodes, that is, systems of a size where traditional performance evaluation methods fall short.\ud While the mean-field analysis is well-established in epidemics and for chemical reaction systems, it is rarely used for commu- nication networks because a mean-field model tends to abstract away the underlying topology.\ud To represent topological information, however, we extend the mean-field analysis with the concept of classes of states. At the abstraction level of classes we define the network topology by means of connectivity between nodes. This enables us to encode physical node positions and model dynamic networks by allowing nodes to change their class membership whenever they make a local state transition. Based on these extensions, we derive and implement algorithms for automating a mean-field based performance evaluation