Software–Practice and Experience

1 Introduction Benchmarking is an important technique for assessing the performance of persistent object systems, whether existing or proposed. Conceptually, a benchmark consists of two elements: the structure of the persistent data, and the behavior of an application accessing and manipulating the data. The process of using a benchmark to assess a particular persistent object system involves executing or simulating the behavior of the application while collecting data reflecting its performance

A Framework for Storage Management Evaluation in Persistent Object Systems

With the advent of object oriented database management systems, the need to evaluate and improve the performance of these systems has led to research in the area of system benchmarking. One traditional approach has been to implement an application using a particular database management system and incorporate methods in the application to perform analysis and experimentation on functions of the system, such as storage management. In this paper, we present another approach to performance evaluation. We describe PTFF, a common trace file format, and Tragedy, a trace generation tool. The advantages of our approach include: Applications can be modeled independent of any database management language or system. The instrumentation necessary to perform experimentation and analysis of storage management is transparent to the application layer. The trace event files only have to be generated once and can be used for several experiments. The development of applications for system benchmar..