Empirically assessing algorithm performance

Abstract

The timing performance data of ten related algorithms (solving the single keyword pattern matching problem) executing under a wide variety of operating conditions, was gathered and analysed. Using the resulting 15 million items of timing data, various metrics to estimate algorithm performance were computed and compared. An assessment is made of whether and how various changes in the operating environment affect the measurements