An empirical performance study for validating a performance analysis approach: PSIM

Abstract

Performance analysis gains more attention in recent years by researchers who focus their study on the early software development stages to mitigate the risk of redesign as problems emerge later. Previously we proposed PSIM (a Performance SImulation and Modeling tool) that integrated performance properties into software architecture specifications expressed in several major UML diagrams. PSIM models can be transformed into Colored GSPN (Colored Generalized Stochastic Petri Nets). As a result, the Colored GSPN models can be simulated to perform model-based performance evaluation. In this paper we briefly review the PSIM approach and apply it to model a web-based electronic conferencing system, called M-Net, to derive performance metrics. We then conduct runtime performance testing to the implementation of M-Net and compare the simulation data to runtime testing data. The comparison results show the effectiveness of the PSIM method in predicting system performance and identifying system performance bottlenecks.This is a manuscript of a proceeding published as Jinchun Xia, Yujia Ge and C. K. Chang, "An empirical performance study for validating a performance analysis approach: PSIM," 29th Annual International Computer Software and Applications Conference (COMPSAC'05), 2005, pp. 307-312 Vol. 2, doi: 10.1109/COMPSAC.2005.43. Posted with permission. © 2005 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other work