Moment Matching-Based Distribution Fitting with Generalized Hyper-Erlang Distributions

This paper describes a novel moment matching based fitting method for phase-type (PH) distributions. A special sub-class of phase-type distributions is introduced for the fitting, called generalized hyper-Erlang distributions. The user has to provide only two parameters: the number of moments to match, and the upper bound for the sum of the multiplicities of the eigenvalues of the distribution, which is related to the maximal size of the resulting PH distribution. Given these two parameters, our method obtains all PH distributions that match the target moments and have a Markovian representation up to the given size. From this set of PH distributions the best one can be selected according to any distance function

A fast EM algorithm for fitting marked Markovian arrival processes with a new special structure

This paper presents an EM algorithm for fitting traces with Markovian arrival processes (MAPs). The proposed algorithm operates on a special subclass of MAPs. This special structure enables the efficient implementation of the EM algorithm; it is more orders of magnitudes faster than methods operating on the general MAP class while providing similar or better likelihood values. An other important feature of the algorithm is that it is able to fit multi-class traces with marked Markovian arrival processes as well. Several numerical examples demonstrate the efficiency of the procedure

Markovian Workload Characterization for QoS Prediction in the Cloud.

Resource allocation in the cloud is usually driven by performance predictions, such as estimates of the future incoming load to the servers or of the quality-of-service (QoS) offered by applications to end users. In this context, characterizing web workload fluctuations in an accurate way is fundamental to understand how to provision cloud resources under time-varying traffic intensities. In this paper, we investigate the Markovian Arrival Processes (MAP) and the related MAP/MAP/1 queueing model as a tool for performance prediction of servers deployed in the cloud. MAPs are a special class of Markov models used as a compact description of the time-varying characteristics of workloads. In addition, MAPs can fit heavy-tail distributions, that are common in HTTP traffic, and can be easily integrated within analytical queueing models to efficiently predict system performance without simulating. By comparison with trace-driven simulation, we observe that existing techniques for MAP parameterization from HTTP log files often lead to inaccurate performance predictions. We then define a maximum likelihood method for fitting MAP parameters based on data commonly available in Apache log files, and a new technique to cope with batch arrivals, which are notoriously difficult to model accurately. Numerical experiments demonstrate the accuracy of our approach for performance prediction of web systems. © 2011 IEEE

Matching marginal moments and lag autocorrelations with MAPs

This paper presents a procedure that constructs a Markovian Arrival Process (MAP) based on the mean, the squared coefficient of variation and the lag-1 autocorrelation of the inter-arrival times. This method always provides a valid MAP without posing any restrictions on the three input parameters. Besides matching these three parameters, it is possible to match the third moment of the inter-arrival times and the decay of the autocorrelation function as well, if they fall into the given (very wide) bounds