The effect of workload dependence in systems: Experimental evaluation, analytic models, and policy development

This dissertation presents an analysis of performance effects of burstiness (formalized by the autocorrelation function) in multi-tiered systems via a 3-pronged approach, i.e., experimental measurements, analytic models, and policy development. This analysis considers (a) systems with finite buffers (e.g., systems with admission control that effectively operate as closed systems) and (b) systems with infinite buffers (i.e., systems that operate as open systems).;For multi-tiered systems with a finite buffer size, experimental measurements show that if autocorrelation exists in any of the tiers in a multi-tiered system, then autocorrelation propagates to all tiers of the system. The presence of autocorrelated flows in all tiers significantly degrades performance. Workload characterization in a real experimental environment driven by the TPC-W benchmark confirms the existence of autocorrelated flows, which originate from the autocorrelated service process of one of the tiers. A simple model is devised that captures the observed behavior. The model is in excellent agreement with experimental measurements and captures the propagation of autocorrelation in the multi-tiered system as well as the resulting performance trends.;For systems with an infinite buffer size, this study focuses on analytic models by proposing and comparing two families of approximations for the departure process of a BMAP/MAP/1 queue that admits batch correlated flows, and whose service time process may be autocorrelated. One approximation is based on the ETAQA methodology for the solution of M/G/1-type processes and the other arises from lumpability rules. Formal proofs are provided: both approximations preserve the marginal distribution of the inter-departure times and their initial correlation structures.;This dissertation also demonstrates how the knowledge of autocorrelation can be used to effectively improve system performance, D_EQAL, a new load balancing policy for clusters with dependent arrivals is proposed. D_EQAL separates jobs to servers according to their sizes as traditional load balancing policies do, but this separation is biased by the effort to reduce performance loss due to autocorrelation in the streams of jobs that are directed to each server. as a result of this, not all servers are equally utilized (i.e., the load in the system becomes unbalanced) but performance benefits of this load unbalancing are significant

PAARGAMAN: Passenger Demand Provoked (On-The-Fly) Routing Of Intelligent Public Transport Vehicle with Dynamic Route Updation, Generation, and Suggestion

Demand-based public bus service meets the need of passengers with less money, time, and resources by reducing the number of private vehicles on the road. In contrast, dynamic real-time demand-based routing faces challenges like elevated travel time due to the requested assignment based on the paths and vehicle availability. Hence, this research introduces a novel framework named Passenger Influence Bus Service-Intelligent Public Transport System (PIBS-IPTS) for efficient routing of available vehicles based on the demand of passengers. For this, optimal paths are elected from the known routes of the general vehicle through the Cuckoo Search (CS) optimization algorithm. Then efficient route prediction is employed by the Artificial Neural Network (ANN) for passenger flow. Here, the unavailability of the passenger request, such as source location or Destination locations, or the unavailability of both locations is updated while employing the path generation process. The path generation process ensures the reduction of request drops generated by the passenger, which elevates the usage of the general bus service. Here, for the optimal selection of routes from the identified routing paths, a multi-objective function based on traffic density, route condition, and route mobility is employed for the selection of a near-optimal global solution. The method’s performance is analyzed using MAE, RMSE, and MAPE and obtained the best values of 0.69, 0.72, and 0.74, respectively

Analysis of a discrete-time single-server queue with an occasional extra server

We consider a discrete-time queueing system having two distinct servers: one server, the "regular" server, is permanently available, while the second server, referred to as the "extra" server, is only allocated to the system intermittently. Apart from their availability, the two servers are identical, in the sense that the customers have deterministic service times equal to 1 fixed-length time slot each, regardless of the server that processes them. In this paper, we assume that the extra server is available during random "up-periods", whereas it is unavailable during random "down-periods". Up-periods and down-periods occur alternately on the time axis. The up-periods have geometrically distributed lengths (expressed in time slots), whereas the distribution of the lengths of the down-periods is general, at least in the first instance. Customers enter the system according to a general independent arrival process, i.e., the numbers of arrivals during consecutive time slots are i.i.d. random variables with arbitrary distribution. For this queueing model, we are able to derive closed-form expressions for the steady-state probability generating functions (pgfs) and the expected values of the numbers of customers in the system at various observation epochs, such as the start of an up-period, the start of a down-period and the beginning of an arbitrary time slot. At first sight, these formulas, however, appear to contain an infinite number of unknown constants. One major issue of the mathematical analysis turns out to be the determination of these constants. In the paper, we show that restricting the pgf of the down-periods to be a rational function of its argument, brings about the crucial simplification that the original infinite number of unknown constants appearing in the formulas can be expressed in terms of a finite number of independent unknowns. The latter can then be adequately determined based on the bounded nature of pgfs inside the complex unit disk, and an extensive use of properties of polynomials. Various special cases, both from the perspective of the arrival distribution and the down-period distribution, are discussed. The results are also illustrated by means of relevant numerical examples. Possible applications of this type of queueing model are numerous: the extra server could be the regular server of another similar queue, helping whenever an idle period occurs in its own queue; a geometric distribution for these idle times is then a very natural modeling assumption. A typical example would be the situation at the check-in counter at a gate in an airport: the regular server serves customers with a low-fare ticket, while the extra server gives priority to the business-class and first-class customers, but helps checking regular customers, whenever the priority line is empty. (C) 2017 Elsevier B.V. All rights reserved

A Non-Markovian Multistage Batch Arrival Queue with Breakdown and Reneging

The present investigation deals with analysis of non-Markovian queueing model with multistage of services. When the server is unavailable during the system breakdown (or) vacation periods, we consider reneging to prevail. Supplementary variable techniques have been adopted to obtain steady state system length distributions. The numerical illustrations are provided to validate the tractability of performance measures as far as computational aspect is concerned. Numerical results in the form of graphical representation are also presented. Practical large scale industry applications are described to justify our model

Performance analysis of priority queueing systems in discrete time

The integration of different types of traffic in packet-based networks spawns the need for traffic differentiation. In this tutorial paper, we present some analytical techniques to tackle discrete-time queueing systems with priority scheduling. We investigate both preemptive (resume and repeat) and non-preemptive priority scheduling disciplines. Two classes of traffic are considered, high-priority and low-priority traffic, which both generate variable-length packets. A probability generating functions approach leads to performance measures such as moments of system contents and packet delays of both classes