RepFlow: Minimizing Flow Completion Times with Replicated Flows in Data Centers

Short TCP flows that are critical for many interactive applications in data centers are plagued by large flows and head-of-line blocking in switches. Hash-based load balancing schemes such as ECMP aggravate the matter and result in long-tailed flow completion times (FCT). Previous work on reducing FCT usually requires custom switch hardware and/or protocol changes. We propose RepFlow, a simple yet practically effective approach that replicates each short flow to reduce the completion times, without any change to switches or host kernels. With ECMP the original and replicated flows traverse distinct paths with different congestion levels, thereby reducing the probability of having long queueing delay. We develop a simple analytical model to demonstrate the potential improvement of RepFlow. Extensive NS-3 simulations and Mininet implementation show that RepFlow provides 50%--70% speedup in both mean and 99-th percentile FCT for all loads, and offers near-optimal FCT when used with DCTCP.Comment: To appear in IEEE INFOCOM 201

Scheduling Networks of Queues: Heavy Traffic Analysis of a Multistation Closed Network

We consider the problem of finding an optimal dynamic priority sequencing policy to maximize the mean throughput rate in a multistation, multiclass closed queueing network with general service time distributions and a general routing structure. Under balanced heavy loading conditions, this scheduling problem can be approximated by a control problem involving Brownian motion. Although a unique, closed form solution to the Brownian control problem is not derived, an analysis of the problem leads to an effective static sequencing policy, and to an approximate means of comparing the relative performance of arbitrary static policies. Three examples are given that illustrate the effectiveness of our procedure

The effective bandwidth problem revisited

The paper studies a single-server queueing system with autonomous service and $\ell$ priority classes. Arrival and departure processes are governed by marked point processes. There are $\ell$ buffers corresponding to priority classes, and upon arrival a unit of the $k$th priority class occupies a place in the $k$th buffer. Let $N^{(k)}$, $k=1,2,...,\ell$ denote the quota for the total $k$th buffer content. The values $N^{(k)}$ are assumed to be large, and queueing systems both with finite and infinite buffers are studied. In the case of a system with finite buffers, the values $N^{(k)}$ characterize buffer capacities. The paper discusses a circle of problems related to optimization of performance measures associated with overflowing the quota of buffer contents in particular buffers models. Our approach to this problem is new, and the presentation of our results is simple and clear for real applications.Comment: 29 pages, 11pt, Final version, that will be published as is in Stochastic Model

Bulk Scheduling with the DIANA Scheduler

Results from the research and development of a Data Intensive and Network Aware (DIANA) scheduling engine, to be used primarily for data intensive sciences such as physics analysis, are described. In Grid analyses, tasks can involve thousands of computing, data handling, and network resources. The central problem in the scheduling of these resources is the coordinated management of computation and data at multiple locations and not just data replication or movement. However, this can prove to be a rather costly operation and efficient sing can be a challenge if compute and data resources are mapped without considering network costs. We have implemented an adaptive algorithm within the so-called DIANA Scheduler which takes into account data location and size, network performance and computation capability in order to enable efficient global scheduling. DIANA is a performance-aware and economy-guided Meta Scheduler. It iteratively allocates each job to the site that is most likely to produce the best performance as well as optimizing the global queue for any remaining jobs. Therefore it is equally suitable whether a single job is being submitted or bulk scheduling is being performed. Results indicate that considerable performance improvements can be gained by adopting the DIANA scheduling approach.Comment: 12 pages, 11 figures. To be published in the IEEE Transactions in Nuclear Science, IEEE Press. 200

Does Order Negotiation Improve The Job-Shop Workload Control?

Work flows in a job-shop are determined not only by the release load and the time between release factors, but also by the number of accepted orders. There has been extensive research on workload and input-output control aiming at improving the performance of manufacturing operations in job-shops. This paper explores the idea of controlling the workload since the acceptance/rejection of orders stage. A new acceptance/rejection rule is proposed, and tests are conducted to study the sensitivity of job-shop performance to different order acceptance parameters, like the tolerance of the workload limit and the due date extension acceptance. It also evaluates the effect of the negotiation phase of the proposed acceptance rule on the job-shop performance using a simulation model of a generic random job-shop. The extensive simulation experiments allow us to conclude that having a negotiation phase prior to rejection improves almost all workload performance measures. We also conclude that different tolerances of the workload limit affect slightly the performance of the job-shop.job shop, order negotiation, workload control

Queues with delays in two-state strategies and Lévy input

We consider a reflected Lévy process without negative jumps, starting at the origin. When the reflected process first upcrosses level K, a timer is activated. After D time units, the timer expires and the Lévy exponent of the Lévy process is changed. As soon as the process hits zero again, the Lévy exponent reverses to the original function. If the process has reached the origin before the timer expires then the Lévy exponent does not change. Using martingale techniques, we analyze the steady-state distribution of the resulting process, reflected at the origin. We pay special attention to the cases of deterministic and exponential timers, and to the following three special Lévy processes: (i) a compound Poisson process plus negative drift (corresponding to an M/G/1 queue), (ii) Brownian motion, and (iii) a Lévy process that is a subordinator until the timer expires. © Applied Probability Trust 2008