1,487 research outputs found
Workload reduction of a generalized Brownian network
We consider a dynamic control problem associated with a generalized Brownian
network, the objective being to minimize expected discounted cost over an
infinite planning horizon. In this Brownian control problem (BCP), both the
system manager's control and the associated cumulative cost process may be
locally of unbounded variation. Due to this aspect of the cost process, both
the precise statement of the problem and its analysis involve delicate
technical issues. We show that the BCP is equivalent, in a certain sense, to a
reduced Brownian control problem (RBCP) of lower dimension. The RBCP is a
singular stochastic control problem, in which both the controls and the
cumulative cost process are locally of bounded variation.Comment: Published at http://dx.doi.org/10.1214/105051605000000458 in the
Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute
of Mathematical Statistics (http://www.imstat.org
Correction. Brownian models of open processing networks: canonical representation of workload
Due to a printing error the above mentioned article [Annals of Applied
Probability 10 (2000) 75--103, doi:10.1214/aoap/1019737665] had numerous
equations appearing incorrectly in the print version of this paper. The entire
article follows as it should have appeared. IMS apologizes to the author and
the readers for this error. A recent paper by Harrison and Van Mieghem
explained in general mathematical terms how one forms an ``equivalent workload
formulation'' of a Brownian network model. Denoting by the state vector
of the original Brownian network, one has a lower dimensional state descriptor
in the equivalent workload formulation, where can be chosen as
any basis matrix for a particular linear space. This paper considers Brownian
models for a very general class of open processing networks, and in that
context develops a more extensive interpretation of the equivalent workload
formulation, thus extending earlier work by Laws on alternate routing problems.
A linear program called the static planning problem is introduced to articulate
the notion of ``heavy traffic'' for a general open network, and the dual of
that linear program is used to define a canonical choice of the basis matrix
. To be specific, rows of the canonical are alternative basic optimal
solutions of the dual linear program. If the network data satisfy a natural
monotonicity condition, the canonical matrix is shown to be nonnegative,
and another natural condition is identified which ensures that admits a
factorization related to the notion of resource pooling.Comment: Published at http://dx.doi.org/10.1214/105051606000000583 in the
Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute
of Mathematical Statistics (http://www.imstat.org
State space collapse and diffusion approximation for a network operating under a fair bandwidth sharing policy
We consider a connection-level model of Internet congestion control,
introduced by Massouli\'{e} and Roberts [Telecommunication Systems 15 (2000)
185--201], that represents the randomly varying number of flows present in a
network. Here, bandwidth is shared fairly among elastic document transfers
according to a weighted -fair bandwidth sharing policy introduced by Mo
and Walrand [IEEE/ACM Transactions on Networking 8 (2000) 556--567] []. Assuming Poisson arrivals and exponentially distributed document
sizes, we focus on the heavy traffic regime in which the average load placed on
each resource is approximately equal to its capacity. A fluid model (or
functional law of large numbers approximation) for this stochastic model was
derived and analyzed in a prior work [Ann. Appl. Probab. 14 (2004) 1055--1083]
by two of the authors. Here, we use the long-time behavior of the solutions of
the fluid model established in that paper to derive a property called
multiplicative state space collapse, which, loosely speaking, shows that in
diffusion scale, the flow count process for the stochastic model can be
approximately recovered as a continuous lifting of the workload process.Comment: Published in at http://dx.doi.org/10.1214/08-AAP591 the Annals of
Applied Probability (http://www.imstat.org/aap/) by the Institute of
Mathematical Statistics (http://www.imstat.org
Sample path large deviations for multiclass feedforward queueing networks in critical loading
We consider multiclass feedforward queueing networks with first in first out
and priority service disciplines at the nodes, and class dependent
deterministic routing between nodes. The random behavior of the network is
constructed from cumulative arrival and service time processes which are
assumed to satisfy an appropriate sample path large deviation principle. We
establish logarithmic asymptotics of large deviations for waiting time, idle
time, queue length, departure and sojourn-time processes in critical loading.
This transfers similar results from Puhalskii about single class queueing
networks with feedback to multiclass feedforward queueing networks, and
complements diffusion approximation results from Peterson. An example with
renewal inter arrival and service time processes yields the rate function of a
reflected Brownian motion. The model directly captures stationary situations.Comment: Published at http://dx.doi.org/10.1214/105051606000000439 in the
Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute
of Mathematical Statistics (http://www.imstat.org
Asymptotic optimality of maximum pressure policies in stochastic processing networks
We consider a class of stochastic processing networks. Assume that the
networks satisfy a complete resource pooling condition. We prove that each
maximum pressure policy asymptotically minimizes the workload process in a
stochastic processing network in heavy traffic. We also show that, under each
quadratic holding cost structure, there is a maximum pressure policy that
asymptotically minimizes the holding cost. A key to the optimality proofs is to
prove a state space collapse result and a heavy traffic limit theorem for the
network processes under a maximum pressure policy. We extend a framework of
Bramson [Queueing Systems Theory Appl. 30 (1998) 89--148] and Williams
[Queueing Systems Theory Appl. 30 (1998b) 5--25] from the multiclass queueing
network setting to the stochastic processing network setting to prove the state
space collapse result and the heavy traffic limit theorem. The extension can be
adapted to other studies of stochastic processing networks.Comment: Published in at http://dx.doi.org/10.1214/08-AAP522 the Annals of
Applied Probability (http://www.imstat.org/aap/) by the Institute of
Mathematical Statistics (http://www.imstat.org
- …