2 research outputs found
Learning-aided Stochastic Network Optimization with Imperfect State Prediction
We investigate the problem of stochastic network optimization in the presence
of imperfect state prediction and non-stationarity. Based on a novel
distribution-accuracy curve prediction model, we develop the predictive
learning-aided control (PLC) algorithm, which jointly utilizes historic and
predicted network state information for decision making. PLC is an online
algorithm that requires zero a-prior system statistical information, and
consists of three key components, namely sequential distribution estimation and
change detection, dual learning, and online queue-based control.
Specifically, we show that PLC simultaneously achieves good long-term
performance, short-term queue size reduction, accurate change detection, and
fast algorithm convergence. In particular, for stationary networks, PLC
achieves a near-optimal , utility-delay
tradeoff. For non-stationary networks, \plc{} obtains an
utility-backlog tradeoff for distributions that last
time, where
is the prediction accuracy and is a constant (the
Backpressue algorithm \cite{neelynowbook} requires an length
for the same utility performance with a larger backlog). Moreover, PLC detects
distribution change slots faster with high probability ( is the
prediction size) and achieves an convergence time. Our results demonstrate
that state prediction (even imperfect) can help (i) achieve faster detection
and convergence, and (ii) obtain better utility-delay tradeoffs
Timely-Throughput Optimal Scheduling with Prediction
Motivated by the increasing importance of providing delay-guaranteed services
in general computing and communication systems, and the recent wide adoption of
learning and prediction in network control, in this work, we consider a general
stochastic single-server multi-user system and investigate the fundamental
benefit of predictive scheduling in improving timely-throughput, being the rate
of packets that are delivered to destinations before their deadlines. By
adopting an error rate-based prediction model, we first derive a Markov
decision process (MDP) solution to optimize the timely-throughput objective
subject to an average resource consumption constraint. Based on a packet-level
decomposition of the MDP, we explicitly characterize the optimal scheduling
policy and rigorously quantify the timely-throughput improvement due to
predictive-service, which scales as
,
where are constants, is the
true-positive rate in prediction, is the false-negative rate, is the
packet deadline and is the prediction window size. We also conduct
extensive simulations to validate our theoretical findings. Our results provide
novel insights into how prediction and system parameters impact performance and
provide useful guidelines for designing predictive low-latency control
algorithms.Comment: 14 pages, 7 figure