Reinforcement learning for resource allocation in LEO satellite networks

Published versio

A New CAC Policy Based on Traffic Characterization in Cellular Networks

The Call Admission Control (CAC) method presented in this paper is based on the statistical properties of the network’s traffic variables. It probabilistically estimates the time until the release of a seized channel: the admission control depends on the computed mean remaining time averaged along all channels at a specific instant and on a time threshold. The policy produces a smooth transition between the QoS metrics, giving the operator the freedom to design the network at the desired QoS point. Another valuable property is that the algorithm is straightforward and fed only by simple teletraffic metrics: distribution and the first and second moments of Channel Holding Time (CHT). Simplicity is important for a CAC method because decisions for accepting or rejecting calls must be computed quickly and frequently.Peer Reviewe

QoS-aware adaptive call admission control in multiuser OFDM wireless network.

Yu, Xi.Thesis (M.Phil.)--Chinese University of Hong Kong, 2008.Includes bibliographical references (leaves 46-49).Abstracts in English and Chinese.Acknowledgement --- p.iAbstract --- p.iiChapter Chapter 1 --- Introduction and Background --- p.1Chapter 1.1 --- Background --- p.3Chapter 1.1.1 --- Brief Review of CAC --- p.3Chapter 1.1.2 --- Dynamic Sub-carrier Allocation in Multi-user OFDM Wireless Network --- p.6Chapter 1.2 --- Problem Statement --- p.11Chapter 1.3 --- The Organization of The Thesis --- p.12Chapter Chapter2 --- System Model and Call Admission Control Framework --- p.13Chapter 2.1 --- System setup --- p.13Chapter 2.2 --- The CAC Strategy Framework --- p.14Chapter Chapter 3 --- QoS-aware Adaptive Call Admission Control´ؤStep One: The QoS-Provisioning CAC --- p.18Chapter 3.1 --- Problem Formulation --- p.19Chapter 3.2 --- Optimal Condition Analysis --- p.21Chapter 3.3 --- Throughput Estimation Algorithm --- p.22Chapter 3.4 --- QoS-Provisioning CAC --- p.25Chapter 3.5 --- Performance Evaluation --- p.26Chapter Chapter 4 --- QoS-aware Adaptive Call Admission Control´ؤStep Two: Average Revenue Maximization CAC --- p.30Chapter 4.1 --- Semi-Markov Decision Process --- p.30Chapter 4.2 --- Investigation of Algorithms for SMDP --- p.34Chapter 4.3 --- The Average Revenue Maximum CAC --- p.37Chapter 4.4 --- Performance Evaluation --- p.40Chapter Chapter 5 --- Conclusion and Future Work --- p.44Bibliography --- p.4