Dynamic Multi-Arm Bandit Game Based Multi-Agents Spectrum Sharing Strategy Design

For a wireless avionics communication system, a Multi-arm bandit game is mathematically formulated, which includes channel states, strategies, and rewards. The simple case includes only two agents sharing the spectrum which is fully studied in terms of maximizing the cumulative reward over a finite time horizon. An Upper Confidence Bound (UCB) algorithm is used to achieve the optimal solutions for the stochastic Multi-Arm Bandit (MAB) problem. Also, the MAB problem can also be solved from the Markov game framework perspective. Meanwhile, Thompson Sampling (TS) is also used as benchmark to evaluate the proposed approach performance. Numerical results are also provided regarding minimizing the expectation of the regret and choosing the best parameter for the upper confidence bound

Game-theoretic infrastructure sharing in multioperator cellular networks

©2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.The introduction of fourth-generation wireless technologies has fueled the rapid development of cellular networks, significantly increasing the energy consumption and the expenditures of mobile network operators (MNOs). In addition, network underutilization during low-traffic periods (e.g., night zone) has motivated a new business model, namely, infrastructure sharing, which allows the MNOs to have their traffic served by other MNOs in the same geographic area, thus enabling them to switch off part of their network. In this paper, we propose a novel infrastructure-sharing algorithm for multioperator environments, which enables the deactivation of underutilized base stations during low-traffic periods. Motivated by the conflicting interests of the MNOs and the necessity for effective solutions, we introduce a game-theoretic framework that enables the MNOs to individually estimate the switching-off probabilities that reduce their expected financial cost. Our approach reaches dominant strategy equilibrium, which is the strategy that minimizes the cost of each player. Finally, we provide extensive analytical and experimental results to estimate the potential energy and cost savings that can be achieved in multioperator environments, incentivizing the MNOs to apply the proposed scheme.Peer ReviewedPostprint (author's final draft