Applications of Repeated Games in Wireless Networks: A Survey

A repeated game is an effective tool to model interactions and conflicts for players aiming to achieve their objectives in a long-term basis. Contrary to static noncooperative games that model an interaction among players in only one period, in repeated games, interactions of players repeat for multiple periods; and thus the players become aware of other players' past behaviors and their future benefits, and will adapt their behavior accordingly. In wireless networks, conflicts among wireless nodes can lead to selfish behaviors, resulting in poor network performances and detrimental individual payoffs. In this paper, we survey the applications of repeated games in different wireless networks. The main goal is to demonstrate the use of repeated games to encourage wireless nodes to cooperate, thereby improving network performances and avoiding network disruption due to selfish behaviors. Furthermore, various problems in wireless networks and variations of repeated game models together with the corresponding solutions are discussed in this survey. Finally, we outline some open issues and future research directions.Comment: 32 pages, 15 figures, 5 tables, 168 reference

After-sales services optimisation through dynamic opportunistic maintenance: a wind energy case study

After-sales maintenance services can be a very profitable source of incomes for original equipment manufacturers (OEM) due to the increasing interest of assets’ users on performance-based contracts. However, when it concerns the product value-adding process, OEM have traditionally been more focused on improving their production processes, rather than on complementing their products by offering after-sales services; consequently leading to difficulties in offering them efficiently. Furthermore, both due to the high uncertainty of the assets’ behaviour and the inherent challenges of managing the maintenance process (e.g. maintenance strategy to be followed or resources to be deployed), it is complex to make business out of the provision of after-sales services. With the aim of helping the business and maintenance decision makers at this point, this paper proposes a framework for optimising the incomes of after-sales maintenance services through: 1) implementing advanced multi-objective opportunistic maintenance strategies that sistematically consider the assets’ operational context in order to perform preventive maintenance during most favourable conditions, 2) considering the specific OEMs’ and users’ needs, and 3) assessing both internal and external uncertainties that might condition the after-sales services’ success. The developed case study for the wind energy sector demonstrates the suitability of the presented framework for optimising the after-sales services.EU Framework Programme Horizon 2020, MSCA-RISE-2014: Marie Skłodowska-Curie Research and Innovation Staff Exchange (RISE) (grant agreement number 645733- Sustain-Owner-H2020-MSCA-RISE-2014) and the EmaitekPlus 2016-2017 Program of the Basque Government

Transmit without regrets: Online optimization in MIMO-OFDM cognitive radio systems

In this paper, we examine cognitive radio systems that evolve dynamically over time due to changing user and environmental conditions. To combine the advantages of orthogonal frequency division multiplexing (OFDM) and multiple-input, multiple-output (MIMO) technologies, we consider a MIMO-OFDM cognitive radio network where wireless users with multiple antennas communicate over several non-interfering frequency bands. As the network's primary users (PUs) come and go in the system, the communication environment changes constantly (and, in many cases, randomly). Accordingly, the network's unlicensed, secondary users (SUs) must adapt their transmit profiles "on the fly" in order to maximize their data rate in a rapidly evolving environment over which they have no control. In this dynamic setting, static solution concepts (such as Nash equilibrium) are no longer relevant, so we focus on dynamic transmit policies that lead to no regret: specifically, we consider policies that perform at least as well as (and typically outperform) even the best fixed transmit profile in hindsight. Drawing on the method of matrix exponential learning and online mirror descent techniques, we derive a no-regret transmit policy for the system's SUs which relies only on local channel state information (CSI). Using this method, the system's SUs are able to track their individually evolving optimum transmit profiles remarkably well, even under rapidly (and randomly) changing conditions. Importantly, the proposed augmented exponential learning (AXL) policy leads to no regret even if the SUs' channel measurements are subject to arbitrarily large observation errors (the imperfect CSI case), thus ensuring the method's robustness in the presence of uncertainties.Comment: 25 pages, 3 figures, to appear in the IEEE Journal on Selected Areas in Communication

Wireless Powered Cooperative Relaying using NOMA with Imperfect CSI

The impact of imperfect channel state (CSI) information in an energy harvesting (EH) cooperative non-orthogonal multiple access (NOMA) network, consisting of a source, two users, and an EH relay is investigated in this paper. The relay is not equipped with a fixed power source and acts as a wireless powered node to help signal transmission to the users. Closed-form expressions for the outage probability of both users are derived under imperfect CSI for two different power allocation strategies namely fixed and dynamic power allocation. Monte Carlo simulations are used to numerically evaluate the effect of imperfect CSI. These results confirm the theoretical outage analysis and show that NOMA can outperform orthogonal multiple access even with imperfect CSI.Comment: 6 pages, 6 figures, accepted in IEEE GLOBECOM 2018 NOMA Worksho

Adaptive Power Allocation and Control in Time-Varying Multi-Carrier MIMO Networks

In this paper, we examine the fundamental trade-off between radiated power and achieved throughput in wireless multi-carrier, multiple-input and multiple-output (MIMO) systems that vary with time in an unpredictable fashion (e.g. due to changes in the wireless medium or the users' QoS requirements). Contrary to the static/stationary channel regime, there is no optimal power allocation profile to target (either static or in the mean), so the system's users must adapt to changes in the environment "on the fly", without being able to predict the system's evolution ahead of time. In this dynamic context, we formulate the users' power/throughput trade-off as an online optimization problem and we provide a matrix exponential learning algorithm that leads to no regret - i.e. the proposed transmit policy is asymptotically optimal in hindsight, irrespective of how the system evolves over time. Furthermore, we also examine the robustness of the proposed algorithm under imperfect channel state information (CSI) and we show that it retains its regret minimization properties under very mild conditions on the measurement noise statistics. As a result, users are able to track the evolution of their individually optimum transmit profiles remarkably well, even under rapidly changing network conditions and high uncertainty. Our theoretical analysis is validated by extensive numerical simulations corresponding to a realistic network deployment and providing further insights in the practical implementation aspects of the proposed algorithm.Comment: 25 pages, 4 figure