Stochastic Differential Games and Energy-Efficient Power Control

One of the contributions of this work is to formulate the problem of energy-efficient power control in multiple access channels (namely, channels which comprise several transmitters and one receiver) as a stochastic differential game. The players are the transmitters who adapt their power level to the quality of their time-varying link with the receiver, their battery level, and the strategy updates of the others. The proposed model not only allows one to take into account long-term strategic interactions but also long-term energy constraints. A simple sufficient condition for the existence of a Nash equilibrium in this game is provided and shown to be verified in a typical scenario. As the uniqueness and determination of equilibria are difficult issues in general, especially when the number of players goes large, we move to two special cases: the single player case which gives us some useful insights of practical interest and allows one to make connections with the case of large number of players. The latter case is treated with a mean-field game approach for which reasonable sufficient conditions for convergence and uniqueness are provided. Remarkably, this recent approach for large system analysis shows how scalability can be dealt with in large games and only relies on the individual state information assumption.Comment: The final publication is available at http://www.springerlink.com/openurl.asp?genre=article\&id=doi:10.1007/s13235-012-0068-

Mean Field Energy Games in Wireless Networks

This work tackles the problem of energy-efficient distributed power control in wireless networks with a large number of transmitters. The problem is modeled by a dynamic game. Each transmitter-receiver communication is characterized by a state given by the available energy and/or the individual channel state and whose evolution is governed by certain dynamics. Since equilibrium analysis in such a (stochastic) game is generally difficult and even impossible, the problem is approximated by exploiting the large system assumption. Under an appropriate exchangeability assumption, the corresponding mean field game is well defined and studied in detail for special cases. The main contribution of this work is to show how mean field games can be applied to the problem under investigation and provide illustrative numerical results. Our results indicate that this approach can lead to significant gains in terms of energy-efficiency at the resulting equilibrium.Comment: IEEE Proc. of Asilomar Conf. on Signals, Systems, and Computers, Nov. 2012, Pacific Grove, CA, US

A mean-field game economic growth model

Here, we examine a mean-field game (MFG) that models the economic growth of a population of non-cooperative rational agents. In this MFG, agents are described by two state variables - the capital and consumer goods they own. Each agent seeks to maximize their utility by taking into account statistical data of the total population. The individual actions drive the evolution of the players, and a market-clearing condition determines the relative price of capital and consumer goods. We study the existence and uniqueness of optimal strategies of the agents and develop numerical methods to compute these strategies and the equilibrium price

Compressive Channel Estimation and Multi-user Detection in C-RAN

This paper considers the channel estimation (CE) and multi-user detection (MUD) problems in cloud radio access network (C-RAN). Assuming that active users are sparse in the network, we solve CE and MUD problems with compressed sensing (CS) technology to greatly reduce the long identification pilot overhead. A mixed L{2,1}-regularization functional for extended sparse group-sparsity recovery is proposed to exploit the inherently sparse property existing both in user activities and remote radio heads (RRHs) that active users are attached to. Empirical and theoretical guidelines are provided to help choosing tuning parameters which have critical effect on the performance of the penalty functional. To speed up the processing procedure, based on alternating direction method of multipliers and variable splitting strategy, an efficient algorithm is formulated which is guaranteed to be convergent. Numerical results are provided to illustrate the effectiveness of the proposed functional and efficient algorithm.Comment: 6 pages, 3 figure

Ultra Dense Small Cell Networks: Turning Density into Energy Efficiency

In this paper, a novel approach for joint power control and user scheduling is proposed for optimizing energy efficiency (EE), in terms of bits per unit energy, in ultra dense small cell networks (UDNs). Due to severe coupling in interference, this problem is formulated as a dynamic stochastic game (DSG) between small cell base stations (SBSs). This game enables to capture the dynamics of both the queues and channel states of the system. To solve this game, assuming a large homogeneous UDN deployment, the problem is cast as a mean-field game (MFG) in which the MFG equilibrium is analyzed with the aid of low-complexity tractable partial differential equations. Exploiting the stochastic nature of the problem, user scheduling is formulated as a stochastic optimization problem and solved using the drift plus penalty (DPP) approach in the framework of Lyapunov optimization. Remarkably, it is shown that by weaving notions from Lyapunov optimization and mean-field theory, the proposed solution yields an equilibrium control policy per SBS which maximizes the network utility while ensuring users' quality-of-service. Simulation results show that the proposed approach achieves up to 70.7% gains in EE and 99.5% reductions in the network's outage probabilities compared to a baseline model which focuses on improving EE while attempting to satisfy the users' instantaneous quality-of-service requirements.Comment: 15 pages, 21 figures (sub-figures are counted separately), IEEE Journal on Selected Areas in Communications - Series on Green Communications and Networking (Issue 2

Théorie des jeux et apprentissage pour les réseaux sans fil distribués

Dans cette thèse, nous étudions des réseaux sans fil dans lesquels les terminaux mobiles sont autonomes dans le choix de leurs configurations de communication. Cette autonomie de décision peut notamment concerner le choix de la technologie d'accès au réseau, le choix du point d'accès, la modulation du signal, les bandes de fréquences occupées, la puissance du signal émis, etc. Typiquement, ces choix de configuration sont réalisés dans le but de maximiser des métriques de performances propres à chaque terminal. Sous l'hypothèse que les terminaux prennent leurs décisions de manière rationnelle afin de maximiser leurs performances, la théorie des jeux s'applique naturellement pour modéliser les interactions entre les décisions des différents terminaux. Plus précisément, l'objectif principal de cette thèse est d'étudier des stratégies d'équilibre de contrôle de puissance d'émission afin de satisfaire des considérations d'efficacité énergétique. Le cadre des jeux stochastiques est particulièrement adapté à ce problème et nous permet notamment de caractériser la région de performance atteignable pour toutes les stratégies de contrôle de puissance qui mènent à un état d'équilibre. Lorsque le nombre de terminaux en jeu est grand, nous faisons appel à la théorie des jeux à champ moyen pour simplifier l'étude du système. Cette théorie nous permet d'étudier non pas les interactions individuelles entre les terminaux, mais l'interaction de chaque terminal avec un champ moyen qui représente l'état global des autres terminaux. Des stratégies de contrôle de puissance optimales du jeu à champ moyen sont étudiées. Une autre partie de la thèse a été consacrée à des problématiques d'apprentissage de points d'équilibre dans les réseaux distribués. En particulier, après avoir caractérisé les positions d'équilibre d'un jeu de positionnement de points d'accès, nous montrons comment des dynamiques de meilleures réponses et d'apprentissage permettent de converger vers un équilibre. Enfin, pour un jeu de contrôle de puissance, la convergence des dynamiques de meilleures réponses vers des points d'équilibre a été étudiée. Il est notamment proposé un algorithme d'adaptation de puissance convergeant vers un équilibre avec une faible connaissance du réseau.In this thesis, we study wireless networks in which mobile terminals are free to choose their communication configuration. Theses configuration choices include access wireless technology, access point association, coding-modulation scheme, occupied bandwidth, power allocation, etc. Typically, these configuration choices are made to maximize some performance metrics associated to every terminals. Under the assumption that mobile terminals take their decisions in a rational manner, game theory can be applied to model the interactions between the terminals. Precisely, the main objective of this thesis is to study energy-efficient power control policies from which no terminal has an interest to deviate. The framework of stochastic games is particularly suited to this problem and allows to characterize the achievable utility region for equilibrium power control strategies. When the number of terminals in the network is large, we invoke mean field game theory to simplify the study of the system. Indeed, in a mean field game, the interactions between a player and all the other players are not considered individually. Instead, one only studies the interactions between each player and a mean field, which is the distribution of the states of all the other players. Optimal power control strategies from the mean field formulation are studied. Another part of this thesis has been focused on learning equilibria in distributed games. In particular, we show how best response dynamics and learning algorithms can converge to an equilibrium in a base station location game. For another scenario, namely a power control problem, we study the convergence of the best response dynamics. In this case, we propose a power control behavioral rule that converges to an equilibrium with very little information about the network.PARIS11-SCD-Bib. électronique (914719901) / SudocSudocFranceF

User-Centric Mobility Management in Ultra-Dense Cellular Networks under Spatio-Temporal Dynamics

Abstract-This article investigates the mobility management of an ultra dense cellular network (UDN) from an energy-efficiency (EE) point of view. Many dormant base stations (BSs) in a UDN do not transmit signals, and thus a received power based handover (HO) approach as in traditional cellular networks is hardly applicable. In addition, the limited front/backhaul capacity compared to a huge number of BSs makes it difficult to implement a centralized HO and power control. For these reasons, a novel user-centric association rule is proposed, which jointly optimizes HO and power control for maximizing EE. The proposed mobility management is able to cope not only with the spatial randomness of user movement but also with temporally correlated wireless channels. The proposed approach is implemented over a HO time window and tractable power control policy by exploiting mean-field game (MFG) and stochastic geometry (SG). Compared to a baseline with a fixed HO interval and transmit power, the proposed approach achieves the 1.2 times higher long-term average EE at a typical active BS. Index Terms-User-centric handover, ultra-dense cellular networks, spatio-temporal network dynamics, power control, energy-efficiency, mean-field game, stochastic geometry I. MOTIVATION AND CONTRIBUTIONS Imagine energy-saving ceiling lights adaptively turn on when walking down a dark corridor. This resembles a cellular network operation where a huge number of base stations (BSs) are deployed [1]- It is then natural to ask how to make energy-efficient cell coverage in such a ultra-dense cellular network (UDN), by adjusting a handover (HO) rule and power control policy. In addition, implementing energy-efficient HO and power control in a distributed manner is its prime task. A centralized control as in traditional cellular networks is hardly applicable due to the limited front/backhaul capacity compared to the number of BSs in a UDN. To resolve these issues, this article proposes a user-centric association rule (see The contributions of this paper are as follows. • User-centric reverse association in a UDN is proposed. • Closed-form EEs are derived under Brownian motion (BM) mobility with temporally correlated fading (Propositions 2 and Corollary 1). • EE optimal power control policy and HO rule are proposed in tractable forms (Propositions 3 and 4). • Mean-field (MF) interference convergence is proved in a UDN under BM mobility (Proposition 1). II. SYSTEM MODEL User Mobility and Network Deployment. Initial user locations y(t) = {y x (t), y y (t)} at time t = 0 follow a homogeneous Poisson point process (PPP) with density λ b . At t > 0, the users move according to a Brownian motion (BM) represented by a stochastic differential equation (SDE) where the standard Wiener process W(t) = {W x (t), W y (t)} for mutually independent W x (t), W y (t) ∼ N (0, t) and v is the mean displacement distance per unit time, interpreted as average velocity. BS locations follow a homogeneous PP

Mean-Field-Type Games in Engineering

A mean-field-type game is a game in which the instantaneous payoffs and/or the state dynamics functions involve not only the state and the action profile but also the joint distributions of state-action pairs. This article presents some engineering applications of mean-field-type games including road traffic networks, multi-level building evacuation, millimeter wave wireless communications, distributed power networks, virus spread over networks, virtual machine resource management in cloud networks, synchronization of oscillators, energy-efficient buildings, online meeting and mobile crowdsensing.Comment: 84 pages, 24 figures, 183 references. to appear in AIMS 201