Joint Channel Selection and Power Control in Infrastructureless Wireless Networks: A Multi-Player Multi-Armed Bandit Framework

This paper deals with the problem of efficient resource allocation in dynamic infrastructureless wireless networks. Assuming a reactive interference-limited scenario, each transmitter is allowed to select one frequency channel (from a common pool) together with a power level at each transmission trial; hence, for all transmitters, not only the fading gain, but also the number of interfering transmissions and their transmit powers are varying over time. Due to the absence of a central controller and time-varying network characteristics, it is highly inefficient for transmitters to acquire global channel and network knowledge. Therefore a reasonable assumption is that transmitters have no knowledge of fading gains, interference, and network topology. Each transmitting node selfishly aims at maximizing its average reward (or minimizing its average cost), which is a function of the action of that specific transmitter as well as those of all other transmitters. This scenario is modeled as a multi-player multi-armed adversarial bandit game, in which multiple players receive an a priori unknown reward with an arbitrarily time-varying distribution by sequentially pulling an arm, selected from a known and finite set of arms. Since players do not know the arm with the highest average reward in advance, they attempt to minimize their so-called regret, determined by the set of players' actions, while attempting to achieve equilibrium in some sense. To this end, we design in this paper two joint power level and channel selection strategies. We prove that the gap between the average reward achieved by our approaches and that based on the best fixed strategy converges to zero asymptotically. Moreover, the empirical joint frequencies of the game converge to the set of correlated equilibria. We further characterize this set for two special cases of our designed game

Agent-Based Computational Economics: A Constructive Approach to Economic Theory

This chapter explores the potential advantages and disadvantages of Agent-based Computational Economics (ACE) for the study of economic systems. General points are concretely illustrated using an ACE model of a two-sector decentralized market economy. Six issues are highlighted: Constructive understanding of production, pricing, and trade processes; the essential primacy of survival; strategic rivalry and market power; behavioral uncertainty and learning; the role of conventions and organizations; and the complex interactions among structural attributes, behaviors, and institutional arrangements. Extensive annotated pointers to ACE surveys, research, course materials, and software can be accessed here: http://www.econ.iastate.edu/tesfatsi/ace.htmagent-based computational economics; Learning; network formation; decentralized market economy

Channel Selection for Network-assisted D2D Communication via No-Regret Bandit Learning with Calibrated Forecasting

We consider the distributed channel selection problem in the context of device-to-device (D2D) communication as an underlay to a cellular network. Underlaid D2D users communicate directly by utilizing the cellular spectrum but their decisions are not governed by any centralized controller. Selfish D2D users that compete for access to the resources construct a distributed system, where the transmission performance depends on channel availability and quality. This information, however, is difficult to acquire. Moreover, the adverse effects of D2D users on cellular transmissions should be minimized. In order to overcome these limitations, we propose a network-assisted distributed channel selection approach in which D2D users are only allowed to use vacant cellular channels. This scenario is modeled as a multi-player multi-armed bandit game with side information, for which a distributed algorithmic solution is proposed. The solution is a combination of no-regret learning and calibrated forecasting, and can be applied to a broad class of multi-player stochastic learning problems, in addition to the formulated channel selection problem. Analytically, it is established that this approach not only yields vanishing regret (in comparison to the global optimal solution), but also guarantees that the empirical joint frequencies of the game converge to the set of correlated equilibria.Comment: 31 pages (one column), 9 figure

Agent-Based Computational Modeling And Macroeconomics

Agent-based Computational Economics (ACE) is the computational study of economic processes modeled as dynamic systems of interacting agents. This essay discusses the potential use of ACE modeling tools for the study of macroeconomic systems. Points are illustrated using an ACE model of a two-sector decentralized market economy. Related work can be accessed here: http://www.econ.iastate.edu/tesfatsi/amulmark.htmagent-based computational economics

Bringing Macroeconomics into the Lab.

This paper reviews experiments in macroeconomics, pointing out the theoretical justifications, the strengths and weaknesses of this approach. We identify two broad classes of experiments: general equilibrium and partial equilibrium experiments, and emphasize the idea of theory testing that is behind these. A large number of macroeconomic issues have been analyzed in the laboratory spanning from monetary economics to fiscal policy, from international trade and finance, to growth and macroeconomic imperfections. In a large number of cases results give support to the theories tested. We also highlight that experimental macroeconomics has increased the number of tools available to experimentalists.Macroeconomics; experiments