Applications of Repeated Games in Wireless Networks: A Survey

A repeated game is an effective tool to model interactions and conflicts for players aiming to achieve their objectives in a long-term basis. Contrary to static noncooperative games that model an interaction among players in only one period, in repeated games, interactions of players repeat for multiple periods; and thus the players become aware of other players' past behaviors and their future benefits, and will adapt their behavior accordingly. In wireless networks, conflicts among wireless nodes can lead to selfish behaviors, resulting in poor network performances and detrimental individual payoffs. In this paper, we survey the applications of repeated games in different wireless networks. The main goal is to demonstrate the use of repeated games to encourage wireless nodes to cooperate, thereby improving network performances and avoiding network disruption due to selfish behaviors. Furthermore, various problems in wireless networks and variations of repeated game models together with the corresponding solutions are discussed in this survey. Finally, we outline some open issues and future research directions.Comment: 32 pages, 15 figures, 5 tables, 168 reference

Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks

Future wireless networks have a substantial potential in terms of supporting a broad range of complex compelling applications both in military and civilian fields, where the users are able to enjoy high-rate, low-latency, low-cost and reliable information services. Achieving this ambitious goal requires new radio techniques for adaptive learning and intelligent decision making because of the complex heterogeneous nature of the network structures and wireless services. Machine learning (ML) algorithms have great success in supporting big data analytics, efficient parameter estimation and interactive decision making. Hence, in this article, we review the thirty-year history of ML by elaborating on supervised learning, unsupervised learning, reinforcement learning and deep learning. Furthermore, we investigate their employment in the compelling applications of wireless networks, including heterogeneous networks (HetNets), cognitive radios (CR), Internet of things (IoT), machine to machine networks (M2M), and so on. This article aims for assisting the readers in clarifying the motivation and methodology of the various ML algorithms, so as to invoke them for hitherto unexplored services as well as scenarios of future wireless networks.Comment: 46 pages, 22 fig

Radio Communications

In the last decades the restless evolution of information and communication technologies (ICT) brought to a deep transformation of our habits. The growth of the Internet and the advances in hardware and software implementations modified our way to communicate and to share information. In this book, an overview of the major issues faced today by researchers in the field of radio communications is given through 35 high quality chapters written by specialists working in universities and research centers all over the world. Various aspects will be deeply discussed: channel modeling, beamforming, multiple antennas, cooperative networks, opportunistic scheduling, advanced admission control, handover management, systems performance assessment, routing issues in mobility conditions, localization, web security. Advanced techniques for the radio resource management will be discussed both in single and multiple radio technologies; either in infrastructure, mesh or ad hoc networks

Spectrum sharing systems for improving spectral efficiency in cognitive cellular network

Since spectrum is the invisible infrastructure that powers the wireless communication, the demand has been exceptionally increasing in recent years after the implementation of 4G and immense data requirements of 5G due to the applications, such as Internet-of-Things (IoT). Therefore, the effective optimization of the use of spectrum is immediately needed than ever before. The spectrum sensing is the prerequisite for optimal resource allocation in cognitive radio networks (CRN). Therefore, the spectrum sensing in wireless system with lower latency requirements is proposed first. In such systems with high spatial density of the base stations and users/objects, spectrum sharing enables spectrum reuse across very small regions. The proposed method in this Thesis is a multi-channel cooperative spectrum sensing technique, in which an independent network of sensors, namely, spectrum monitoring network, detects the spectrum availability. The locally aggregated decision in each zone associated with the zone aggregator (ZA) location is then passed to a decision fusion centre (DFC). The secondary base station (SBS) accordingly allocates the available channels to secondary users to maximize the spectral efficiency. The function of the DFC is formulated as an optimization problem with the objective of maximizing the spectral efficiency. The optimal detection threshold is obtained for different cases with various spatial densities of ZAs and SBSs. It is further shown that the proposed method reduces the spectrum sensing latency and results in a higher spectrum efficiency. Furthermore, a novel power allocation scheme for multicell CRN is proposed where the subchannel power allocation is performed by incorporating network-wide primary system communication activity. A collaborative subchannel monitoring scheme is proposed to evaluate the aggregated subchannel activity index (ASAI) to indicate the activity levels of primary users. Two utility functions are then defined to characterize the spectral efficiency (SE) and energy efficiency (EE) as a function of ASAI to formulate a utility maximization problem. The optimal transmit power allocation is then obtained with the objective of maximizing the total utility at the SBS, subject to maximum SBS transmit power and collision probability constraint at the primary receivers. Since optimal EE and SE are two contradicting objectives to obtain the transmit power allocation, the design approach to handle both EE and SE as a function of common network parameter, i.e., ASAI, is provided which ultimately proves the quantitative insights on efficient system design. Extensive simulation results confirm the analytical results and indicate a significant improvement in sensing latency and accuracy and a significant gain against the benchmark models on the rate performance, despite the proposed methods perform with lower signalling overhead

Cognitive Radio Systems

Cognitive radio is a hot research area for future wireless communications in the recent years. In order to increase the spectrum utilization, cognitive radio makes it possible for unlicensed users to access the spectrum unoccupied by licensed users. Cognitive radio let the equipments more intelligent to communicate with each other in a spectrum-aware manner and provide a new approach for the co-existence of multiple wireless systems. The goal of this book is to provide highlights of the current research topics in the field of cognitive radio systems. The book consists of 17 chapters, addressing various problems in cognitive radio systems

Spectrum sharing systems for improving spectral efficiency in cognitive cellular network

Since spectrum is the invisible infrastructure that powers the wireless communication, the demand has been exceptionally increasing in recent years after the implementation of 4G and immense data requirements of 5G due to the applications, such as Internet-of-Things (IoT). Therefore, the effective optimization of the use of spectrum is immediately needed than ever before. The spectrum sensing is the prerequisite for optimal resource allocation in cognitive radio networks (CRN). Therefore, the spectrum sensing in wireless system with lower latency requirements is proposed first. In such systems with high spatial density of the base stations and users/objects, spectrum sharing enables spectrum reuse across very small regions. The proposed method in this Thesis is a multi-channel cooperative spectrum sensing technique, in which an independent network of sensors, namely, spectrum monitoring network, detects the spectrum availability. The locally aggregated decision in each zone associated with the zone aggregator (ZA) location is then passed to a decision fusion centre (DFC). The secondary base station (SBS) accordingly allocates the available channels to secondary users to maximize the spectral efficiency. The function of the DFC is formulated as an optimization problem with the objective of maximizing the spectral efficiency. The optimal detection threshold is obtained for different cases with various spatial densities of ZAs and SBSs. It is further shown that the proposed method reduces the spectrum sensing latency and results in a higher spectrum efficiency. Furthermore, a novel power allocation scheme for multicell CRN is proposed where the subchannel power allocation is performed by incorporating network-wide primary system communication activity. A collaborative subchannel monitoring scheme is proposed to evaluate the aggregated subchannel activity index (ASAI) to indicate the activity levels of primary users. Two utility functions are then defined to characterize the spectral efficiency (SE) and energy efficiency (EE) as a function of ASAI to formulate a utility maximization problem. The optimal transmit power allocation is then obtained with the objective of maximizing the total utility at the SBS, subject to maximum SBS transmit power and collision probability constraint at the primary receivers. Since optimal EE and SE are two contradicting objectives to obtain the transmit power allocation, the design approach to handle both EE and SE as a function of common network parameter, i.e., ASAI, is provided which ultimately proves the quantitative insights on efficient system design. Extensive simulation results confirm the analytical results and indicate a significant improvement in sensing latency and accuracy and a significant gain against the benchmark models on the rate performance, despite the proposed methods perform with lower signalling overhead

Modelling, Dimensioning and Optimization of 5G Communication Networks, Resources and Services

This reprint aims to collect state-of-the-art research contributions that address challenges in the emerging 5G networks design, dimensioning and optimization. Designing, dimensioning and optimization of communication networks resources and services have been an inseparable part of telecom network development. The latter must convey a large volume of traffic, providing service to traffic streams with highly differentiated requirements in terms of bit-rate and service time, required quality of service and quality of experience parameters. Such a communication infrastructure presents many important challenges, such as the study of necessary multi-layer cooperation, new protocols, performance evaluation of different network parts, low layer network design, network management and security issues, and new technologies in general, which will be discussed in this book

Learning for Cross-layer Resource Allocation in the Framework of Cognitive Wireless Networks

The framework of cognitive wireless networks is expected to endow wireless devices with a cognition-intelligence ability with which they can efficiently learn and respond to the dynamic wireless environment. In this dissertation, we focus on the problem of developing cognitive network control mechanisms without knowing in advance an accurate network model. We study a series of cross-layer resource allocation problems in cognitive wireless networks. Based on model-free learning, optimization and game theory, we propose a framework of self-organized, adaptive strategy learning for wireless devices to (implicitly) build the understanding of the network dynamics through trial-and-error. The work of this dissertation is divided into three parts. In the first part, we investigate a distributed, single-agent decision-making problem for real-time video streaming over a time-varying wireless channel between a single pair of transmitter and receiver. By modeling the joint source-channel resource allocation process for video streaming as a constrained Markov decision process, we propose a reinforcement learning scheme to search for the optimal transmission policy without the need to know in advance the details of network dynamics. In the second part of this work, we extend our study from the single-agent to a multi-agent decision-making scenario, and study the energy-efficient power allocation problems in a two-tier, underlay heterogeneous network and in a self-sustainable green network. For the heterogeneous network, we propose a stochastic learning algorithm based on repeated games to allow individual macro- or femto-users to find a Stackelberg equilibrium without flooding the network with local action information. For the self-sustainable green network, we propose a combinatorial auction mechanism that allows mobile stations to adaptively choose the optimal base station and sub-carrier group for transmission only from local payoff and transmission strategy information. In the third part of this work, we study a cross-layer routing problem in an interweaved Cognitive Radio Network (CRN), where an accurate network model is not available and the secondary users that are distributed within the CRN only have access to local action/utility information. In order to develop a spectrum-aware routing mechanism that is robust against potential insider attackers, we model the uncoordinated interaction between CRN nodes in the dynamic wireless environment as a stochastic game. Through decomposition of the stochastic routing game, we propose two stochastic learning algorithm based on a group of repeated stage games for the secondary users to learn the best-response strategies without the need of information flooding