Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey

Wireless sensor networks (WSNs) consist of autonomous and resource-limited devices. The devices cooperate to monitor one or more physical phenomena within an area of interest. WSNs operate as stochastic systems because of randomness in the monitored environments. For long service time and low maintenance cost, WSNs require adaptive and robust methods to address data exchange, topology formulation, resource and power optimization, sensing coverage and object detection, and security challenges. In these problems, sensor nodes are to make optimized decisions from a set of accessible strategies to achieve design goals. This survey reviews numerous applications of the Markov decision process (MDP) framework, a powerful decision-making tool to develop adaptive algorithms and protocols for WSNs. Furthermore, various solution methods are discussed and compared to serve as a guide for using MDPs in WSNs

Applications of Repeated Games in Wireless Networks: A Survey

A repeated game is an effective tool to model interactions and conflicts for players aiming to achieve their objectives in a long-term basis. Contrary to static noncooperative games that model an interaction among players in only one period, in repeated games, interactions of players repeat for multiple periods; and thus the players become aware of other players' past behaviors and their future benefits, and will adapt their behavior accordingly. In wireless networks, conflicts among wireless nodes can lead to selfish behaviors, resulting in poor network performances and detrimental individual payoffs. In this paper, we survey the applications of repeated games in different wireless networks. The main goal is to demonstrate the use of repeated games to encourage wireless nodes to cooperate, thereby improving network performances and avoiding network disruption due to selfish behaviors. Furthermore, various problems in wireless networks and variations of repeated game models together with the corresponding solutions are discussed in this survey. Finally, we outline some open issues and future research directions.Comment: 32 pages, 15 figures, 5 tables, 168 reference

Future RAN architecture: SD-RAN through a general-purpose processing platform

In this article, we identify and study the potential of an integrated deployment solution for energy-efficient cellular networks combining the strengths of two very active current research themes: 1) software-defined radio access networks (SD-RANs) and 2) decoupled signaling and data transmissions, or beyond cellular green generation (BCG2) architecture, for enhanced energy efficiency. While SD-RAN envisions a decoupled centralized control plane and data-forwarding plane for flexible control, the BCG2 architecture calls for decoupling coverage from the capacity and coverage provided through an always-on low-power signaling node for a larger geographical area; the capacity is catered by various on-demand data nodes for maximum energy efficiency. In this article, we show that a combined approach that brings both specifications together can not only achieve greater benefits but also facilitate faster realization of both technologies. We propose the idea and design of a signaling controller that acts as a signaling node to provide always-on coverage, consuming low power, and at the same time host the control plane functions for the SDRAN through a general-purpose processing platform. The phantom cell concept is also a similar idea where a normal macrocell provides interference control to densely deployed small cells, although our initial results show that the integrated architecture has a much greater potential for energy savings than phantom cells