Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey

Wireless sensor networks (WSNs) consist of autonomous and resource-limited devices. The devices cooperate to monitor one or more physical phenomena within an area of interest. WSNs operate as stochastic systems because of randomness in the monitored environments. For long service time and low maintenance cost, WSNs require adaptive and robust methods to address data exchange, topology formulation, resource and power optimization, sensing coverage and object detection, and security challenges. In these problems, sensor nodes are to make optimized decisions from a set of accessible strategies to achieve design goals. This survey reviews numerous applications of the Markov decision process (MDP) framework, a powerful decision-making tool to develop adaptive algorithms and protocols for WSNs. Furthermore, various solution methods are discussed and compared to serve as a guide for using MDPs in WSNs

Deploying Dense Networks for Maximal Energy Efficiency: Small Cells Meet Massive MIMO

How would a cellular network designed for maximal energy efficiency look like? To answer this fundamental question, tools from stochastic geometry are used in this paper to model future cellular networks and obtain a new lower bound on the average uplink spectral efficiency. This enables us to formulate a tractable uplink energy efficiency (EE) maximization problem and solve it analytically with respect to the density of base stations (BSs), the transmit power levels, the number of BS antennas and users per cell, and the pilot reuse factor. The closed-form expressions obtained from this general EE maximization framework provide valuable insights on the interplay between the optimization variables, hardware characteristics, and propagation environment. Small cells are proved to give high EE, but the EE improvement saturates quickly with the BS density. Interestingly, the maximal EE is achieved by also equipping the BSs with multiple antennas and operate in a "massive MIMO" fashion, where the array gain from coherent detection mitigates interference and the multiplexing of many users reduces the energy cost per user.Comment: To appear in IEEE Journal on Selected Areas in Communications, 15 pages, 7 figures, 1 tabl

5G Ultra-dense networks with non-uniform Distributed Users

User distribution in ultra-dense networks (UDNs) plays a crucial role in affecting the performance of UDNs due to the essential coupling between the traffic and the service provided by the networks. Existing studies are mostly based on the assumption that users are uniformly distributed in space. The non-uniform user distribution has not been widely considered despite that it is much closer to the real scenario. In this paper, Radiation and Absorbing model (R&A model) is first adopted to analyze the impact of the non-uniformly distributed users on the performance of 5G UDNs. Based on the R&A model and queueing network theory, the stationary user density in each hot area is investigated. Furthermore, the coverage probability, network throughput and energy efficiency are derived based on the proposed theoretical model. Compared with the uniformly distributed assumption, it is shown that non-uniform user distribution has a significant impact on the performance of UDNs.Comment: 14 pages, 10 figure

Spatial spectrum and energy efficiency of random cellular networks

It is a great challenge to evaluate the network performance of cellular mobile communication systems. In this paper, we propose new spatial spectrum and energy efficiency models for Poisson-Voronoi tessellation (PVT) random cellular networks. To evaluate the user access the network, a Markov chain based wireless channel access model is first proposed for PVT random cellular networks. On that basis, the outage probability and blocking probability of PVT random cellular networks are derived, which can be computed numerically. Furthermore, taking into account the call arrival rate, the path loss exponent and the base station (BS) density in random cellular networks, spatial spectrum and energy efficiency models are proposed and analyzed for PVT random cellular networks. Numerical simulations are conducted to evaluate the network spectrum and energy efficiency in PVT random cellular networks.Comment: appears in IEEE Transactions on Communications, April, 201