Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey

Wireless sensor networks (WSNs) consist of autonomous and resource-limited devices. The devices cooperate to monitor one or more physical phenomena within an area of interest. WSNs operate as stochastic systems because of randomness in the monitored environments. For long service time and low maintenance cost, WSNs require adaptive and robust methods to address data exchange, topology formulation, resource and power optimization, sensing coverage and object detection, and security challenges. In these problems, sensor nodes are to make optimized decisions from a set of accessible strategies to achieve design goals. This survey reviews numerous applications of the Markov decision process (MDP) framework, a powerful decision-making tool to develop adaptive algorithms and protocols for WSNs. Furthermore, various solution methods are discussed and compared to serve as a guide for using MDPs in WSNs

Coordinated Dynamic Spectrum Management of LTE-U and Wi-Fi Networks

This paper investigates the co-existence of Wi-Fi and LTE in emerging unlicensed frequency bands which are intended to accommodate multiple radio access technologies. Wi-Fi and LTE are the two most prominent access technologies being deployed today, motivating further study of the inter-system interference arising in such shared spectrum scenarios as well as possible techniques for enabling improved co-existence. An analytical model for evaluating the baseline performance of co-existing Wi-Fi and LTE is developed and used to obtain baseline performance measures. The results show that both Wi-Fi and LTE networks cause significant interference to each other and that the degradation is dependent on a number of factors such as power levels and physical topology. The model-based results are partially validated via experimental evaluations using USRP based SDR platforms on the ORBIT testbed. Further, inter-network coordination with logically centralized radio resource management across Wi-Fi and LTE systems is proposed as a possible solution for improved co-existence. Numerical results are presented showing significant gains in both Wi-Fi and LTE performance with the proposed inter-network coordination approach.Comment: Accepted paper at IEEE DySPAN 201