Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey

Wireless sensor networks (WSNs) consist of autonomous and resource-limited devices. The devices cooperate to monitor one or more physical phenomena within an area of interest. WSNs operate as stochastic systems because of randomness in the monitored environments. For long service time and low maintenance cost, WSNs require adaptive and robust methods to address data exchange, topology formulation, resource and power optimization, sensing coverage and object detection, and security challenges. In these problems, sensor nodes are to make optimized decisions from a set of accessible strategies to achieve design goals. This survey reviews numerous applications of the Markov decision process (MDP) framework, a powerful decision-making tool to develop adaptive algorithms and protocols for WSNs. Furthermore, various solution methods are discussed and compared to serve as a guide for using MDPs in WSNs

On the Performance of Multiple Antenna Cooperative Spectrum Sharing Protocol under Nakagami-m Fading

In a cooperative spectrum sharing (CSS) protocol, two wireless systems operate over the same frequency band albeit with different priorities. The secondary (or cognitive) system which has a lower priority, helps the higher priority primary system to achieve its target rate by acting as a relay and allocating a fraction of its power to forward the primary signal. The secondary system in return is benefited by transmitting its own data on primary system's spectrum. In this paper, we have analyzed the performance of multiple antenna cooperative spectrum sharing protocol under Nakagami-m Fading. Closed form expressions for outage probability have been obtained by varying the parameters m and Omega of the Nakagami-m fading channels. Apart from above, we have shown the impact of power allocation factor (alpha) and parameter m on the region of secondary spectrum access, conventionally defined as critical radius for the secondary system. A comparison between theoretical and simulated results is also presented to corroborate the theoretical results obtained in this paperComment: Accepted in the proceedings of IEEE PIMRC 2015 Hong Kong, Chin

Impact of Mobility on MIMO Green Wireless Systems

This paper studies the impact of mobility on the power consumption of wireless networks. With increasing mobility, we show that the network should dedicate a non negligible fraction of the useful rate to estimate the different degrees of freedom. In order to keep the rate constant, we quantify the increase of power required for several cases of interest. In the case of a point to point MIMO link, we calculate the minimum transmit power required for a target rate and outage probability as a function of the coherence time and the number of antennas. Interestingly, the results show that there is an optimal number of antennas to be used for a given coherence time and power consumption. This provides a lower bound limit on the minimum power required for maintaining a green network.Comment: Accepted for EUSIPCO conference. 5 page