Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey

Wireless sensor networks (WSNs) consist of autonomous and resource-limited devices. The devices cooperate to monitor one or more physical phenomena within an area of interest. WSNs operate as stochastic systems because of randomness in the monitored environments. For long service time and low maintenance cost, WSNs require adaptive and robust methods to address data exchange, topology formulation, resource and power optimization, sensing coverage and object detection, and security challenges. In these problems, sensor nodes are to make optimized decisions from a set of accessible strategies to achieve design goals. This survey reviews numerous applications of the Markov decision process (MDP) framework, a powerful decision-making tool to develop adaptive algorithms and protocols for WSNs. Furthermore, various solution methods are discussed and compared to serve as a guide for using MDPs in WSNs

Information exchange in randomly deployed dense WSNs with wireless energy harvesting capabilities

©2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.As large-scale dense and often randomly deployed wireless sensor networks (WSNs) become widespread, local information exchange between colocated sets of nodes may play a significant role in handling the excessive traffic volume. Moreover, to account for the limited life-span of the wireless devices, harvesting the energy of the network transmissions provides significant benefits to the lifetime of such networks. In this paper, we study the performance of communication in dense networks with wireless energy harvesting (WEH)-enabled sensor nodes. In particular, we examine two different communication scenarios (direct and cooperative) for data exchange and we provide theoretical expressions for the probability of successful communication. Then, considering the importance of lifetime in WSNs, we employ state-of-the-art WEH techniques and realistic energy converters, quantifying the potential energy gains that can be achieved in the network. Our analytical derivations, which are validated by extensive Monte-Carlo simulations, highlight the importance of WEH in dense networks and identify the tradeoffs between the direct and cooperative communication scenarios.Peer ReviewedPostprint (author's final draft

RF-Powered Cognitive Radio Networks: Technical Challenges and Limitations

The increasing demand for spectral and energy efficient communication networks has spurred a great interest in energy harvesting (EH) cognitive radio networks (CRNs). Such a revolutionary technology represents a paradigm shift in the development of wireless networks, as it can simultaneously enable the efficient use of the available spectrum and the exploitation of radio frequency (RF) energy in order to reduce the reliance on traditional energy sources. This is mainly triggered by the recent advancements in microelectronics that puts forward RF energy harvesting as a plausible technique in the near future. On the other hand, it is suggested that the operation of a network relying on harvested energy needs to be redesigned to allow the network to reliably function in the long term. To this end, the aim of this survey paper is to provide a comprehensive overview of the recent development and the challenges regarding the operation of CRNs powered by RF energy. In addition, the potential open issues that might be considered for the future research are also discussed in this paper.Comment: 8 pages, 2 figures, 1 table, Accepted in IEEE Communications Magazin

Energy harvesting over Rician fading channel: A performance analysis for half-duplex bidirectional sensor networks under hardware impairments

In this paper, a rigorous analysis of the performance of time-switching energy harvesting strategy that is applied for a half-duplex bidirectional wireless sensor network with intermediate relay over a Rician fading channel is presented to provide the exact-form expressions of the outage probability, achievable throughput and the symbol-error-rate (SER) of the system under the hardware impairment condition. Using the proposed probabilistic models for wireless channels between mobile nodes as well as for the hardware noises, we derive the outage probability of the system, and then the throughput and SER can be obtained as a result. Both exact analysis and asymptotic analysis at high signal-power-to-noise-ratio regime are provided. Monte Carlo simulation is also conducted to verify the analysis. This work confirms the effectiveness of energy harvesting applied in wireless sensor networks over a Rician fading channel, and can provide an insightful understanding about the effect of various parameters on the system performance.Web of Science186art. no. 1781

Resource Allocation in Wireless Networks with RF Energy Harvesting and Transfer

Radio frequency (RF) energy harvesting and transfer techniques have recently become alternative methods to power the next generation of wireless networks. As this emerging technology enables proactive replenishment of wireless devices, it is advantageous in supporting applications with quality-of-service (QoS) requirement. This article focuses on the resource allocation issues in wireless networks with RF energy harvesting capability, referred to as RF energy harvesting networks (RF-EHNs). First, we present an overview of the RF-EHNs, followed by a review of a variety of issues regarding resource allocation. Then, we present a case study of designing in the receiver operation policy, which is of paramount importance in the RF-EHNs. We focus on QoS support and service differentiation, which have not been addressed by previous literatures. Furthermore, we outline some open research directions.Comment: To appear in IEEE Networ

Energy-Efficient NOMA Enabled Heterogeneous Cloud Radio Access Networks

Heterogeneous cloud radio access networks (H-CRANs) are envisioned to be promising in the fifth generation (5G) wireless networks. H-CRANs enable users to enjoy diverse services with high energy efficiency, high spectral efficiency, and low-cost operation, which are achieved by using cloud computing and virtualization techniques. However, H-CRANs face many technical challenges due to massive user connectivity, increasingly severe spectrum scarcity and energy-constrained devices. These challenges may significantly decrease the quality of service of users if not properly tackled. Non-orthogonal multiple access (NOMA) schemes exploit non-orthogonal resources to provide services for multiple users and are receiving increasing attention for their potential of improving spectral and energy efficiency in 5G networks. In this article a framework for energy-efficient NOMA H-CRANs is presented. The enabling technologies for NOMA H-CRANs are surveyed. Challenges to implement these technologies and open issues are discussed. This article also presents the performance evaluation on energy efficiency of H-CRANs with NOMA.Comment: This work has been accepted by IEEE Network. Pages 18, Figure

Multi-source in DF cooperative networks with the PSR protocol based full-duplex energy harvesting over a Rayleigh fading channel: performance analysis

Due to the tremendous energy consumption growth with ever-increasing connected devices, alternative wireless information and power transfer techniques are important not only for theoretical research but also for saving operational costs and for a sustainable growth of wireless communications. In this paper, we investigate the multi-source in decode-and-forward cooperative networks with the power splitting protocol based full-duplex energy harvesting relaying network over a Rayleigh fading channel. In this system model, the multi-source and the destination communicate with each other by both the direct link and an intermediate helping relay. First, we investigate source selection for the best system performance. Then, the closed-form expression of the outage probability and the symbol error ratio are derived. Finally, the Monte Carlo simulation is used for validating the analytical expressions in connection with all main possible system parameters. The research results show that the analytical and simulation results matched well with each other.Web of Science68327526