Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey

Wireless sensor networks (WSNs) consist of autonomous and resource-limited devices. The devices cooperate to monitor one or more physical phenomena within an area of interest. WSNs operate as stochastic systems because of randomness in the monitored environments. For long service time and low maintenance cost, WSNs require adaptive and robust methods to address data exchange, topology formulation, resource and power optimization, sensing coverage and object detection, and security challenges. In these problems, sensor nodes are to make optimized decisions from a set of accessible strategies to achieve design goals. This survey reviews numerous applications of the Markov decision process (MDP) framework, a powerful decision-making tool to develop adaptive algorithms and protocols for WSNs. Furthermore, various solution methods are discussed and compared to serve as a guide for using MDPs in WSNs

Power Optimisation and Relay Selection in Cooperative Wireless Communication Networks

Cooperative communications have emerged as a significant concept to improve reliability and throughput in wireless systems. In cooperative networks, the idea is to implement a scheme in wireless systems where the nodes can harmonize their resources thereby enhancing the network performance in different aspects such as latency, BER and throughput. As cooperation spans from the basic idea of transmit diversity achieved via MIMO techniques and the relay channel, it aims to reap somewhat multiple benefits of combating fading/burst errors, increasing throughput and reducing energy use. Another major benefit of cooperation in wireless networks is that since the concept only requires neighbouring nodes to act as virtual relay antennas, the concept evades the negative impacts of deployment costs of multiple physical antennas for network operators especially in areas where they are difficult to deploy. In cooperative communications energy efficiency and long network lifetimes are very important design issues, the focus in this work is on ad hoc and sensor network varieties where the nodes integrate sensing, processing and communication such that their cooperation capabilities are subject to power optimisation. As cooperation communications leads to trade-offs in Quality of Services and transmit power, the key design issue is power optimisation to dynamically combat channel fluctuations and achieve a net reduction of transmit power with the goal of saving battery life. Recent researches in cooperative communications focus on power optimisation achieved via power control at the PHY layer, and/or scheduling mechanism at the MAC layer. The approach for this work will be to review the power control strategy at the PHY layer, identify their associated trade-offs, and use this as a basis to propose a power control strategy that offers adaptability to channel conditions, the road to novelty in this work is a channel adaptable power control algorithm that jointly optimise power allocation, modulation strategy and relay selection. Thus, a novel relay selection method is developed and implemented to improve the performance of cooperative wireless networks in terms of energy consumption. The relay selection method revolves on selection the node with minimum distance to the source and destination. The design is valid to any wireless network setting especially Ad-hoc and sensor networks where space limitations preclude the implementation of bigger capacity battery. The thesis first investigates the design of relay selection schemes in cooperative networks and the associated protocols. Besides, modulation strategy and error correction code impact on energy consumption are investigated and the optimal solution is proposed and jointly implemented with the relay selection method. The proposed algorithm is extended to cooperative networks in which multiple nodes participate in cooperation in fixed and variable rate system. Thus, multi relay selection algorithm is proposed to improve virtual MIMO performance in terms of energy consumption. Furthermore, motivated by the trend of cell size optimisation in wireless networks, the proposed relay selection method is extended to clustered wireless networks, and jointly implemented with virtual clustering technique. The work will encompass three main stages: First, the cooperative system is designed and two major protocols Decode and Forward (DF) and amplify and forward (AF) are investigated. Second, the proposed algorithm is modelled and tested under different channel conditions with emphasis on its performance using different modulation strategies for different cooperative wireless networks. Finally, the performance of the proposed algorithm is illustrated and verified via computer simulations. Simulation results show that the distance based relay selection algorithm exhibits an improved performance in terms of energy consumption compared to the conventional cooperative schemes under different cooperative communication scenarios

Generalized Area Spectral Efficiency: An Effective Performance Metric for Green Wireless Communications

Area spectral efficiency (ASE) was introduced as a metric to quantify the spectral utilization efficiency of cellular systems. Unlike other performance metrics, ASE takes into account the spatial property of cellular systems. In this paper, we generalize the concept of ASE to study arbitrary wireless transmissions. Specifically, we introduce the notion of affected area to characterize the spatial property of arbitrary wireless transmissions. Based on the definition of affected area, we define the performance metric, generalized area spectral efficiency (GASE), to quantify the spatial spectral utilization efficiency as well as the greenness of wireless transmissions. After illustrating its evaluation for point-to-point transmission, we analyze the GASE performance of several different transmission scenarios, including dual-hop relay transmission, three-node cooperative relay transmission and underlay cognitive radio transmission. We derive closed-form expressions for the GASE metric of each transmission scenario under Rayleigh fading environment whenever possible. Through mathematical analysis and numerical examples, we show that the GASE metric provides a new perspective on the design and optimization of wireless transmissions, especially on the transmitting power selection. We also show that introducing relay nodes can greatly improve the spatial utilization efficiency of wireless systems. We illustrate that the GASE metric can help optimize the deployment of underlay cognitive radio systems.Comment: 11 pages, 8 figures, accepted by TCo

Green Cellular Networks: A Survey, Some Research Issues and Challenges

Energy efficiency in cellular networks is a growing concern for cellular operators to not only maintain profitability, but also to reduce the overall environment effects. This emerging trend of achieving energy efficiency in cellular networks is motivating the standardization authorities and network operators to continuously explore future technologies in order to bring improvements in the entire network infrastructure. In this article, we present a brief survey of methods to improve the power efficiency of cellular networks, explore some research issues and challenges and suggest some techniques to enable an energy efficient or "green" cellular network. Since base stations consume a maximum portion of the total energy used in a cellular system, we will first provide a comprehensive survey on techniques to obtain energy savings in base stations. Next, we discuss how heterogeneous network deployment based on micro, pico and femto-cells can be used to achieve this goal. Since cognitive radio and cooperative relaying are undisputed future technologies in this regard, we propose a research vision to make these technologies more energy efficient. Lastly, we explore some broader perspectives in realizing a "green" cellular network technologyComment: 16 pages, 5 figures, 2 table

On the Energy Efficiency of LT Codes in Proactive Wireless Sensor Networks

This paper presents an in-depth analysis on the energy efficiency of Luby Transform (LT) codes with Frequency Shift Keying (FSK) modulation in a Wireless Sensor Network (WSN) over Rayleigh fading channels with pathloss. We describe a proactive system model according to a flexible duty-cycling mechanism utilized in practical sensor apparatus. The present analysis is based on realistic parameters including the effect of channel bandwidth used in the IEEE 802.15.4 standard, active mode duration and computation energy. A comprehensive analysis, supported by some simulation studies on the probability mass function of the LT code rate and coding gain, shows that among uncoded FSK and various classical channel coding schemes, the optimized LT coded FSK is the most energy-efficient scheme for distance d greater than the pre-determined threshold level d_T , where the optimization is performed over coding and modulation parameters. In addition, although the optimized uncoded FSK outperforms coded schemes for d < d_T , the energy gap between LT coded and uncoded FSK is negligible for d < d_T compared to the other coded schemes. These results come from the flexibility of the LT code to adjust its rate to suit instantaneous channel conditions, and suggest that LT codes are beneficial in practical low-power WSNs with dynamic position sensor nodes.Comment: accepted for publication in IEEE Transactions on Signal Processin

Distributed Detection and Estimation in Wireless Sensor Networks

In this article we consider the problems of distributed detection and estimation in wireless sensor networks. In the first part, we provide a general framework aimed to show how an efficient design of a sensor network requires a joint organization of in-network processing and communication. Then, we recall the basic features of consensus algorithm, which is a basic tool to reach globally optimal decisions through a distributed approach. The main part of the paper starts addressing the distributed estimation problem. We show first an entirely decentralized approach, where observations and estimations are performed without the intervention of a fusion center. Then, we consider the case where the estimation is performed at a fusion center, showing how to allocate quantization bits and transmit powers in the links between the nodes and the fusion center, in order to accommodate the requirement on the maximum estimation variance, under a constraint on the global transmit power. We extend the approach to the detection problem. Also in this case, we consider the distributed approach, where every node can achieve a globally optimal decision, and the case where the decision is taken at a central node. In the latter case, we show how to allocate coding bits and transmit power in order to maximize the detection probability, under constraints on the false alarm rate and the global transmit power. Then, we generalize consensus algorithms illustrating a distributed procedure that converges to the projection of the observation vector onto a signal subspace. We then address the issue of energy consumption in sensor networks, thus showing how to optimize the network topology in order to minimize the energy necessary to achieve a global consensus. Finally, we address the problem of matching the topology of the network to the graph describing the statistical dependencies among the observed variables.Comment: 92 pages, 24 figures. To appear in E-Reference Signal Processing, R. Chellapa and S. Theodoridis, Eds., Elsevier, 201