Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey

Wireless sensor networks (WSNs) consist of autonomous and resource-limited devices. The devices cooperate to monitor one or more physical phenomena within an area of interest. WSNs operate as stochastic systems because of randomness in the monitored environments. For long service time and low maintenance cost, WSNs require adaptive and robust methods to address data exchange, topology formulation, resource and power optimization, sensing coverage and object detection, and security challenges. In these problems, sensor nodes are to make optimized decisions from a set of accessible strategies to achieve design goals. This survey reviews numerous applications of the Markov decision process (MDP) framework, a powerful decision-making tool to develop adaptive algorithms and protocols for WSNs. Furthermore, various solution methods are discussed and compared to serve as a guide for using MDPs in WSNs

Integrated placement and routing of relay nodes for fault-tolerant hierarchical sensor networks

In two-tiered sensor networks, using higher-powered relay nodes as cluster heads has been shown to lead to further improvements in network performance. Placement of such relay nodes focuses on achieving specified coverage and connectivity requirements with as few relay nodes as possible. Existing placement strategies typically are unaware of energy dissipation due to routing and are not capable of optimizing the routing scheme and placement concurrently. We, in this thesis, propose an integrated integer linear program (ILP) formulation that determines the minimum number of relay nodes, along with their locations and a suitable communication strategy such that the network has a guaranteed lifetime as well as ensuring the pre-specified level of coverage (ks) and connectivity (kr). We also present an intersection based approach for creating the initial set of potential relay node positions, which are used by our ILP, and evaluate its performance under different conditions. Experimental results on networks with hundreds of sensor nodes show that our approach leads to significant improvement over existing energy-unaware placement schemes

Lossy network correlated data gathering with high-resolution coding

Sensor networks measuring correlated data are considered, where the task is to gather data from the network nodes to a sink. A specific scenario is addressed, where data at nodes are lossy coded with high-resolution, and the information measured by the nodes has to be reconstructed at the sink within both certain total and individual distortion bounds. The first problem considered is to find the optimal transmission structure and the rate-distortion allocations at the various spatially located nodes, such as to minimize the total power consumption cost of the network, by assuming fixed nodes positions. The optimal transmission structure is the shortest path tree and the problems of rate and distortion allocation separate in the high-resolution case, namely, first the distortion allocation is found as a function of the transmission structure, and second, for a given distortion allocation, the rate allocation is computed. The second problem addressed is the case when the node positions can be chosen, by finding the optimal node placement for two different targets of interest, namely total power minimization and network lifetime maximization. Finally, a node placement solution that provides a tradeoff between the two metrics is proposed

Power Aware Routing for Sensor Databases

Wireless sensor networks offer the potential to span and monitor large geographical areas inexpensively. Sensor network databases like TinyDB are the dominant architectures to extract and manage data in such networks. Since sensors have significant power constraints (battery life), and high communication costs, design of energy efficient communication algorithms is of great importance. The data flow in a sensor database is very different from data flow in an ordinary network and poses novel challenges in designing efficient routing algorithms. In this work we explore the problem of energy efficient routing for various different types of database queries and show that in general, this problem is NP-complete. We give a constant factor approximation algorithm for one class of query, and for other queries give heuristic algorithms. We evaluate the efficiency of the proposed algorithms by simulation and demonstrate their near optimal performance for various network sizes

Design Methods for the Cluster Head Selection in WSNs based on Node Residual Status to Enhance the Lifetime and Performance of the Network

This study introduces a novel approach to enhance Wireless Sensor Networks (WSNs) by proposing an energy-balancing algorithm and a unique Cluster Head (CH) selection strategy based on nodes' residual energy states. Unlike conventional methods, our algorithm dynamically distributes energy across nodes, mitigating localized energy depletion and extending the overall network lifetime. The Knapsack method optimizes resource allocation considering energy constraints. Performance evaluations, conducted using NS2.34/2.35, compare our approach with a widely used energy-balancing technique in WSNs. Our results showcase significant improvements. Notably, our algorithm achieves a remarkable 20% increase in network lifetime and a 25% enhancement in data throughput, demonstrating its effectiveness in optimizing resource usage. Furthermore, a 30% reduction in latency ensures faster and more responsive data transmission. The CH selection method positively impacts network coverage, resulting in a substantial 20% expansion of monitored areas. Compared to the existing technique, our proposed strategy consistently outperforms in key metrics, indicating its superior efficacy. This research contributes to advancing WSN sustainability and efficiency, particularly in scenarios prioritizing energy efficiency. The proposed algorithm emerges as a promising solution, demonstrating its potential to optimize WSN performance and longevity. Furthermore, the network simulator (NS) is used to examine the performance of the network with the NS2.34/2.35 version. The results exhibit the dominance of the projected method compared to existing techniques. Additionally, the method shows adaptability to dynamic network conditions, ensuring effective CH reselection in the presence of node failures or energy fluctuations

A survey of network lifetime maximization techniques in wireless sensor networks

Emerging technologies, such as the Internet of things, smart applications, smart grids and machine-to-machine networks stimulate the deployment of autonomous, selfconfiguring, large-scale wireless sensor networks (WSNs). Efficient energy utilization is crucially important in order to maintain a fully operational network for the longest period of time possible. Therefore, network lifetime (NL) maximization techniques have attracted a lot of research attention owing to their importance in terms of extending the flawless operation of battery-constrained WSNs. In this paper, we review the recent developments in WSNs, including their applications, design constraints and lifetime estimation models. Commencing with the portrayal of rich variety definitions of NL design objective used for WSNs, the family of NL maximization techniques is introduced and some design guidelines with examples are provided to show the potential improvements of the different design criteri