Deployment Policies to Reliably Maintain and Maximize Expected Coverage in a Wireless Sensor Network

The long-term operation of a wireless sensor network (WSN) requires the deployment of new sensors over time to restore any loss in network coverage and communication ability resulting from sensor failures. Over the course of several deployment actions it is important to consider the cost of maintaining the WSN in addition to any desired performance measures such as coverage, connectivity, or reliability. The resulting problem formulation is approached first through a time-based deployment model in which the network is restored to a fixed size at periodic time intervals. The network destruction spectrum (D-spectrum) has been introduced to estimate reliability and is more commonly applied to a static network, rather than a dynamic network where new sensors are deployed over time. We discuss how the D-spectrum can be incorporated to estimate reliability of a time-based deployment policy and the features that allow a wide range of deployment policies to be evaluated in an efficient manner. We next focus on a myopic condition-based deployment model where the network is observed at periodic time intervals and a fixed budget is available to deploy new sensors with each observation. With a limited budget available the model must address the complexity present in a dynamic network size in addition to a dynamic network topology, and the dependence of network reliability on the deployment action. We discuss how the D-spectrum can be applied to the myopic condition-based deployment problem, illustrating the value of the D-spectrum in a variety of maintenance settings beyond the traditional static network reliability problem. From the insight of the time-based and myopic condition-based deployment models, we present a Markov decision process (MDP) model for the condition-based deployment problem that captures the benefit of an action beyond the current time period. Methodology related to approximate dynamic programming (ADP) and approximate value iteration algorithms is presented to search for high quality deployment policies. In addition to the time-based and myopic condition-based deployment models, the MDP model is one of the few addressing the repeated deployment of new sensors as well as an emphasis on network reliability. For each model we discuss the relevant problem formulation, methodology to estimate network reliability, and demonstrate the performance in a range of test instances, comparing to alternative policies or models as appropriate. We conclude with a stochastic optimization model focused on a slightly different objective to maximize expected coverage with uncertainty in where a sensor lands in the network. We discuss a heuristic solution method that seeks to determine an optimal deployment of sensors, present results for a wide range of network sizes and explore the impact of sensor failures on both the model formulation and resulting deployment policy

A Data Collecting Strategy for Farmland WSNs using a Mobile Sink

To the characteristics of large number of sensor nodes, wide area and unbalanced energy consumption in farmland Wireless Sensor Networks, an efficient data collection strategy (GCMS) based on grid clustering and a mobile sink is proposed. Firstly, cluster is divided based on virtual grid, and the cluster head is selected by considering node position and residual energy. Then, an optimal mobile path and residence time allocation mechanism for mobile sink are proposed. Finally, GCMS is simulated and compared with LEACH and GRDG. Simulation results show that GCMS can significantly prolong the network lifetime and increase the amount of data collection, especially suitable for large-scale farmland Wireless Sensor Networks

Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey

Wireless sensor networks (WSNs) consist of autonomous and resource-limited devices. The devices cooperate to monitor one or more physical phenomena within an area of interest. WSNs operate as stochastic systems because of randomness in the monitored environments. For long service time and low maintenance cost, WSNs require adaptive and robust methods to address data exchange, topology formulation, resource and power optimization, sensing coverage and object detection, and security challenges. In these problems, sensor nodes are to make optimized decisions from a set of accessible strategies to achieve design goals. This survey reviews numerous applications of the Markov decision process (MDP) framework, a powerful decision-making tool to develop adaptive algorithms and protocols for WSNs. Furthermore, various solution methods are discussed and compared to serve as a guide for using MDPs in WSNs

Optimal Data Scheduling and Admission Control for Backscatter Sensor Networks

© 2017 IEEE. This paper studies the data scheduling and admission control problem for a backscatter sensor network (BSN). In the network, instead of initiating their own transmissions, the sensors can send their data to the gateway just by switching their antenna impedance and reflecting the received RF signals. As such, we can reduce remarkably the complexity, the power consumption, and the implementation cost of sensor nodes. Different sensors may have different functions, and data collected from each sensor may also have a different status, e.g., urgent or normal, and thus we need to take these factors into account. Therefore, in this paper, we first introduce a system model together with a mechanism in order to address the data collection and scheduling problem in the BSN. We then propose an optimization solution using the Markov decision process framework and a reinforcement learning algorithm based on the linear function approximation method, with the aim of finding the optimal data collection policy for the gateway. Through simulation results, we not only show the efficiency of the proposed solution compared with other baseline policies, but also present the analysis for data admission control policy under different classes of sensors as well as different types of data

Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks

Future wireless networks have a substantial potential in terms of supporting a broad range of complex compelling applications both in military and civilian fields, where the users are able to enjoy high-rate, low-latency, low-cost and reliable information services. Achieving this ambitious goal requires new radio techniques for adaptive learning and intelligent decision making because of the complex heterogeneous nature of the network structures and wireless services. Machine learning (ML) algorithms have great success in supporting big data analytics, efficient parameter estimation and interactive decision making. Hence, in this article, we review the thirty-year history of ML by elaborating on supervised learning, unsupervised learning, reinforcement learning and deep learning. Furthermore, we investigate their employment in the compelling applications of wireless networks, including heterogeneous networks (HetNets), cognitive radios (CR), Internet of things (IoT), machine to machine networks (M2M), and so on. This article aims for assisting the readers in clarifying the motivation and methodology of the various ML algorithms, so as to invoke them for hitherto unexplored services as well as scenarios of future wireless networks.Comment: 46 pages, 22 fig

Robust deployment and control of sensors in wireless monitoring networks

Advances in Micro Electro-Mechanical Systems (MEMS) technology, including MEMS sensors, have allowed the deployment of small, inexpensive, energy-efficient sensors with wireless networking capabilities. The continuing development of these technologies has given rise to increased interest in the concept of wireless sensor networks (WSNs). A WSN is composed of a large number (hundreds, even thousands) of sensor nodes, each consisting of sensing, data processing, and communication components. The sensors are deployed onto a region of interest and form a network to directly sense and report on physical phenomena. The goal of a monitoring wireless sensor network is to gather sensor data from a specified region and relay this information to a designated base station (BSt). In this study, we focus on deploying and replenishing wireless sensor nodes onto an area such that a given mission lifetime is met subject to constraints on cost, connectivity, and coverage of the area of interest. The major contributions of this work are (1) a technique for differential deployment (meaning that nodes are deployed with different densities depending on their distance from the base station); the resulting clustered architecture extends lifetime beyond network lifetime experienced with a uniform deployment and other existing differential techniques; (2) a characterization of the energy consumption in a clustered network and the energy remaining after network failure, this characterization includes the overhead costs associated with creating hierarchies and retrieving data from all sensors ; (3) a characterization of the effects and costs associated with hop counts in the network; (4) a strategy for replenishing nodes consisting of determining the optimal order size and the allocation over the deployment region. The impact of replenishment is also integrated into the network control model using intervention analysis. The result is a set of algorithms that provide differential deployment densities for nodes (clusterhead and non-clusterhead) that maximize network lifetime and minimize wasted energy. If a single deployment is not feasible, the optimal replenishment strategy that minimizes deployment costs and penalties is calculated.Ph.D., Electrical Engineering -- Drexel University, 201

A Comprehensive Survey of Potential Game Approaches to Wireless Networks

Potential games form a class of non-cooperative games where unilateral improvement dynamics are guaranteed to converge in many practical cases. The potential game approach has been applied to a wide range of wireless network problems, particularly to a variety of channel assignment problems. In this paper, the properties of potential games are introduced, and games in wireless networks that have been proven to be potential games are comprehensively discussed.Comment: 44 pages, 6 figures, to appear in IEICE Transactions on Communications, vol. E98-B, no. 9, Sept. 201