Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey

Wireless sensor networks (WSNs) consist of autonomous and resource-limited devices. The devices cooperate to monitor one or more physical phenomena within an area of interest. WSNs operate as stochastic systems because of randomness in the monitored environments. For long service time and low maintenance cost, WSNs require adaptive and robust methods to address data exchange, topology formulation, resource and power optimization, sensing coverage and object detection, and security challenges. In these problems, sensor nodes are to make optimized decisions from a set of accessible strategies to achieve design goals. This survey reviews numerous applications of the Markov decision process (MDP) framework, a powerful decision-making tool to develop adaptive algorithms and protocols for WSNs. Furthermore, various solution methods are discussed and compared to serve as a guide for using MDPs in WSNs

No-Sense: Sense with Dormant Sensors

Wireless sensor networks (WSNs) have enabled continuous monitoring of an area of interest (body, room, region, etc.) while eliminating expensive wired infrastructure. Typically in such applications, wireless sensor nodes report the sensed values to a sink node, where the information is required for the end-user. WSNs also provide the flexibility to the end-user for choosing several parameters for the monitoring application. For example, placement of sensors, frequency of sensing and transmission of those sensed data. Over the years, the advancement in embedded technology has led to increased processing power and memory capacity of these battery powered devices. However, batteries can only supply limited energy, thus limiting the lifetime of the network. In order to prolong the lifetime of the deployment, various efforts have been made to improve the battery technologies and also reduce the energy consumption of the sensor node at various layers in the networking stack. Of all the operations in the network stack, wireless data transmission and reception have found to consume most of the energy. Hence many proposals found in the literature target reducing them through intelligent schemes like power control, reducing retransmissions, etc. In this article we propose a new framework called Virtual Sensing Framework (VSF), which aims to sufficiently satisfy application requirements while conserving energy at the sensor nodes.Comment: Accepted for publication in IEEE Twentieth National Conference on Communications (NCC-2014

Reliable routing scheme for indoor sensor networks

Indoor Wireless sensor networks require a highly dynamic, adaptive routing scheme to deal with the high rate of topology changes due to fading of indoor wireless channels. Besides that, energy consumption rate needs to be consistently distributed among sensor nodes and efficient utilization of battery power is essential. If only the link reliability metric is considered in the routing scheme, it may create long hops routes, and the high quality paths will be frequently used. This leads to shorter lifetime of such paths; thereby the entire network's lifetime will be significantly minimized. This paper briefly presents a reliable load-balanced routing (RLBR) scheme for indoor ad hoc wireless sensor networks, which integrates routing information from different layers. The proposed scheme aims to redistribute the relaying workload and the energy usage among relay sensor nodes to achieve balanced energy dissipation; thereby maximizing the functional network lifetime. RLBR scheme was tested and benchmarked against the TinyOS-2.x implementation of MintRoute on an indoor testbed comprising 20 Mica2 motes and low power listening (LPL) link layer provided by CC1000 radio. RLBR scheme consumes less energy for communications while reducing topology repair latency and achieves better connectivity and communication reliability in terms of end-to-end packets delivery performance

Joint Transmission and Energy Transfer Policies for Energy Harvesting Devices with Finite Batteries

One of the main concerns in traditional Wireless Sensor Networks (WSNs) is energy efficiency. In this work, we analyze two techniques that can extend network lifetime. The first is Ambient \emph{Energy Harvesting} (EH), i.e., the capability of the devices to gather energy from the environment, whereas the second is Wireless \emph{Energy Transfer} (ET), that can be used to exchange energy among devices. We study the combination of these techniques, showing that they can be used jointly to improve the system performance. We consider a transmitter-receiver pair, showing how the ET improvement depends upon the statistics of the energy arrivals and the energy consumption of the devices. With the aim of maximizing a reward function, e.g., the average transmission rate, we find performance upper bounds with and without ET, define both online and offline optimization problems, and present results based on realistic energy arrivals in indoor and outdoor environments. We show that ET can significantly improve the system performance even when a sizable fraction of the transmitted energy is wasted and that, in some scenarios, the online approach can obtain close to optimal performance.Comment: 16 pages, 12 figure

A Survey on Energy-Efficient Strategies in Static Wireless Sensor Networks

A comprehensive analysis on the energy-efficient strategy in static Wireless Sensor Networks (WSNs) that are not equipped with any energy harvesting modules is conducted in this article. First, a novel generic mathematical definition of Energy Efficiency (EE) is proposed, which takes the acquisition rate of valid data, the total energy consumption, and the network lifetime of WSNs into consideration simultaneously. To the best of our knowledge, this is the first time that the EE of WSNs is mathematically defined. The energy consumption characteristics of each individual sensor node and the whole network are expounded at length. Accordingly, the concepts concerning EE, namely the Energy-Efficient Means, the Energy-Efficient Tier, and the Energy-Efficient Perspective, are proposed. Subsequently, the relevant energy-efficient strategies proposed from 2002 to 2019 are tracked and reviewed. Specifically, they respectively are classified into five categories: the Energy-Efficient Media Access Control protocol, the Mobile Node Assistance Scheme, the Energy-Efficient Clustering Scheme, the Energy-Efficient Routing Scheme, and the Compressive Sensing--based Scheme. A detailed elaboration on both of the basic principle and the evolution of them is made. Finally, further analysis on the categories is made and the related conclusion is drawn. To be specific, the interdependence among them, the relationships between each of them, and the Energy-Efficient Means, the Energy-Efficient Tier, and the Energy-Efficient Perspective are analyzed in detail. In addition, the specific applicable scenarios for each of them and the relevant statistical analysis are detailed. The proportion and the number of citations for each category are illustrated by the statistical chart. In addition, the existing opportunities and challenges facing WSNs in the context of the new computing paradigm and the feasible direction concerning EE in the future are pointed out