Greedy path planning for maximizing value of information in underwater sensor networks

Underwater sensor networks (UWSNs) face specific challenges due to the transmission properties in the underwater environment. Radio waves propagate only for short distances under water, and acoustic transmissions have limited data rate and relatively high latency. One of the possible solutions to these challenges involves the use of autonomous underwater vehicles (AUVs) to visit and offload data from the individual sensor nodes. We consider an underwater sensor network visually monitoring an offshore oil platform for hazards such as oil spills from pipes and blowups. To each observation chunk (image or video) we attach a numerical value of information (VoI). This value monotonically decreases in time with a speeed which depends on the urgency of the captured data. An AUV visits different nodes along a specific path and collects data to be transmitted to the customer. Our objective is to develop path planners for the movement of the AUV which maximizes the total VoI collected. We consider three different path planners: the lawn mower path planner (LPP), the greedy planner (GPP) and the random planner (RPP). In a simulation study we compare the total VoI collected by these algorithms and show that the GPP outperforms the other two proposed algorithms on the studied scenarios

Value-of-Information based Data Collection in Underwater Sensor Networks

Underwater sensor networks are deployed in marine environments, presenting specific challenges compared to sensor networks deployed in terrestrial settings. Among the major issues that underwater sensor networks face is communication medium limitations that result in low bandwidth and long latency. This creates problems when these networks need to transmit large amounts of data over long distances. A possible solution to address this issue is to use mobile sinks such as autonomous underwater vehicles (AUVs) to offload these large quantities of data. Such mobile sinks are called data mules. Often it is the case that a sensor network is deployed to report events that require immediate attention. Delays in reporting such events can have catastrophic consequences. In this dissertation, we present path planning algorithms that help in prioritizing data retrieval from sensor nodes in such a manner that nodes that require more immediate attention would be dealt with at the earliest. In other words, the goal is to improve the Quality of Information (QoI) retrieved. The path planning algorithms proposed in this dissertation are based on heuristics meant to improve the Value of Information (VoI) retrieved from a system. Value of information is a construct that helps in encoding the valuation of an information segment i.e. it is the price an optimal player would pay to obtain a segment of information in a game theoretic setting. Quality of information and value of information are complementary concepts. In this thesis, we formulate a value of information model for sensor networks and then consider the constraints that arise in underwater settings. On the basis of this, we develop a VoI-based path planning problem statement and propose heuristics that solve the path planning problem. We show through simulation studies that the proposed strategies improve the value, and hence, quality of the information retrieved. It is important to note that these path planning strategies can be applied equally well in terrestrial settings that deploy mobile sinks for data collection

Routing Protocols for Underwater Acoustic Sensor Networks: A Survey from an Application Perspective

Underwater acoustic communications are different from terrestrial radio communications; acoustic channel is asymmetric and has large and variable end‐to‐end propagation delays, distance‐dependent limited bandwidth, high bit error rates, and multi‐path fading. Besides, nodes’ mobility and limited battery power also cause problems for networking protocol design. Among them, routing in underwater acoustic networks is a challenging task, and many protocols have been proposed. In this chapter, we first classify the routing protocols according to application scenarios, which are classified according to the number of sinks that an underwater acoustic sensor network (UASN) may use, namely single‐sink, multi‐sink, and no‐sink. We review some typical routing strategies proposed for these application scenarios, such as cross‐layer and reinforcement learning as well as opportunistic routing. Finally, some remaining key issues are highlighted

An effective data-collection scheme with AUV path planning in underwater wireless sensor networks

Data collection in underwater wireless sensor networks (UWSNs) using autonomous underwater vehicles (AUVs) is a more robust solution than traditional approaches, instead of transmitting data from each node to a destination node. However, the design of delay-aware and energy-efficient path planning for AUVs is one of the most crucial problems in collecting data for UWSNs. To reduce network delay and increase network lifetime, we proposed a novel reliable AUV-based data-collection routing protocol for UWSNs. The proposed protocol employs a route planning mechanism to collect data using AUVs. The sink node directs AUVs for data collection from sensor nodes to reduce energy consumption. First, sensor nodes are organized into clusters for better scalability, and then, these clusters are arranged into groups to assign an AUV to each group. Second, the traveling path for each AUV is crafted based on the Markov decision process (MDP) for the reliable collection of data. The simulation results affirm the effectiveness and efficiency of the proposed technique in terms of throughput, energy efficiency, delay, and reliability. © 2022 Wahab Khan et al

Heuristics for a vehicle routing problem with information collection in wireless networks

International audienceWe consider a wireless network where a given set of stations is continuously generating information. A single vehicle, located at a base station, is available to collect the information via wireless transfer. The wireless transfer vehicle routing problem (WTVRP) is to decide which stations should be visited in the vehicle route, how long shall the vehicle stay in each station, and how much information shall be transferred from the nearby stations to the vehicle during each stay. The goal is to collect the maximum amount of information during a time period after which the vehicle returns to the base station. The WTVRP is NP-hard. Although it can be solved to optimality for small size instances, one needs to rely on good heuristic schemes to obtain good solutions for large size instances. In this work, we consider a mathematical formulation based on the vehicle visits. Several heuristics strategies are proposed, most of them based on the mathematical model. These strategies include constructive and improvement heuristics. Computational experiments show that a strategy that combines a combinatorial greedy heuristic to design a initial vehicle route, improved by a fix-and-optimize heuristic to provide a local optimum, followed by an exchange heuristic, affords good solutions within reasonable amount of running time

Adaptive Information Gathering via Imitation Learning

In the adaptive information gathering problem, a policy is required to select an informative sensing location using the history of measurements acquired thus far. While there is an extensive amount of prior work investigating effective practical approximations using variants of Shannon's entropy, the efficacy of such policies heavily depends on the geometric distribution of objects in the world. On the other hand, the principled approach of employing online POMDP solvers is rendered impractical by the need to explicitly sample online from a posterior distribution of world maps. We present a novel data-driven imitation learning framework to efficiently train information gathering policies. The policy imitates a clairvoyant oracle - an oracle that at train time has full knowledge about the world map and can compute maximally informative sensing locations. We analyze the learnt policy by showing that offline imitation of a clairvoyant oracle is implicitly equivalent to online oracle execution in conjunction with posterior sampling. This observation allows us to obtain powerful near-optimality guarantees for information gathering problems possessing an adaptive sub-modularity property. As demonstrated on a spectrum of 2D and 3D exploration problems, the trained policies enjoy the best of both worlds - they adapt to different world map distributions while being computationally inexpensive to evaluate.Comment: Robotics Science and Systems, 201

Decision-making for Vehicle Path Planning

This dissertation presents novel algorithms for vehicle path planning in scenarios where the environment changes. In these dynamic scenarios the path of the vehicle needs to adapt to changes in the real world. In these scenarios, higher performance paths can be achieved if we are able to predict the future state of the world, by learning the way it evolves from historical data. We are relying on recent advances in the field of deep learning and reinforcement learning to learn appropriate world models and path planning behaviors. There are many different practical applications that map to this model. In this dissertation we propose algorithms for two applications that are very different in domain but share important formal similarities: the scheduling of taxi services in a large city and tracking wild animals with an unmanned aerial vehicle. The first application models a centralized taxi dispatch center in a big city. It is a multivariate optimization problem for taxi time scheduling and path planning. The first goal here is to balance the taxi service demand and supply ratio in the city. The second goal is to minimize passenger waiting time and taxi idle driving distance. We design different learning models that capture taxi demand and destination distribution patterns from historical taxi data. The predictions are evaluated with real-world taxi trip records. The predicted taxi demand and destination is used to build a taxi dispatch model. The taxi assignment and re-balance is optimized by solving a Mixed Integer Programming (MIP) problem. The second application concerns animal monitoring using an unmanned aerial vehicle (UAV) to search and track wild animals in a large geographic area. We propose two different path planing approaches for the UAV. The first one is based on the UAV controller solving Markov decision process (MDP). The second algorithms relies on the past recorded animal appearances. We designed a learning model that captures animal appearance patterns and predicts the distribution of future animal appearances. We compare the proposed path planning approaches with traditional methods and evaluated them in terms of collected value of information (VoI), message delay and percentage of events collected

Markov Decision Processes with Applications in Wireless Sensor Networks: A Survey

Wireless sensor networks (WSNs) consist of autonomous and resource-limited devices. The devices cooperate to monitor one or more physical phenomena within an area of interest. WSNs operate as stochastic systems because of randomness in the monitored environments. For long service time and low maintenance cost, WSNs require adaptive and robust methods to address data exchange, topology formulation, resource and power optimization, sensing coverage and object detection, and security challenges. In these problems, sensor nodes are to make optimized decisions from a set of accessible strategies to achieve design goals. This survey reviews numerous applications of the Markov decision process (MDP) framework, a powerful decision-making tool to develop adaptive algorithms and protocols for WSNs. Furthermore, various solution methods are discussed and compared to serve as a guide for using MDPs in WSNs