Fake-Acknowledgment Attack on ACK-based Sensor Power Schedule for Remote State Estimation

We consider a class of malicious attacks against remote state estimation. A sensor with limited resources adopts an acknowledgement (ACK)-based online power schedule to improve the remote state estimation performance. A malicious attacker can modify the ACKs from the remote estimator and convey fake information to the sensor. When the capability of the attacker is limited, we propose an attack strategy for the attacker and analyze the corresponding effect on the estimation performance. The possible responses of the sensor are studied and a condition for the sensor to discard ACKs and switch from online schedule to offline schedule is provided.Comment: submitted to IEEE CDC 201

Transmission Power Scheduling for Energy Harvesting Sensor in Remote State Estimation

We study remote estimation in a wireless sensor network. Instead of using a conventional battery-powered sensor, a sensor equipped with an energy harvester which can obtain energy from the external environment is utilized. We formulate this problem into an infinite time-horizon Markov decision process and provide the optimal sensor transmission power control strategy. In addition, a sub-optimal strategy which is easier to implement and requires less computation is presented. A numerical example is provided to illustrate the implementation of the sub-optimal policy and evaluation of its estimation performance.Comment: Extended version of article to be published in the Proceedings of the 19th IFAC World Congress, 201

Energy-Efficient Spectrum Sensing for Cognitive Radio Enabled Remote State Estimation Over Wireless Channels

The performance of remote estimation over wireless channels is strongly affected by sensor data losses due to interference. Although the impact of interference can be alleviated by applying cognitive radio technique which features in spectrum sensing and transmitting data only on clear channels, the introduction of spectrum sensing incurs extra energy expenditure. In this paper, we investigate the problem of energy-efficient spectrum sensing for remotely estimating the state of a general linear dynamic system, and formulate an optimization problem which minimizes the total sensor energy consumption while guaranteeing a desired level of estimation performance. We model the problem as a mixed integer nonlinear program and propose a simulated annealing based optimization algorithm which jointly addresses when to perform sensing, which channels to sense, in what order and how long to scan each channel. Simulation results demonstrate that the proposed algorithm well balances the sensing energy and transmission energy expenditure and can achieve the desired estimation performance

Deep Reinforcement Learning for Wireless Sensor Scheduling in Cyber-Physical Systems

In many Cyber-Physical Systems, we encounter the problem of remote state estimation of geographically distributed and remote physical processes. This paper studies the scheduling of sensor transmissions to estimate the states of multiple remote, dynamic processes. Information from the different sensors have to be transmitted to a central gateway over a wireless network for monitoring purposes, where typically fewer wireless channels are available than there are processes to be monitored. For effective estimation at the gateway, the sensors need to be scheduled appropriately, i.e., at each time instant one needs to decide which sensors have network access and which ones do not. To address this scheduling problem, we formulate an associated Markov decision process (MDP). This MDP is then solved using a Deep Q-Network, a recent deep reinforcement learning algorithm that is at once scalable and model-free. We compare our scheduling algorithm to popular scheduling algorithms such as round-robin and reduced-waiting-time, among others. Our algorithm is shown to significantly outperform these algorithms for many example scenarios