An Estimation Algorithm for a Class of Networked Control Systems Using UDP-Like Communication Schemes

In this work we consider a class of networked control systems (NCS) when the control signal is sent to the plant via a UDP-like communication protocol. In this case the controller sends a communication packet to the plant across a lossy network, but the controller does not receive any acknowledgement signal indicating the status of the control packet. Standard observer based estimators assume the estimator has knowledge of what control signal is applied to the plant. Under the UDP-like protocol the controller/estimator does not have explicit knowledge whether the control signals have been applied to the plant or not. We present a simple estimation and control algorithm that consists of a state and mode observer as well as a constraint on the control signal sent to the plant. For the class of systems considered, discrete time LTI plants where at least one of the states that is directly affected by the input is also part of the measurement vector, the estimator is able to recover the fate of the control packet from the measurement at the next timestep and exhibit better performance than other naive schemes. For single-input-single-output (SISO) systems we are able to show convergence properties of the estimation error and closed loop stability. Simulations are provided to demonstrate the algorithm and show its effectiveness

Estimation Schemes for Networked Control Systems Using UDP-Like Communication

In this work we consider a class of networked control systems (NCS) when the control signal is sent to the plant via a UDP-like communication protocol, the controller sends a communication packet to the plant across a lossy network but the controller does not receive any acknowledgement signal indicating the status of reception/delivery of the control packet. Standard observer based estimators assume the estimator has knowledge of what control signal is applied to the plant, but under the UDP-like communication scheme the estimator does not know what control is applied. Continuing previous work, we present a simple estimation algorithm consisting of a state estimator and mode observer. For single input systems we can add an extra control signal that guarantees recovery of the fate of the control packet. Using a modified state feedback with the added input we can guarantee the estimation error is bounded as is the expected value of the state. This extra input is removed and sufficient conditions on the system properties are given to assure the estimation remain bounded. Comparisons are made between the algorithm presented and the method of unknown input observer. Simulations are provided to demonstrate the algorithm

Optimal Local and Remote Controllers with Unreliable Communication

We consider a decentralized optimal control problem for a linear plant controlled by two controllers, a local controller and a remote controller. The local controller directly observes the state of the plant and can inform the remote controller of the plant state through a packet-drop channel. We assume that the remote controller is able to send acknowledgments to the local controller to signal the successful receipt of transmitted packets. The objective of the two controllers is to cooperatively minimize a quadratic performance cost. We provide a dynamic program for this decentralized control problem using the common information approach. Although our problem is not a partially nested LQG problem, we obtain explicit optimal strategies for the two controllers. In the optimal strategies, both controllers compute a common estimate of the plant state based on the common information. The remote controller's action is linear in the common estimated state, and the local controller's action is linear in both the actual state and the common estimated state

An Optimal Transmission Strategy for Kalman Filtering over Packet Dropping Links with Imperfect Acknowledgements

This paper presents a novel design methodology for optimal transmission policies at a smart sensor to remotely estimate the state of a stable linear stochastic dynamical system. The sensor makes measurements of the process and forms estimates of the state using a local Kalman filter. The sensor transmits quantized information over a packet dropping link to the remote receiver. The receiver sends packet receipt acknowledgments back to the sensor via an erroneous feedback communication channel which is itself packet dropping. The key novelty of this formulation is that the smart sensor decides, at each discrete time instant, whether to transmit a quantized version of either its local state estimate or its local innovation. The objective is to design optimal transmission policies in order to minimize a long term average cost function as a convex combination of the receiver's expected estimation error covariance and the energy needed to transmit the packets. The optimal transmission policy is obtained by the use of dynamic programming techniques. Using the concept of submodularity, the optimality of a threshold policy in the case of scalar systems with perfect packet receipt acknowledgments is proved. Suboptimal solutions and their structural results are also discussed. Numerical results are presented illustrating the performance of the optimal and suboptimal transmission policies.Comment: Conditionally accepted in IEEE Transactions on Control of Network System

Experiments in dynamic control of autonomous marine vehicles using acoustic modems

Marine robots are an increasingly attractive means for observing and monitoring in the ocean, but underwater acoustic communication (“acomms”) remains a major challenge, especially for real-time control. Packet loss occurs widely, bit rates are low, and there are significant delays. We consider here strategies for feedback control with acomms links in either the sensor-controller channel, or the controller-actuator channel. On the controller-actuator side we implement sparse packetized predictive control (S-PPC), which simultaneously addresses packet-loss and the data rate limit. For the sensor-controller channel we study a modified information filter (MIF) in a Linear Quadratic Gaussian (LQG) control scheme. Field experiments were carried out with both approaches, regulating crosstrack error in a robotic kayak using acomms. Outcomes with both the S-PPC and MIF LQG confirm that good performance is achievable.United States. Office of Naval Research (Grant N00014-09-1-0700)National Science Foundation (U.S.) (Contract CNS-1212597)Finmeccanic

Optimal LQG Control Across a Packet-Dropping Link

We examine optimal Linear Quadratic Gaussian control for a system in which communication between the sensor (output of the plant) and the controller occurs across a packet-dropping link. We extend the familiar LQG separation principle to this problem that allows us to solve this problem using a standard LQR state-feedback design, along with an optimal algorithm for propagating and using the information across the unreliable link. We present one such optimal algorithm, which consists of a Kalman Filter at the sensor side of the link, and a switched linear filter at the controller side. Our design does not assume any statistical model of the packet drop events, and is thus optimal for an arbitrary packet drop pattern. Further, the solution is appealing from a practical point of view because it can be implemented as a small modification of an existing LQG control design