Sparse Wide-Area Control of Power Systems using Data-driven Reinforcement Learning

In this paper we present an online wide-area oscillation damping control (WAC) design for uncertain models of power systems using ideas from reinforcement learning. We assume that the exact small-signal model of the power system at the onset of a contingency is not known to the operator and use the nominal model and online measurements of the generator states and control inputs to rapidly converge to a state-feedback controller that minimizes a given quadratic energy cost. However, unlike conventional linear quadratic regulators (LQR), we intend our controller to be sparse, so its implementation reduces the communication costs. We, therefore, employ the gradient support pursuit (GraSP) optimization algorithm to impose sparsity constraints on the control gain matrix during learning. The sparse controller is thereafter implemented using distributed communication. Using the IEEE 39-bus power system model with 1149 unknown parameters, it is demonstrated that the proposed learning method provides reliable LQR performance while the controller matched to the nominal model becomes unstable for severely uncertain systems.Comment: Submitted to IEEE ACC 2019. 8 pages, 4 figure

Sliding mode and shaped input vibration control of flexible systems

Copyright [2008] IEEE. This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way imply IEEE endorsement of any of Brunel University's products or services. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to [email protected]. By choosing to view this document, you agree to all provisions of the copyright laws protecting it.In this paper, the vibration reduction problem is investigated for a flexible spacecraft during attitude maneuvering. A new control strategy is proposed, which integrates both the command input shaping and the sliding mode output feedback control (SMOFC) techniques. Specifically, the input shaper is designed for the reference model and implemented outside of the feedback loop in order to achieve the exact elimination of the residual vibration by modifying the existing command. The feedback controller, on the other hand, is designed based on the SMOFC such that the closed-loop system behaves like the reference model with input shaper, where the residual vibrations are eliminated in the presence of parametric uncertainties and external disturbances. An attractive feature of this SMOFC algorithm is that the parametric uncertainties or external disturbances of the system do not need to satisfy the so-called matching conditions or invariance conditions provided that certain bounds are known. In addition, a smoothed hyperbolic tangent function is introduced to eliminate the chattering phenomenon. Compared with the conventional methods, the proposed scheme guarantees not only the stability of the closed-loop system, but also the good performance as well as the robustness. Simulation results for the spacecraft model show that the precise attitudes control and vibration suppression are successfully achieved

Nonlinear Receding-Horizon Control of Rigid Link Robot Manipulators

The approximate nonlinear receding-horizon control law is used to treat the trajectory tracking control problem of rigid link robot manipulators. The derived nonlinear predictive law uses a quadratic performance index of the predicted tracking error and the predicted control effort. A key feature of this control law is that, for their implementation, there is no need to perform an online optimization, and asymptotic tracking of smooth reference trajectories is guaranteed. It is shown that this controller achieves the positions tracking objectives via link position measurements. The stability convergence of the output tracking error to the origin is proved. To enhance the robustness of the closed loop system with respect to payload uncertainties and viscous friction, an integral action is introduced in the loop. A nonlinear observer is used to estimate velocity. Simulation results for a two-link rigid robot are performed to validate the performance of the proposed controller. Keywords: receding-horizon control, nonlinear observer, robot manipulators, integral action, robustness

Discrete-time sliding mode control based on disturbance observer applied to current control of permanent magnet synchronous motor

This paper proposes a robust current control technique based on a discrete-time sliding mode controller and a disturbance observer for high-performance permanent magnet synchronous motor (PMSM) drives. This scheme is applied in the PMSM current control loops to enable the decoupling between the dq current axes, rejection of disturbances caused by mechanical load changes and robustness under parametric uncertainties. In order to ensure the discrete-time sliding mode properties, which make the system cross the sliding surface at each sampling period, the PMSM model is extended, including the digital implementation delay resulting from the discrete-time algorithm execution. The development of this method allows direct implementation in microcontrollers and digital signal processors. Stability and convergence analysis are developed in the discrete-time domain. Simulation and experimental results demonstrate the effectiveness and good performance of the proposed current control approach

Recent advances on recursive filtering and sliding mode design for networked nonlinear stochastic systems: A survey

Copyright © 2013 Jun Hu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.Some recent advances on the recursive filtering and sliding mode design problems for nonlinear stochastic systems with network-induced phenomena are surveyed. The network-induced phenomena under consideration mainly include missing measurements, fading measurements, signal quantization, probabilistic sensor delays, sensor saturations, randomly occurring nonlinearities, and randomly occurring uncertainties. With respect to these network-induced phenomena, the developments on filtering and sliding mode design problems are systematically reviewed. In particular, concerning the network-induced phenomena, some recent results on the recursive filtering for time-varying nonlinear stochastic systems and sliding mode design for time-invariant nonlinear stochastic systems are given, respectively. Finally, conclusions are proposed and some potential future research works are pointed out.This work was supported in part by the National Natural Science Foundation of China under Grant nos. 61134009, 61329301, 61333012, 61374127 and 11301118, the Engineering and Physical Sciences Research Council (EPSRC) of the UK under Grant no. GR/S27658/01, the Royal Society of the UK, and the Alexander von Humboldt Foundation of Germany

Robust adaptive controller for wheel mobile robot with disturbances and wheel slips

In this paper an observer based adaptive control algorithm is built for wheel mobile robot (WMR) with considering the system uncertainties, input disturbances, and wheel slips. Firstly, the model of the kinematic and dynamic loops is shown with presence of the disturbances and system uncertainties. Next, the adaptive controller for nonlinear mismatched disturbance systems based on the disturbances observer is presented in detail. The controller includes two parts, the first one is for the stability purpose and the later is for the disturbances compensation. After that this control scheme is applied for both two loops of the system. In this paper, the stability of the closed system which consists of two control loops and the convergence of the observers is mathematically analysed based on the Lyapunov theory. Moreover, the proposed model does not require the complex calculation so it is easy for the implementation. Finally, the simulation model is built for presented method and the existed one to verify the correctness and the effectiveness of the proposed scheme. The simulation results show that the introduced controller gives the good performances even that the desired trajectory is complicated and the working condition is hard