Making the Power Grid More Intelligent

Summary form only given. This paper focuses on the applications of intelligent techniques for improving the performances of the power system controllers. Intelligent control techniques lay the foundation of the next generation of nonlinear controllers and have the advantage of further improving the controller\u27s performance by incorporating heuristics and expert knowledge into its design. Most of these techniques are independent of any mathematical model of the power system, which proves to be a considerable advantage

A Heuristic Dynamic Programming Based Power System Stabilizer for a Turbogenerator in a Single Machine Power System

Power system stabilizers (PSS) are used to generate supplementary control signals for the excitation system in order to damp the low frequency power system oscillations. To overcome the drawbacks of conventional PSS (CPSS), numerous techniques have been proposed in the literature. Based on the analysis of existing techniques, a novel design of power system stabilizer (PSS) based on heuristic dynamic programming (HDP) is proposed in this paper. HDP combining the concepts of dynamic programming and reinforcement learning is used in the design of a nonlinear optimal power system stabilizer. The proposed HDP based PSS is evaluated against the conventional power system stabilizer and indirect adaptive neurocontrol based PSS under small and large disturbances in a single machine infinite bus power system setup. Results are presented to show the effectiveness of this new technique

A Heuristic-Dynamic-programming-Based Power System Stabilizer for a Turbogenerator in a Single-Machine Power System

Power system stabilizers (PSSs) are used to generate supplementary control signals for the excitation system in order to damp the low-frequency power system oscillations. To overcome the drawbacks of a conventional PSS (CPSS), numerous techniques have been proposed in the literature. Based on the analysis of existing techniques, a novel design based on heuristic dynamic programming (HDP) is presented in this paper. HDP, combining the concepts of dynamic programming and reinforcement learning, is used in the design of a nonlinear optimal power system stabilizer. Results show the effectiveness of this new technique. The performance of the HDP-based PSS is compared with the CPSS and the indirect-adaptive-neurocontrol-based PSS under small and large disturbances. In addition, the impact of different discount factors in the HDP PSS\u27s performance is presented

Adaptive dynamic programming-based algorithm for infinite-horizon linear quadratic stochastic optimal control problems

This paper investigates an infinite-horizon linear quadratic stochastic (LQS) optimal control problem for a class of continuous-time stochastic systems. By employing the technique of adaptive dynamic programming (ADP), we propose a novel model-free policy iteration (PI) algorithm. Without needing all information of the system coefficient matrices, the proposed PI algorithm iterates by using the data of the input and system state collected on a fixed time interval. Finally, a numerical example is presented to demonstrate the feasibility of the obtained algorithm

Optimal Wide Area Controller and State Predictor for a Power System

An optimal wide area controller is designed in this paper for a 12-bus power system together with a Static Compensator (STATCOM). The controller provides auxiliary reference signals for the automatic voltage regulators (AVR) of the generators as well as the line voltage controller of the STATCOM in such a way that it improves the damping of the rotor speed deviations of the synchronous machines. Adaptive critic designs theory is used to implement the controller and enable it to provide nonlinear optimal control over the infinite horizon time of the problem and at different operating conditions of the power system. Simulation results are provided to indicate that the proposed wide area controller improves the damping of the rotor speed deviations of the generators during large scale disturbances. Moreover, a robust radial basis function network based identifier is presented in this paper to predict the states of a multimachine power system in real-time. This wide area state predictor (WASP) compensates for transport lags associated with the present communication technology for wide area monitoring of the electric power grid. The WASP is also robust to partial loss of information caused by larger than expected transport lags or even failed sensors throughout the network

Sparse Wide-Area Control of Power Systems using Data-driven Reinforcement Learning

In this paper we present an online wide-area oscillation damping control (WAC) design for uncertain models of power systems using ideas from reinforcement learning. We assume that the exact small-signal model of the power system at the onset of a contingency is not known to the operator and use the nominal model and online measurements of the generator states and control inputs to rapidly converge to a state-feedback controller that minimizes a given quadratic energy cost. However, unlike conventional linear quadratic regulators (LQR), we intend our controller to be sparse, so its implementation reduces the communication costs. We, therefore, employ the gradient support pursuit (GraSP) optimization algorithm to impose sparsity constraints on the control gain matrix during learning. The sparse controller is thereafter implemented using distributed communication. Using the IEEE 39-bus power system model with 1149 unknown parameters, it is demonstrated that the proposed learning method provides reliable LQR performance while the controller matched to the nominal model becomes unstable for severely uncertain systems.Comment: Submitted to IEEE ACC 2019. 8 pages, 4 figure

Chaotic multi-objective optimization based design of fractional order PI{\lambda}D{\mu} controller in AVR system

In this paper, a fractional order (FO) PI{\lambda}D\mu controller is designed to take care of various contradictory objective functions for an Automatic Voltage Regulator (AVR) system. An improved evolutionary Non-dominated Sorting Genetic Algorithm II (NSGA II), which is augmented with a chaotic map for greater effectiveness, is used for the multi-objective optimization problem. The Pareto fronts showing the trade-off between different design criteria are obtained for the PI{\lambda}D\mu and PID controller. A comparative analysis is done with respect to the standard PID controller to demonstrate the merits and demerits of the fractional order PI{\lambda}D\mu controller.Comment: 30 pages, 14 figure

Robust model predictive control for linear systems subject to norm-bounded model Uncertainties and Disturbances: An Implementation to industrial directional drilling system

Model Predictive Control (MPC) refers to a class of receding horizon algorithms in which the current control action is computed by solving online, at each sampling instant, a constrained optimization problem. MPC has been widely implemented within the industry, due to its ability to deal with multivariable processes and to explicitly consider any physical constraints within the optimal control problem in a straightforward manner. However, the presence of uncertainty, whether in the form of additive disturbances, state estimation error or plant-model mismatch, and the robust constraints satisfaction and stability, remain an active area of research. The family of predictive control algorithms, which explicitly take account of process uncertainties/disturbances whilst guaranteeing robust constraint satisfaction and performance is referred to as Robust MPC (RMPC) schemes. In this thesis, RMPC algorithms based on Linear Matrix Inequality (LMI) optimization are investigated, with the overall aim of improving robustness and control performance, while maintaining conservativeness and computation burden at low levels. Typically, the constrained RMPC problem with state-feedback parameterizations is nonlinear (and nonconvex) with a prohibitively high computational burden for online implementation. To remedy this issue, a novel approach is proposed to linearize the state-feedback RMPC problem, with minimal conservatism, through the use of semidefinite relaxation techniques and the Elimination Lemma. The proposed algorithm computes the state-feedback gain and perturbation online by solving an LMI optimization that, in comparison to other schemes in the literature is shown to have a substantially reduced computational burden without adversely affecting the tracking performance of the controller. In the case that only (noisy) output measurements are available, an output-feedback RMPC algorithm is also derived for norm-bounded uncertain systems. The novelty lies in the fact that, instead of using an offline estimation scheme or a fixed linear observer, the past input/output data is used within a Robust Moving Horizon Estimation (RMHE) scheme to compute (tight) bounds on the current state. These current state bounds are then used within the RMPC control algorithm. To reduce conservatism, the output-feedback control gain and control perturbation are both explicitly considered as decision variables in the online LMI optimization. Finally, the aforementioned robust control strategies are applied in an industrial directional drilling configuration and their performance is illustrated by simulations. A rotary steerable system (RSS) is a drilling technology that has been extensively studied over the last 20 years in hydrocarbon exploration and is used to drill complex curved borehole trajectories. RSSs are commonly treated as dynamic robotic actuator systems, driven by a reference signal and typically controlled by using a feedback loop control law. However, due to spatial delays, parametric uncertainties, and the presence of disturbances in such an unpredictable working environment, designing such control laws is not a straightforward process. Furthermore, due to their inherent delayed feedback, described by delay differential equations (DDE), directional drilling systems have the potential to become unstable given the requisite conditions. To address this problem, a simplified model described by ordinary differential equations (ODE) is first proposed, and then taking into account disturbances and system uncertainties that arise from design approximations, the proposed RMPC algorithm is used to automate the directional drilling system.Open Acces