Decentralized Optimal Control With Application In Power System

An output-feedback decentralized optimal controller is proposed for power systems with renewable energy penetration. Renewable energy source is modeled similar to the classical generator model and is equipped with the unified power flow controller (UPFC). The transient performance of power system is considered and stability of the dynamical states are investigated. An offline decentralized optimal controller is designed that utilizes only the local states. The network comprises conventional synchronous generators as well as renewable sources with inverter equipped with UPFC. Subsequently, the optimal decentralized controller is compared to the initial stabilizing controller used to obtain the optimal controller. An online decentralized optimal controller is designed for discrete-time system. Two neuro networks are utilized to estimate value function and optimal control strategy. Furthermore, a novel observer-based decentralized optimal controller is developed on small scale discrete-time power system. The system is trained followed by least square rules and successive approximation. Simulation results on IEEE 14-, 30-, and 118-bus power system benchmarks shows satisfactory performance of the online decentralized controller. And also, simulation results demonstrate great performance of the observer and the optimal controller compare to the centralized optimal controller

Event-triggered robust control for multi-player nonzero-sum games with input constraints and mismatched uncertainties

In this article, an event-triggered robust control (ETRC) method is investigated for multi-player nonzero-sum games of continuous-time input constrained nonlinear systems with mismatched uncertainties. By constructing an auxiliary system and designing an appropriate value function, the robust control problem of input constrained nonlinear systems is transformed into an optimal regulation problem. Then, a critic neural network (NN) is adopted to approximate the value function of each player for solving the event-triggered coupled Hamilton-Jacobi equation and obtaining control laws. Based on a designed event-triggering condition, control laws are updated when events occur only. Thus, both computational burden and communication bandwidth are reduced. We prove that the weight approximation errors of critic NNs and the closed-loop uncertain multi-player system states are all uniformly ultimately bounded thanks to the Lyapunov's direct method. Finally, two examples are provided to demonstrate the effectiveness of the developed ETRC method

Decentralised State Feedback Tracking Control for Large-Scale Interconnected Systems Using Sliding Mode Techniques

A class of large-scale interconnected systems with matched and unmatched uncertainties is studied in this thesis, with the objective of proposing a controller based on diffeomorphisms and some techniques to deal with the tracking problem of the system. The main research developed in this thesis includes: 1. Large-scale interconnected system is a complex system consisting of several semi-independent subsystems, which are typically located in distinct geographic or logical locations. In this situation, decentralised control which only collects the local information is the practical method to deal with large-scale interconnected systems. The decentralised methodology is utilised throughout this thesis, guaranteeing that systems exhibit essential robustness against uncertainty. 2. Sliding mode technique is involved in the process of controller design. By introducing a nonsingular local diffeomorphism, the large-scale system can be transformed into a system with a specific regular form, where the matched uncertainty is completely absent from the subspace spanned by the sliding mode dynamics. The sliding mode based controller is proposed in this thesis to successfully achieve high robustness of the closed-loop interconnected systems with some particular uncertainties. 3. The considered large-scale interconnected systems can always track the smooth desired signals in a finite time. Each subsystem can track its own ideal signal or all subsystems can track the same ideal signal. Both situations are discussed in this thesis and the results are mathematically proven by introducing the Lyapunov theory, even when operating under the presence of disturbances. At the end of each chapter, some simulation examples, like a coupled inverted pendulums system, a river pollution system and a high-speed train system, are presented to verify the correctness of the proposed theory. At the conclusion of this thesis, a brief summary of the research findings has been provided, along with a mention of potential future research directions in tracking control of large-scale systems, like more general boundedness of interconnections, possibilities of distributed control, collaboration with intelligent control and so on. Some mathematical theories involved and simulation code are included in the appendix section

Adaptive and learning-based formation control of swarm robots

Autonomous aerial and wheeled mobile robots play a major role in tasks such as search and rescue, transportation, monitoring, and inspection. However, these operations are faced with a few open challenges including robust autonomy, and adaptive coordination based on the environment and operating conditions, particularly in swarm robots with limited communication and perception capabilities. Furthermore, the computational complexity increases exponentially with the number of robots in the swarm. This thesis examines two different aspects of the formation control problem. On the one hand, we investigate how formation could be performed by swarm robots with limited communication and perception (e.g., Crazyflie nano quadrotor). On the other hand, we explore human-swarm interaction (HSI) and different shared-control mechanisms between human and swarm robots (e.g., BristleBot) for artistic creation. In particular, we combine bio-inspired (i.e., flocking, foraging) techniques with learning-based control strategies (using artificial neural networks) for adaptive control of multi- robots. We first review how learning-based control and networked dynamical systems can be used to assign distributed and decentralized policies to individual robots such that the desired formation emerges from their collective behavior. We proceed by presenting a novel flocking control for UAV swarm using deep reinforcement learning. We formulate the flocking formation problem as a partially observable Markov decision process (POMDP), and consider a leader-follower configuration, where consensus among all UAVs is used to train a shared control policy, and each UAV performs actions based on the local information it collects. In addition, to avoid collision among UAVs and guarantee flocking and navigation, a reward function is added with the global flocking maintenance, mutual reward, and a collision penalty. We adapt deep deterministic policy gradient (DDPG) with centralized training and decentralized execution to obtain the flocking control policy using actor-critic networks and a global state space matrix. In the context of swarm robotics in arts, we investigate how the formation paradigm can serve as an interaction modality for artists to aesthetically utilize swarms. In particular, we explore particle swarm optimization (PSO) and random walk to control the communication between a team of robots with swarming behavior for musical creation

System structure based decentralized sliding mode output tracking control for nonlinear interconnected systems

In this article, a decentralized tracking control scheme is proposed for a class of nonlinear interconnected systems with uncertainties using sliding mode technique. Both matched nonlinear uncertainty and mismatched known nonlinear interconnections are considered. Under the condition that the nominal isolated subsystems have relative degrees, a geometric transformation is applied to transfer the interconnected system into a new nonlinear interconnected system with a special structure to facilitate the system analysis and design. Then, a composite sliding surface is designed in terms of tracking errors, and decentralized controllers are proposed to drive the system states to the designed sliding surface in finite time and maintain a sliding motion on it thereafter. A set of conditions are developed to guarantee that the output tracking errors converge to zero asymptotically while all system state variables are bounded. The considered interconnected systems are nonlinear and it is not required that either the isolated subsystems or the isolated nominal subsystems are linearizable. The desired output signals are allowed to be time-varying. Finally, the developed results are applied to an inverted coupled-pendulum system. Simulation demonstrates that the proposed control scheme is effective