Event-triggered near optimal adaptive control of interconnected systems

Increased interest in complex interconnected systems like smart-grid, cyber manufacturing have attracted researchers to develop optimal adaptive control schemes to elicit a desired performance when the complex system dynamics are uncertain. In this dissertation, motivated by the fact that aperiodic event sampling saves network resources while ensuring system stability, a suite of novel event-sampled distributed near-optimal adaptive control schemes are introduced for uncertain linear and affine nonlinear interconnected systems in a forward-in-time and online manner. First, a novel stochastic hybrid Q-learning scheme is proposed to generate optimal adaptive control law and to accelerate the learning process in the presence of random delays and packet losses resulting from the communication network for an uncertain linear interconnected system. Subsequently, a novel online reinforcement learning (RL) approach is proposed to solve the Hamilton-Jacobi-Bellman (HJB) equation by using neural networks (NNs) for generating distributed optimal control of nonlinear interconnected systems using state and output feedback. To relax the state vector measurements, distributed observers are introduced. Next, using RL, an improved NN learning rule is derived to solve the HJB equation for uncertain nonlinear interconnected systems with event-triggered feedback. Distributed NN identifiers are introduced both for approximating the uncertain nonlinear dynamics and to serve as a model for online exploration. Next, the control policy and the event-sampling errors are considered as non-cooperative players and a min-max optimization problem is formulated for linear and affine nonlinear systems by using zero-sum game approach for simultaneous optimization of both the control policy and the event based sampling instants. The net result is the development of optimal adaptive event-triggered control of uncertain dynamic systems --Abstract, page iv

Time-and event-driven communication process for networked control systems: A survey

Copyright © 2014 Lei Zou et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.In recent years, theoretical and practical research topics on networked control systems (NCSs) have gained an increasing interest from many researchers in a variety of disciplines owing to the extensive applications of NCSs in practice. In particular, an urgent need has arisen to understand the effects of communication processes on system performances. Sampling and protocol are two fundamental aspects of a communication process which have attracted a great deal of research attention. Most research focus has been on the analysis and control of dynamical behaviors under certain sampling procedures and communication protocols. In this paper, we aim to survey some recent advances on the analysis and synthesis issues of NCSs with different sampling procedures (time-and event-driven sampling) and protocols (static and dynamic protocols). First, these sampling procedures and protocols are introduced in detail according to their engineering backgrounds as well as dynamic natures. Then, the developments of the stabilization, control, and filtering problems are systematically reviewed and discussed in great detail. Finally, we conclude the paper by outlining future research challenges for analysis and synthesis problems of NCSs with different communication processes.This work was supported in part by the National Natural Science Foundation of China under Grants 61329301, 61374127, and 61374010, the Royal Society of the UK, and the Alexander von Humboldt Foundation of Germany

Dynamic event-triggered-based human-in-the-loop formation control for stochastic nonlinear MASs

The dynamic event-triggered (DET) formation control problem of a class of stochastic nonlinear multi-agent systems (MASs) with full state constraints is investigated in this article. Supposing that the human operator sends commands to the leader as control input signals, all followers keep formation through network topology communication. Under the command-filter-based backstepping technique, the radial basis function neural networks (RBF NNs) and the barrier Lyapunov function (BLF) are utilized to resolve the problems of unknown nonlinear terms and full state constraints, respectively. Furthermore, a DET control mechanism is proposed to reduce the occupation of communication bandwidth. The presented distributed formation control strategy guarantees that all signals of the MASs are semi-globally uniformly ultimately bounded (SGUUB) in probability. Finally, the feasibility of the theoretical research result is demonstrated by a simulation example

Event-Based H∞ filter design for a class of nonlinear time-varying systems with fading channels and multiplicative noises

In this paper, a general event-triggered framework is developed to deal with the finite-horizon H∞ filtering problem for discrete time-varying systems with fading channels, randomly occurring nonlinearities and multiplicative noises. An event indicator variable is constructed and the corresponding event-triggered scheme is proposed. Such a scheme is based on the relative error with respect to the measurement signal in order to determine whether the measurement output should be transmitted to the filter or not. The fading channels are described by modified stochastic Rice fading models. Some uncorrelated random variables are introduced, respectively, to govern the phenomena of state-multiplicative noises, randomly occurring nonlinearities as well as fading measurements. The purpose of the addressed problem is to design a set of time-varying filter such that the influence from the exogenous disturbances onto the filtering errors is attenuated at the given level quantified by a H∞ norm in the mean-square sense. By utilizing stochastic analysis techniques, sufficient conditions are established to ensure that the dynamic system under consideration satisfies the H∞ filtering performance constraint, and then a recursive linear matrix inequality (RLMI) approach is employed to design the desired filter gains. Simulation results demonstrate the effectiveness of the developed filter design scheme

Analysis, filtering, and control for Takagi-Sugeno fuzzy models in networked systems

Copyright © 2015 Sunjie Zhang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.The fuzzy logic theory has been proven to be effective in dealing with various nonlinear systems and has a great success in industry applications. Among different kinds of models for fuzzy systems, the so-called Takagi-Sugeno (T-S) fuzzy model has been quite popular due to its convenient and simple dynamic structure as well as its capability of approximating any smooth nonlinear function to any specified accuracy within any compact set. In terms of such a model, the performance analysis and the design of controllers and filters play important roles in the research of fuzzy systems. In this paper, we aim to survey some recent advances on the T-S fuzzy control and filtering problems with various network-induced phenomena. The network-induced phenomena under consideration mainly include communication delays, packet dropouts, signal quantization, and randomly occurring uncertainties (ROUs). With such network-induced phenomena, the developments on T-S fuzzy control and filtering issues are reviewed in detail. In addition, some latest results on this topic are highlighted. In the end, conclusions are drawn and some possible future research directions are pointed out.This work was supported in part by the National Natural Science Foundation of China under Grants 61134009, 61329301, 11301118 and 61174136, the Natural Science Foundation of Jiangsu Province of China under Grant BK20130017, the Fundamental Research Funds for the Central Universities of China under Grant CUSF-DH-D-2013061, the Royal Society of the U.K., and the Alexander von Humboldt Foundation of Germany

Event-triggered distributed H∞ state estimation with packet dropouts through sensor networks

This study is concerned with the event-triggered distributed H∞ state estimation problem for a class of discrete-time stochastic non-linear systems with packet dropouts in a sensor network. An event-triggered communication mechanism is adopted over the sensor network with hope to reduce the communication burden and the energy consumption, where the measurements on each sensor are transmitted only when a certain triggering condition is violated. Furthermore, a novel distributed state estimator is designed where the available innovations are not only from the individual sensor, but also from its neighbouring ones according to the given topology. The purpose of the problem under consideration is to design a set of distributed state estimators such that the dynamics of estimation errors is exponentially mean-square stable and also the prespecified H∞ disturbance rejection attenuation level is guaranteed. By utilising the property of the Kronecker product and the stochastic analysis approaches, sufficient conditions are established under which the addressed state estimation problem is recast as a convex optimisation one that can be easily solved via available software packages. Finally, a simulation example is utilised to illustrate the usefulness of the proposed design scheme of event-triggered distributed state estimators.This work was supported in part by Royal Society of the UK, the National Natural Science Foundation of China under Grants 61329301, 61203139, 61473076, 61374127 and 61422301, the Shanghai Rising-Star Program of China under Grant 13QA1400100, the ShuGuang project of Shanghai Municipal Education Commission and Shanghai Education Development Foundation under Grant 13SG34, the Fundamental Research Funds for the Central Universities, DHU Distinguished Young Professor Program, and the Alexander von Humboldt Foundation of Germany

Method And System For Dynamic Stochastic Optimal Electric Power Flow Control

A dynamic stochastic optimal power flow (DSOPF) control system is described for performing multi-objective optimal control capability in complex electrical power systems. The DSOPF system and method replaces the traditional adaptive critic designs (ACDs) and secondary voltage control, and provides a coordinated AC power flow control solution to the smart grid operation in an environment with high short-term uncertainty and variability. The DSOPF system and method is used to provide nonlinear optimal control, where the control objective is explicitly formulated to incorporate power system economy, stability and security considerations. The system and method dynamically drives a power system to its optimal operating point by continuously adjusting the steady-state set points sent by a traditional optimal power flow algorithm.Clemson UniversityGeorgia Tech Research CorporationThe Curators Of The University Of Missour