Event-triggered near optimal adaptive control of interconnected systems

Increased interest in complex interconnected systems like smart-grid, cyber manufacturing have attracted researchers to develop optimal adaptive control schemes to elicit a desired performance when the complex system dynamics are uncertain. In this dissertation, motivated by the fact that aperiodic event sampling saves network resources while ensuring system stability, a suite of novel event-sampled distributed near-optimal adaptive control schemes are introduced for uncertain linear and affine nonlinear interconnected systems in a forward-in-time and online manner. First, a novel stochastic hybrid Q-learning scheme is proposed to generate optimal adaptive control law and to accelerate the learning process in the presence of random delays and packet losses resulting from the communication network for an uncertain linear interconnected system. Subsequently, a novel online reinforcement learning (RL) approach is proposed to solve the Hamilton-Jacobi-Bellman (HJB) equation by using neural networks (NNs) for generating distributed optimal control of nonlinear interconnected systems using state and output feedback. To relax the state vector measurements, distributed observers are introduced. Next, using RL, an improved NN learning rule is derived to solve the HJB equation for uncertain nonlinear interconnected systems with event-triggered feedback. Distributed NN identifiers are introduced both for approximating the uncertain nonlinear dynamics and to serve as a model for online exploration. Next, the control policy and the event-sampling errors are considered as non-cooperative players and a min-max optimization problem is formulated for linear and affine nonlinear systems by using zero-sum game approach for simultaneous optimization of both the control policy and the event based sampling instants. The net result is the development of optimal adaptive event-triggered control of uncertain dynamic systems --Abstract, page iv

Event-triggered consensus control for discrete-time stochastic multi-agent systems: The input-to-state stability in probability

This paper is concerned with the event-triggered consensus control problem for a class of discrete-time stochastic multi-agent systems with state-dependent noises. A novel definition of consensus in probability is proposed to better describe the dynamics of the consensus process of the addressed stochastic multiagent systems. The measurement output available for the controller is not only from the individual agent but also from its neighboring ones according to the given topology. An event-triggered mechanism is adopted with hope to reduce the communication burden, where the control input on each agent is updated only when a certain triggering condition is violated. The purpose of the problem under consideration is to design both the output feedback controller and the threshold of the triggering condition such that the closed-loop system achieves the desired consensus in probability. First of all, a theoretical framework is established for analyzing the so-called input-to-state stability in probability (ISSiP) for general discretetime nonlinear stochastic systems. Within such a theoretical framework, some sufficient conditions on event-triggered control protocol are derived under which the consensus in probability is reached. Furthermore, both the controller parameter and the triggering threshold are obtained in terms of the solution to certain matrix inequalities involving the topology information and the desired consensus probability. Finally, a simulation example is utilized to illustrate the usefulness of the proposed control protocol.Royal Society of the UK, the National Natural Science Foundation of China under Grants 61329301, 61203139 and 61473076, the Hujiang Foundation of China under Grants C14002 and D15009, the Shanghai Rising- Star Program of China under Grant 13QA1400100, the ShuGuang project of Shanghai Municipal Education Commission and Shanghai Education Development Foundation under Grant 13SG34, the Fundamental Research Funds for the Central Universities, DHU Distinguished Young Professor Program, and the Alexander von Humboldt Foundation of German

Time-and event-driven communication process for networked control systems: A survey

Copyright © 2014 Lei Zou et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.In recent years, theoretical and practical research topics on networked control systems (NCSs) have gained an increasing interest from many researchers in a variety of disciplines owing to the extensive applications of NCSs in practice. In particular, an urgent need has arisen to understand the effects of communication processes on system performances. Sampling and protocol are two fundamental aspects of a communication process which have attracted a great deal of research attention. Most research focus has been on the analysis and control of dynamical behaviors under certain sampling procedures and communication protocols. In this paper, we aim to survey some recent advances on the analysis and synthesis issues of NCSs with different sampling procedures (time-and event-driven sampling) and protocols (static and dynamic protocols). First, these sampling procedures and protocols are introduced in detail according to their engineering backgrounds as well as dynamic natures. Then, the developments of the stabilization, control, and filtering problems are systematically reviewed and discussed in great detail. Finally, we conclude the paper by outlining future research challenges for analysis and synthesis problems of NCSs with different communication processes.This work was supported in part by the National Natural Science Foundation of China under Grants 61329301, 61374127, and 61374010, the Royal Society of the UK, and the Alexander von Humboldt Foundation of Germany

Event-Based H∞ filter design for a class of nonlinear time-varying systems with fading channels and multiplicative noises

In this paper, a general event-triggered framework is developed to deal with the finite-horizon H∞ filtering problem for discrete time-varying systems with fading channels, randomly occurring nonlinearities and multiplicative noises. An event indicator variable is constructed and the corresponding event-triggered scheme is proposed. Such a scheme is based on the relative error with respect to the measurement signal in order to determine whether the measurement output should be transmitted to the filter or not. The fading channels are described by modified stochastic Rice fading models. Some uncorrelated random variables are introduced, respectively, to govern the phenomena of state-multiplicative noises, randomly occurring nonlinearities as well as fading measurements. The purpose of the addressed problem is to design a set of time-varying filter such that the influence from the exogenous disturbances onto the filtering errors is attenuated at the given level quantified by a H∞ norm in the mean-square sense. By utilizing stochastic analysis techniques, sufficient conditions are established to ensure that the dynamic system under consideration satisfies the H∞ filtering performance constraint, and then a recursive linear matrix inequality (RLMI) approach is employed to design the desired filter gains. Simulation results demonstrate the effectiveness of the developed filter design scheme

Event-triggered distributed H∞ state estimation with packet dropouts through sensor networks

This study is concerned with the event-triggered distributed H∞ state estimation problem for a class of discrete-time stochastic non-linear systems with packet dropouts in a sensor network. An event-triggered communication mechanism is adopted over the sensor network with hope to reduce the communication burden and the energy consumption, where the measurements on each sensor are transmitted only when a certain triggering condition is violated. Furthermore, a novel distributed state estimator is designed where the available innovations are not only from the individual sensor, but also from its neighbouring ones according to the given topology. The purpose of the problem under consideration is to design a set of distributed state estimators such that the dynamics of estimation errors is exponentially mean-square stable and also the prespecified H∞ disturbance rejection attenuation level is guaranteed. By utilising the property of the Kronecker product and the stochastic analysis approaches, sufficient conditions are established under which the addressed state estimation problem is recast as a convex optimisation one that can be easily solved via available software packages. Finally, a simulation example is utilised to illustrate the usefulness of the proposed design scheme of event-triggered distributed state estimators.This work was supported in part by Royal Society of the UK, the National Natural Science Foundation of China under Grants 61329301, 61203139, 61473076, 61374127 and 61422301, the Shanghai Rising-Star Program of China under Grant 13QA1400100, the ShuGuang project of Shanghai Municipal Education Commission and Shanghai Education Development Foundation under Grant 13SG34, the Fundamental Research Funds for the Central Universities, DHU Distinguished Young Professor Program, and the Alexander von Humboldt Foundation of Germany

On general systems with network-enhanced complexities

In recent years, the study of networked control systems (NCSs) has gradually become an active research area due to the advantages of using networked media in many aspects such as the ease of maintenance and installation, the large flexibility and the low cost. It is well known that the devices in networks are mutually connected via communication cables that are of limited capacity. Therefore, some network-induced phenomena have inevitably emerged in the areas of signal processing and control engineering. These phenomena include, but are not limited to, network-induced communication delays, missing data, signal quantization, saturations, and channel fading. It is of great importance to understand how these phenomena influence the closed-loop stability and performance properties

Performance analysis with network-enhanced complexities: On fading measurements, event-triggered mechanisms, and cyber attacks

Copyright © 2014 Derui Ding et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.Nowadays, the real-world systems are usually subject to various complexities such as parameter uncertainties, time-delays, and nonlinear disturbances. For networked systems, especially large-scale systems such as multiagent systems and systems over sensor networks, the complexities are inevitably enhanced in terms of their degrees or intensities because of the usage of the communication networks. Therefore, it would be interesting to (1) examine how this kind of network-enhanced complexities affects the control or filtering performance; and (2) develop some suitable approaches for controller/filter design problems. In this paper, we aim to survey some recent advances on the performance analysis and synthesis with three sorts of fashionable network-enhanced complexities, namely, fading measurements, event-triggered mechanisms, and attack behaviors of adversaries. First, these three kinds of complexities are introduced in detail according to their engineering backgrounds, dynamical characteristic, and modelling techniques. Then, the developments of the performance analysis and synthesis issues for various networked systems are systematically reviewed. Furthermore, some challenges are illustrated by using a thorough literature review and some possible future research directions are highlighted.This work was supported in part by the National Natural Science Foundation of China under Grants 61134009, 61329301, 61203139, 61374127, and 61374010, the Royal Society of the UK, and the Alexander von Humboldt Foundation of Germany

Event-triggered robust distributed state estimation for sensor networks with state-dependent noises

This paper is concerned with the event-triggered distributed state estimation problem for a class of uncertain stochastic systems with state-dependent noises and randomly occurring uncertainties over sensor networks. An event-triggered communication scheme is proposed in order to determine whether the measurements on each sensor should be transmitted to the estimators or not. The norm-bounded uncertainty enters into the system in a random way. Through available output measurements from not only the individual sensor but also its neighbouring sensors, a sufficient condition is established for the desired distributed estimator to ensure that the estimation error dynamics are exponentially mean-square stable. These conditions are characterized in terms of the feasibility of a set of linear matrix inequalities, and then the explicit expression is given for the distributed estimator gains. Finally, a simulation example is provided to show the effectiveness of the proposed event-triggered distributed state estimation scheme.This work was supported in part by the Deanship of Scientific Research (DSR) at King Abdulaziz University of Saudi Arabia under Grant 16-135-35-HiCi, the National Natural Science Foundation of China under Grants 61374127 and 61329301, the Scientific and Technology Research Foundation of Heilongjiang Education Department of China under Grant 12541061 and 12511014, and the Alexander von Humboldt Foundation of Germany