Stochastic Event-Based Control and Estimation

Digital controllers are traditionally implemented using periodic sampling, computation, and actuation events. As more control systems are implemented to share limited network and CPU bandwidth with other tasks, it is becoming increasingly attractive to use some form of event-based control instead, where precious events are used only when needed. Forms of event-based control have been used in practice for a very long time, but mostly in an ad-hoc way. Though optimal solutions to most event-based control problems are unknown, it should still be viable to compare performance between suggested approaches in a reasonable manner. This thesis investigates an event-based variation on the stochastic linear-quadratic (LQ) control problem, with a fixed cost per control event. The sporadic constraint of an enforced minimum inter-event time is introduced, yielding a mixed continuous-/discrete-time formulation. The quantitative trade-off between event rate and control performance is compared between periodic and sporadic control. Example problems for first-order plants are investigated, for a single control loop and for multiple loops closed over a shared medium. Path constraints are introduced to model and analyze higher-order event-based control systems. This component-based approach to stochastic hybrid systems allows to express continuous- and discrete-time dynamics, state and switching constraints, control laws, and stochastic disturbances in the same model. Sum-of-squares techniques are then used to find bounds on control objectives using convex semidefinite programming. The thesis also considers state estimation for discrete time linear stochastic systems from measurements with convex set uncertainty. The Bayesian observer is considered given log-concave process disturbances and measurement likelihoods. Strong log-concavity is introduced, and it is shown that the observer preserves log-concavity, and propagates strong log-concavity like inverse covariance in a Kalman filter. A recursive state estimator is developed for systems with both stochastic and set-bounded process and measurement noise terms. A time-varying linear filter gain is optimized using convex semidefinite programming and ellipsoidal over-approximation, given a relative weight on the two kinds of error

Event-Based State Estimation Using an Improved Stochastic Send-on-Delta Sampling Scheme

Event-based sensing and communication holds the promise of lower resource utilization and/or better performance for remote state estimation applications found in e.g. networked control systems. Recently, stochastic event-triggering rules have been proposed as a means to avoid the complexity of the problem that normally arises in event-based estimator design. By using a scaled Gaussian function in the stochastic triggering scheme, the optimal remote state estimator becomes a linear Kalman filter with a case dependent measurement update. In this paper we propose a modified version of the stochastic send-on-delta triggering rule. The idea is to use a very simple predictor in the sensor, which allows the communication rate to be reduced while preserving estimation performance compared to regular stochastic send-on-delta sampling. We derive the optimal mean-square error estimator for the new scheme and present upper and lower bounds on the error covariance. The proposed scheme is evaluated in numerical examples, where it compares favorably to previous stochastic sampling approaches, and is shown to preserve estimation performance well even at large reductions in communication rate

Event-triggered near optimal adaptive control of interconnected systems

Increased interest in complex interconnected systems like smart-grid, cyber manufacturing have attracted researchers to develop optimal adaptive control schemes to elicit a desired performance when the complex system dynamics are uncertain. In this dissertation, motivated by the fact that aperiodic event sampling saves network resources while ensuring system stability, a suite of novel event-sampled distributed near-optimal adaptive control schemes are introduced for uncertain linear and affine nonlinear interconnected systems in a forward-in-time and online manner. First, a novel stochastic hybrid Q-learning scheme is proposed to generate optimal adaptive control law and to accelerate the learning process in the presence of random delays and packet losses resulting from the communication network for an uncertain linear interconnected system. Subsequently, a novel online reinforcement learning (RL) approach is proposed to solve the Hamilton-Jacobi-Bellman (HJB) equation by using neural networks (NNs) for generating distributed optimal control of nonlinear interconnected systems using state and output feedback. To relax the state vector measurements, distributed observers are introduced. Next, using RL, an improved NN learning rule is derived to solve the HJB equation for uncertain nonlinear interconnected systems with event-triggered feedback. Distributed NN identifiers are introduced both for approximating the uncertain nonlinear dynamics and to serve as a model for online exploration. Next, the control policy and the event-sampling errors are considered as non-cooperative players and a min-max optimization problem is formulated for linear and affine nonlinear systems by using zero-sum game approach for simultaneous optimization of both the control policy and the event based sampling instants. The net result is the development of optimal adaptive event-triggered control of uncertain dynamic systems --Abstract, page iv

Design of Event-Triggered Fault-Tolerant Control for Stochastic Systems with Time-Delays

This paper proposes two novel, event-triggered fault-tolerant control strategies for a class of stochastic systems with state delays. The plant is disturbed by a Gaussian process, actuator faults, and unknown disturbances. First, a special case about fault signals that are coupled to the unknown disturbances is discussed, and then a fault-tolerant strategy is designed based on an event condition on system states. Subsequently, a send-on-delta transmission framework is established to deal with the problem of fault-tolerant control strategy against fault signals separated from the external disturbances. Two criteria are provided to design feedback controllers in order to guarantee that the systems are exponentially mean-square stable, and the corresponding H∞-norm disturbance attenuation levels are achieved. Two theorems were obtained by synthesizing the feedback control gains and the desired event conditions in terms of linear matrix inequalities (LMIs). Finally, two numerical examples are provided to illustrate the effectiveness of the proposed theoretical results

Stochastic DES Fault Diagnosis with Coloured Interpreted Petri Nets

[EN] This proposal presents an online method to detect and isolate faults in stochastic discrete event systems without previous model. A coloured timed interpreted Petri Net generates the normal behavior language after an identification stage.The next step is fault detection that is carried out by comparing the observed event sequences with the expected event sequences. Once a new fault is detected, a learning algorithm changes the structure of the diagnoser, so it is able to learn new fault languages. Moreover, the diagnoser includes timed events to represent and diagnose stochastic languages. Finally, this paper proposes a detectability condition for stochastic DES and the sufficient and necessary conditions are proved.This work was supported by a grant from the Universidad del Cauca, Reference 2.3-31.2/05 2011.Muñoz-Añasco, DM.; Correcher Salvador, A.; García Moreno, E.; Morant Anglada, FJ. (2015). Stochastic DES Fault Diagnosis with Coloured Interpreted Petri Nets. Mathematical Problems in Engineering. 2015:1-13. https://doi.org/10.1155/2015/303107S1132015Jiang, S., & Kumar, R. (2004). Failure Diagnosis of Discrete-Event Systems With Linear-Time Temporal Logic Specifications. IEEE Transactions on Automatic Control, 49(6), 934-945. doi:10.1109/tac.2004.829616Zaytoon, J., & Lafortune, S. (2013). Overview of fault diagnosis methods for Discrete Event Systems. Annual Reviews in Control, 37(2), 308-320. doi:10.1016/j.arcontrol.2013.09.009Sampath, M., Sengupta, R., Lafortune, S., Sinnamohideen, K., & Teneketzis, D. (1995). Diagnosability of discrete-event systems. IEEE Transactions on Automatic Control, 40(9), 1555-1575. doi:10.1109/9.412626Sampath, M., Sengupta, R., Lafortune, S., Sinnamohideen, K., & Teneketzis, D. C. (1996). Failure diagnosis using discrete-event models. IEEE Transactions on Control Systems Technology, 4(2), 105-124. doi:10.1109/87.486338Estrada-Vargas, A. P., López-Mellado, E., & Lesage, J.-J. (2010). A Comparative Analysis of Recent Identification Approaches for Discrete-Event Systems. Mathematical Problems in Engineering, 2010, 1-21. doi:10.1155/2010/453254Cabasino, M. P., Giua, A., & Seatzu, C. (2010). Fault detection for discrete event systems using Petri nets with unobservable transitions. Automatica, 46(9), 1531-1539. doi:10.1016/j.automatica.2010.06.013Prock, J. (1991). A new technique for fault detection using Petri nets. Automatica, 27(2), 239-245. doi:10.1016/0005-1098(91)90074-cAghasaryan, A., Fabre, E., Benveniste, A., Boubour, R., & Jard, C. (1998). Discrete Event Dynamic Systems, 8(2), 203-231. doi:10.1023/a:1008241818642Hadjicostis, C. N., & Verghese, G. C. (1999). Monitoring Discrete Event Systems Using Petri Net Embeddings. Application and Theory of Petri Nets 1999, 188-207. doi:10.1007/3-540-48745-x_12Benveniste, A., Fabre, E., Haar, S., & Jard, C. (2003). Diagnosis of asynchronous discrete-event systems: a net unfolding approach. IEEE Transactions on Automatic Control, 48(5), 714-727. doi:10.1109/tac.2003.811249Genc, S., & Lafortune, S. (2003). Distributed Diagnosis of Discrete-Event Systems Using Petri Nets. Lecture Notes in Computer Science, 316-336. doi:10.1007/3-540-44919-1_21Genc, S., & Lafortune, S. (2007). Distributed Diagnosis of Place-Bordered Petri Nets. IEEE Transactions on Automation Science and Engineering, 4(2), 206-219. doi:10.1109/tase.2006.879916Ramirez-Trevino, A., Ruiz-Beltran, E., Rivera-Rangel, I., & Lopez-Mellado, E. (2007). Online Fault Diagnosis of Discrete Event Systems. A Petri Net-Based Approach. IEEE Transactions on Automation Science and Engineering, 4(1), 31-39. doi:10.1109/tase.2006.872120Dotoli, M., Fanti, M. P., Mangini, A. M., & Ukovich, W. (2009). On-line fault detection in discrete event systems by Petri nets and integer linear programming. Automatica, 45(11), 2665-2672. doi:10.1016/j.automatica.2009.07.021Fanti, M. P., Mangini, A. M., & Ukovich, W. (2013). Fault Detection by Labeled Petri Nets in Centralized and Distributed Approaches. IEEE Transactions on Automation Science and Engineering, 10(2), 392-404. doi:10.1109/tase.2012.2203596Basile, F., Chiacchio, P., & De Tommasi, G. (2009). An Efficient Approach for Online Diagnosis of Discrete Event Systems. IEEE Transactions on Automatic Control, 54(4), 748-759. doi:10.1109/tac.2009.2014932Roth, M., Lesage, J.-J., & Litz, L. (2011). The concept of residuals for fault localization in discrete event systems. Control Engineering Practice, 19(9), 978-988. doi:10.1016/j.conengprac.2011.02.008Roth, M., Schneider, S., Lesage, J.-J., & Litz, L. (2012). Fault detection and isolation in manufacturing systems with an identified discrete event model. International Journal of Systems Science, 43(10), 1826-1841. doi:10.1080/00207721.2011.649369Chung-Hsien Kuo, & Han-Pang Huang. (2000). Failure modeling and process monitoring for flexible manufacturing systems using colored timed Petri nets. IEEE Transactions on Robotics and Automation, 16(3), 301-312. doi:10.1109/70.850648Ramirez-Trevino, A., Ruiz-Beltran, E., Aramburo-Lizarraga, J., & Lopez-Mellado, E. (2012). Structural Diagnosability of DES and Design of Reduced Petri Net Diagnosers. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 42(2), 416-429. doi:10.1109/tsmca.2011.2169950Cabasino, M. P., Giua, A., & Seatzu, C. (2014). Diagnosability of Discrete-Event Systems Using Labeled Petri Nets. IEEE Transactions on Automation Science and Engineering, 11(1), 144-153. doi:10.1109/tase.2013.2289360Yao, L., Feng, L., & Jiang, B. (2014). Fault Diagnosis and Fault Tolerant Control for Non-Gaussian Singular Time-Delayed Stochastic Distribution Systems. Mathematical Problems in Engineering, 2014, 1-9. doi:10.1155/2014/937583Murata, T. (1989). Petri nets: Properties, analysis and applications. Proceedings of the IEEE, 77(4), 541-580. doi:10.1109/5.24143Dotoli, M., Fanti, M. P., & Mangini, A. M. (2008). Real time identification of discrete event systems using Petri nets. Automatica, 44(5), 1209-1219. doi:10.1016/j.automatica.2007.10.014Muñoz, D. M., Correcher, A., García, E., & Morant, F. (2014). Identification of Stochastic Timed Discrete Event Systems with st-IPN. Mathematical Problems in Engineering, 2014, 1-21. doi:10.1155/2014/835312Latorre-Biel, J.-I., Jiménez-Macías, E., Pérez de la Parte, M., Blanco-Fernández, J., & Martínez-Cámara, E. (2014). Control of Discrete Event Systems by Means of Discrete Optimization and Disjunctive Colored PNs: Application to Manufacturing Facilities. Abstract and Applied Analysis, 2014, 1-16. doi:10.1155/2014/821707Cabasino, M. P., Giua, A., Lafortune, S., & Seatzu, C. (2012). A New Approach for Diagnosability Analysis of Petri Nets Using Verifier Nets. IEEE Transactions on Automatic Control, 57(12), 3104-3117. doi:10.1109/tac.2012.2200372Abdelwahed, S., Karsai, G., Mahadevan, N., & Ofsthun, S. C. (2009). Practical Implementation of Diagnosis Systems Using Timed Failure Propagation Graph Models. IEEE Transactions on Instrumentation and Measurement, 58(2), 240-247. doi:10.1109/tim.2008.200595

Event-Based Control and Estimation with Stochastic Disturbances

This thesis deals with event-based control and estimation strategies, motivated by certain bottlenecks in the control loop. Two kinds of implementation constraints are considered: closing one or several control loops over a data network, and sensors that report measurements only as intervals (e.g. with quantization). The proposed strategies depend critically on _events_, when a data packet is sent or when a change in the measurement signal is received. The value of events is that they communicate new information about stochastic process disturbances. A data network in the control loop imposes constraints on the event timing, modelled as a minimum time between packets. A thresholdbased control strategy is suggested and shown to be optimal for firstorder systems with impulse control. Different ways to find the optimal threshold are investigated for single and multiple control loops sharing one network. The major gain compared to linear time invariant (LTI) control is with a single loop a greatly reduced communication rate, which with multiple loops can be traded for a similarly reduced regulation error. With the bottleneck that sensors report only intervals, both the theoretical and practical control problems become more complex. We focus on the estimation problem, where the optimal solution is known but untractable. Two simplifications are explored to find a realistic state estimator: reformulation to a mixed stochastic/worst case scenario and joint maximum a posteriori estimation. The latter approach is simplified and evaluated experimentally on a moving cart with quantized position measurements controlled by a low-end microcontroller. The examples considered demonstrate that event-based control considerably outperforms LTI control, when the bottleneck addressed is a genuine performance constraint on the latter

Computer implementation of Mason\u27s rule and software development of stochastic petri nets

A symbolic performance analysis approach for discrete event systems can be formulated based on the integration of Petri nets and Moment Generating Function concepts [1-3]. The key steps in the method include modeling a system with arbitrary stochastic Petri nets (ASPN), generation of state machine Petri nets with transfer functions, derivation of equivalent transfer functions, and symbolic derivation of transfer functions to obtain the performance measures. Since Mason\u27s rule can be used to effectively derive the closed-form transfer function, its computer implementation plays a very important role in automating the above procedure. This thesis develops the computer implementation of Mason\u27s rule (CIMR). The algorithms and their complexity analysis are also given. Examples are used to illustrate CIMR method\u27s application for performance evaluation of ASPN and linear control systems. Finally, suggestions for future software development of ASPN are made

Extended Dissipative Filter for Delayed T-S Fuzzy Network of Stochastic System with Packet Loss

This research investigates a time-varying delay-based adaptive event-triggered dissipative filtering problem for the interval type-2 (IT-2) Takagi-Sugeno (T-S) fuzzy networked stochastic system. The concept of extended dissipativity is used to solve the ,  and dissipative performances for (IT-2) T-S fuzzy stochastic systems in a unified manner. Data packet failures and latency difficulties are taken into account while designing fuzzy filters. An adaptive event-triggered mechanism is presented to efficiently control network resources and minimise excessive continuous monitoring while assuring the system’s efficiency with extended dissipativity. A new adaptive event triggering scheme is proposed which depends on the dynamic error rather than pre-determined constant threshold. A new fuzzy stochastic Lyapunov-Krasovskii Functional (LKF) using fuzzy matrices with higher order integrals is built based on the Lyapunov stability principle for mode-dependent filters. Solvability of such LKF leads to the formation of appropriate conditions in the form of linear matrix inequalities, ensuring that the resulting error mechanism is stable. In order to highlight the utility and perfection of the proposed technique, an example is presented

Event-based security control for discrete-time stochastic systems

This study is concerned with the event-based security control problem for a class of discrete-time stochastic systems with multiplicative noises subject to both randomly occurring denial-of-service (DoS) attacks and randomly occurring deception attacks. An event-triggered mechanism is adopted with hope to reduce the communication burden, where the measurement signal is transmitted only when a certain triggering condition is violated. A novel attack model is proposed to reflect the randomly occurring behaviours of the DoS attacks as well as the deception attacks within a unified framework via two sets of Bernoulli distributed white sequences with known conditional probabilities. A new concept of mean-square security domain is put forward to quantify the security degree. The authors aim to design an output feedback controller such that the closed-loop system achieves the desired security. By using the stochastic analysis techniques, some sufficient conditions are established to guarantee the desired security requirement and the control gain is obtained by solving some linear matrix inequalities with nonlinear constraints. A simulation example is utilised to illustrate the usefulness of the proposed controller design scheme.This work was supported in part by Royal Society of the UK, the National Natural Science Foundation of China under Grants 61329301, 61573246 and 61374039, the Shanghai Rising-Star Programme of China under Grant 16QA1403000, the Program for Capability Construction of Shanghai Provincial Universities under Grant 15550502500 and the Alexander von Humboldt Foundation of Germany