Optimal adaptive control of time-delay dynamical systems with known and uncertain dynamics

Delays are found in many industrial pneumatic and hydraulic systems, and as a result, the performance of the overall closed-loop system deteriorates unless they are explicitly accounted. It is also possible that the dynamics of such systems are uncertain. On the other hand, optimal control of time-delay systems in the presence of known and uncertain dynamics by using state and output feedback is of paramount importance. Therefore, in this research, a suite of novel optimal adaptive control (OAC) techniques are undertaken for linear and nonlinear continuous time-delay systems in the presence of uncertain system dynamics using state and/or output feedback. First, the optimal regulation of linear continuous-time systems with state and input delays by utilizing a quadratic cost function over infinite horizon is addressed using state and output feedback. Next, the optimal adaptive regulation is extended to uncertain linear continuous-time systems under a mild assumption that the bounds on system matrices are known. Subsequently, the event-triggered optimal adaptive regulation of partially unknown linear continuous time systems with state-delay is addressed by using integral reinforcement learning (IRL). It is demonstrated that the optimal control policy renders asymptotic stability of the closed-loop system provided the linear time-delayed system is controllable and observable. The proposed event-triggered approach relaxed the need for continuous availability of state vector and proven to be zeno-free. Finally, the OAC using IRL neural network based control of uncertain nonlinear time-delay systems with input and state delays is investigated. An identifier is proposed for nonlinear time-delay systems to approximate the system dynamics and relax the need for the control coefficient matrix in generating the control policy. Lyapunov analysis is utilized to design the optimal adaptive controller, derive parameter/weight tuning law and verify stability of the closed-loop system”--Abstract, page iv

Realizable optimal control for a remotely piloted research vehicle

The design of a control system using the linear-quadratic regulator (LQR) control law theory for time invariant systems in conjunction with an incremental gradient procedure is presented. The incremental gradient technique reduces the full-state feedback controller design, generated by the LQR algorithm, to a realizable design. With a realizable controller, the feedback gains are based only on the available system outputs instead of being based on the full-state outputs. The design is for a remotely piloted research vehicle (RPRV) stability augmentation system. The design includes methods for accounting for noisy measurements, discrete controls with zero-order-hold outputs, and computational delay errors. Results from simulation studies of the response of the RPRV to a step in the elevator and frequency analysis techniques are included to illustrate these abnormalities and their influence on the controller design

Robustness analysis of discrete predictor-based controllers for input-delay systems

In this article, robustness to model uncertainties are analysed in the context of discrete predictor-based state-feedback controllers for discrete-time input-delay systems with time-varying delay, in an LMI framework. The goal is comparing robustness of predictor-based strategies with respect to other (sub)optimal state feedback ones. A numerical example illustrates that improvements in tolerance to modelling errors can be achieved by using the predictor framework.The authors are grateful for grant nos. DPI2008-06737-C02-01, DPI2008-06731-C02-01, DPI2011-27845-C02-01 and PROMETEO/2008/088 from the Spanish and Valencian governments.González Sorribes, A.; Sala, A.; García Gil, PJ.; Albertos Pérez, P. (2013). Robustness analysis of discrete predictor-based controllers for input-delay systems. International Journal of Systems Science. 44(2):232-239. https://doi.org/10.1080/00207721.2011.600469S232239442Boukas, E.-K. (2006). Discrete-time systems with time-varying time delay: Stability and stabilizability. Mathematical Problems in Engineering, 2006, 1-10. doi:10.1155/mpe/2006/42489Du, D., Jiang, B., & Zhou, S. (2008). Delay-dependent robust stabilisation of uncertain discrete-time switched systems with time-varying state delay. International Journal of Systems Science, 39(3), 305-313. doi:10.1080/00207720701805982El Ghaoui, L., Oustry, F., & AitRami, M. (1997). A cone complementarity linearization algorithm for static output-feedback and related problems. IEEE Transactions on Automatic Control, 42(8), 1171-1176. doi:10.1109/9.618250Gao, H., & Chen, T. (2007). New Results on Stability of Discrete-Time Systems With Time-Varying State Delay. IEEE Transactions on Automatic Control, 52(2), 328-334. doi:10.1109/tac.2006.890320Gao, H., Wang, C., Lam, J., & Wang, Y. (2004). Delay-dependent output-feedback stabilisation of discrete-time systems with time-varying state delay. IEE Proceedings - Control Theory and Applications, 151(6), 691-698. doi:10.1049/ip-cta:20040822Gao, H., Chen, T., & Lam, J. (2008). A new delay system approach to network-based control. Automatica, 44(1), 39-52. doi:10.1016/j.automatica.2007.04.020Garcia , P , Castillo , P , Lozano , R and Albertos , P . 2006 . Robustness with Respect to Delay Uncertainties of a Predictor Observer Based Discrete-time Controller . Proceeding of the 45th IEEE Conference on Decision and Control . 2006 . pp. 199 – 204 .Guo , Y and Li , S . 2009 . New Stability Criterion for Discrete-time Systems with Interval Time-varying State Delay . Joint 48th IEEE Conference on Decision and Control and 28th Chinese Control Conference . 2009 . pp. 1342 – 1347 .Hägglund, T. (1996). An industrial dead-time compensating PI controller. Control Engineering Practice, 4(6), 749-756. doi:10.1016/0967-0661(96)00065-2V.J.S. Leite, and Miranda, M.F. (2008), ‘Robust Stabilization of Discrete-time Systems with Time-varying Delay: An LMI Approach’,Mathematical Problems in Engineering, 2008, 15 pages (doi:10.1155/2008/875609)Liu, X. G., Tang, M. L., Martin, R. R., & Wu, M. (2006). Delay-dependent robust stabilisation of discrete-time systems with time-varying delay. IEE Proceedings - Control Theory and Applications, 153(6), 689-702. doi:10.1049/ip-cta:20050223Lozano, R., Castillo, P., Garcia, P., & Dzul, A. (2004). Robust prediction-based control for unstable delay systems: Application to the yaw control of a mini-helicopter. Automatica, 40(4), 603-612. doi:10.1016/j.automatica.2003.10.007Manitius, A., & Olbrot, A. (1979). Finite spectrum assignment problem for systems with delays. IEEE Transactions on Automatic Control, 24(4), 541-552. doi:10.1109/tac.1979.1102124Michiels, W., & Niculescu, S.-I. (2003). On the delay sensitivity of Smith Predictors. International Journal of Systems Science, 34(8-9), 543-551. doi:10.1080/00207720310001609057Palmor, Z.J. (1996), ‘Time-delay Compensation – Smith Predictor and Its Modifications’, inThe Control Handbook, ed. W.S. Levine, Boca Raton: CRC Press, pp. 224–237Pan, Y.-J., Marquez, H. J., & Chen, T. (2006). Stabilization of remote control systems with unknown time varying delays by LMI techniques. International Journal of Control, 79(7), 752-763. doi:10.1080/00207170600654554Richard, J.-P. (2003). Time-delay systems: an overview of some recent advances and open problems. Automatica, 39(10), 1667-1694. doi:10.1016/s0005-1098(03)00167-5Wang, Q.-G., Lee, T. H., & Tan, K. K. (1999). Finite-Spectrum Assignment for Time-Delay Systems. Lecture Notes in Control and Information Sciences. doi:10.1007/978-1-84628-531-8He, Y., Wu, M., Han, Q.-L., & She, J.-H. (2008). Delay-dependentH∞control of linear discrete-time systems with an interval-like time-varying delay. International Journal of Systems Science, 39(4), 427-436. doi:10.1080/00207720701832531Yue, D., & Han, Q.-L. (2005). Delayed feedback control of uncertain systems with time-varying input delay. Automatica, 41(2), 233-240. doi:10.1016/j.automatica.2004.09.006Zhang, B., Xu, S., & Zou, Y. (2008). Improved stability criterion and its applications in delayed controller design for discrete-time systems. Automatica, 44(11), 2963-2967. doi:10.1016/j.automatica.2008.04.01

Event-Triggered H

This paper deals with H∞ controller design problem for event-triggered networked control systems (NCSs), where the next task release time and finishing time are predicted based on the sampled states. A new model of NCSs that involves the network conditions, state, and event-triggered communication strategy is proposed. Based on this model, some novel criteria for the asymptotic stability analysis and H∞ state feedback controller design of the event-triggered NCSs with timevarying delay are established to guarantee a prescribed H∞ disturbance rejection attenuation level. Finally, a numerical example is provided to illustrate the effectiveness of the proposed method

Adaptive neural network state predictor and tracking control for nonlinear time-delay systems

A new adaptive nonlinear state predictor (ANSP) is presented for a class of unknown nonlinear systems with input time-delay. A dynamical identification with neu- ral network (NN) is constructed to obtain NN weights and their derivatives. The future NN weights are deduced for the nonlinear state predictor design without iterative calcu- lations. The time-delay and unknown nonlinearity are compensated by a feedback control using the predicted states. Rigorous stability analysis for the identification, predictor and feedback control are provided by means of Lyapunov criterion. Simulations and practical experiments of a temperature control system are included to verify the effectiveness of the proposed scheme.Postprint (published version

Integral partitioning approach to stability analysis and stabilization of distributed time delay systems

In this paper, the problems of delay-dependent stability analysis and stabilization are investigated for linear continuous-time systems with distributed delay. By introducing an integral partitioning technique, a new form of Lyapunov-Krasovskii functional (LKF) is constructed and improved distributed delay dependent stability conditions are established in terms of linear matrix inequalities (LMIs). Based on the criteria, a design algorithm for a state feedback controller is proposed. The results developed in this paper are less conservative than existing ones in the literature, which is illustrated by several examples. © 2011 IFAC.postprintThe 18th World Congress of the International Federation of Automatic Control (IFAC 2011), Milano, Italy, 28 August-2 September 2011. In Proceedings of the 18th IFAC World Congress, 2011, v. 18 pt. 1, p. 5094–509

Trust-based fault detection and robust fault-tolerant control of uncertain cyber-physical systems against time-delay injection attacks

Control systems need to be able to operate under uncertainty and especially under attacks. To address such challenges, this paper formulates the solution of robust control for uncertain systems under time-varying and unknown time-delay attacks in cyber-physical systems (CPSs). A novel control method able to deal with thwart time-delay attacks on closed-loop control systems is proposed. Using a descriptor model and an appropriate Lyapunov functional, sufficient conditions for closed-loop stability are derived based on linear matrix inequalities (LMIs). A design procedure is proposed to obtain an optimal state feedback control gain such that the uncertain system can be resistant under an injection time-delay attack with variable delay. Furthermore, various fault detection frameworks are proposed by following the dynamics of the measured data at the system's input and output using statistical analysis such as correlation analysis and K-L (Kullback-Leibler) divergence criteria to detect attack's existence and to prevent possible instability. Finally, an example is provided to evaluate the proposed design method's effectiveness