On stabilization of bilinear uncertain time-delay stochastic systems with Markovian jumping parameters

Copyright [2002] IEEE. This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way imply IEEE endorsement of any of Brunel University's products or services. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to [email protected]. By choosing to view this document, you agree to all provisions of the copyright laws protecting it.In this paper, we investigate the stochastic stabilization problem for a class of bilinear continuous time-delay uncertain systems with Markovian jumping parameters. Specifically, the stochastic bilinear jump system under study involves unknown state time-delay, parameter uncertainties, and unknown nonlinear deterministic disturbances. The jumping parameters considered here form a continuous-time discrete-state homogeneous Markov process. The whole system may be regarded as a stochastic bilinear hybrid system that includes both time-evolving and event-driven mechanisms. Our attention is focused on the design of a robust state-feedback controller such that, for all admissible uncertainties as well as nonlinear disturbances, the closed-loop system is stochastically exponentially stable in the mean square, independent of the time delay. Sufficient conditions are established to guarantee the existence of desired robust controllers, which are given in terms of the solutions to a set of either linear matrix inequalities (LMIs), or coupled quadratic matrix inequalities. The developed theory is illustrated by numerical simulatio

Static output-feedback stabilization of discrete-time Markovian jump linear systems: a system augmentation approach

This paper studies the static output-feedback (SOF) stabilization problem for discrete-time Markovian jump systems from a novel perspective. The closed-loop system is represented in a system augmentation form, in which input and gain-output matrices are separated. By virtue of the system augmentation, a novel necessary and sufficient condition for the existence of desired controllers is established in terms of a set of nonlinear matrix inequalities, which possess a monotonic structure for a linearized computation, and a convergent iteration algorithm is given to solve such inequalities. In addition, a special property of the feasible solutions enables one to further improve the solvability via a simple D-K type optimization on the initial values. An extension to mode-independent SOF stabilization is provided as well. Compared with some existing approaches to SOF synthesis, the proposed one has several advantages that make it specific for Markovian jump systems. The effectiveness and merit of the theoretical results are shown through some numerical example

Exponential filtering for uncertain Markovian jump time-delay systems with nonlinear disturbances

Copyright [2004] IEEE. This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way imply IEEE endorsement of any of Brunel University's products or services. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to [email protected]. By choosing to view this document, you agree to all provisions of the copyright laws protecting it.In this paper, we study the robust exponential filter design problem for a class of uncertain time-delay systems with both Markovian jumping parameters and nonlinear disturbances. The jumping parameters considered here are generated from a continuous-time discrete-state homogeneous Markov process, and the parameter uncertainties appearing in the state and output equations are real, time dependent, and norm bounded. The time-delay and the nonlinear disturbances are assumed to be unknown. The purpose of the problem under investigation is to design a linear, delay-free, uncertainty-independent state estimator such that, for all admissible uncertainties as well as nonlinear disturbances, the dynamics of the estimation error is stochastically exponentially stable in the mean square, independent of the time delay. We address both the filtering analysis and synthesis issues, and show that the problem of exponential filtering for the class of uncertain time-delay jump systems with nonlinear disturbances can be solved in terms of the solutions to a set of linear (quadratic) matrix inequalities. A numerical example is exploited to demonstrate the usefulness of the developed theory

Stochastic model predictive control for constrained networked control systems with random time delay

In this paper the continuous time stochastic constrained optimal control problem is formulated for the class of networked control systems assuming that time delays follow a discrete-time, finite Markov chain . Polytopic overapproximations of the system's trajectories are employed to produce a polyhedral inner approximation of the non-convex constraint set resulting from imposing the constraints in continuous time. The problem is cast in a Markov jump linear systems (MJLS) framework and a stochastic MPC controller is calculated explicitly, oine, coupling dynamic programming with parametric piecewise quadratic (PWQ) optimization. The calculated control law leads to stochastic stability of the closed loop system, in the mean square sense and respects the state and input constraints in continuous time

Robust filtering for discrete-time Markovian jump delay systems

Copyright [2004] IEEE. This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way imply IEEE endorsement of any of Brunel University's products or services. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to [email protected]. By choosing to view this document, you agree to all provisions of the copyright laws protecting it.In this letter, we study the robust filtering problem for linear uncertain discrete time-delay systems with Markovian jump parameters. The system under consideration is subjected to time-varying norm-bounded parameter uncertainties, time-delay in the state, and Markovian jump parameters in all system matrices. A filter is designed to guarantee that the dynamics of the estimation error is robustly stochastically stable in the mean square, irrespective of the admissible uncertainties as well as the time-delay. It is shown that the problem addressed can be solved in terms of the solutions to a set of coupled matrix Riccati-like inequalities

Nonlinear filtering for state delayed systems with Markovian switching

Copyright [2003] IEEE. This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way imply IEEE endorsement of any of Brunel University's products or services. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to [email protected]. By choosing to view this document, you agree to all provisions of the copyright laws protecting it.This paper deals with the filtering problem for a general class of nonlinear time-delay systems with Markovian jumping parameters. The nonlinear time-delay stochastic systems may switch from one to the others according to the behavior of a Markov chain. The purpose of the problem addressed is to design a nonlinear full-order filter such that the dynamics of the estimation error is guaranteed to be stochastically exponentially stable in the mean square. Both filter analysis and synthesis problems are investigated. Sufficient conditions are established for the existence of the desired exponential filters, which are expressed in terms of the solutions to a set of linear matrix inequalities (LMIs). The explicit expression of the desired filters is also provided. A simulation example is given to illustrate the design procedures and performances of the proposed method

Exponential stabilization of a class of stochastic system with Markovian jump parameters and mode-dependent mixed time-delays

Copyright [2010] IEEE. This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way imply IEEE endorsement of any of Brunel University's products or services. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to [email protected]. By choosing to view this document, you agree to all provisions of the copyright laws protecting it.In this technical note, the globally exponential stabilization problem is investigated for a general class of stochastic systems with both Markovian jumping parameters and mixed time-delays. The mixed mode-dependent time-delays consist of both discrete and distributed delays. We aim to design a memoryless state feedback controller such that the closed-loop system is stochastically exponentially stable in the mean square sense. First, by introducing a new Lyapunov-Krasovskii functional that accounts for the mode-dependent mixed delays, stochastic analysis is conducted in order to derive a criterion for the exponential stabilizability problem. Then, a variation of such a criterion is developed to facilitate the controller design by using the linear matrix inequality (LMI) approach. Finally, it is shown that the desired state feedback controller can be characterized explicitly in terms of the solution to a set of LMIs. Numerical simulation is carried out to demonstrate the effectiveness of the proposed methods.This work was supported in part by the Engineering and Physical Sciences Research Council (EPSRC) of the U.K. under Grant GR/S27658/01, the Royal Society of the U.K., the National 973 Program of China under Grant 2009CB320600, and the Alexander von Humboldt Foundation of Germany. Recommended by Associate Editor G. Chesi