On stabilization of bilinear uncertain time-delay stochastic systems with Markovian jumping parameters

Copyright [2002] IEEE. This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way imply IEEE endorsement of any of Brunel University's products or services. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to [email protected]. By choosing to view this document, you agree to all provisions of the copyright laws protecting it.In this paper, we investigate the stochastic stabilization problem for a class of bilinear continuous time-delay uncertain systems with Markovian jumping parameters. Specifically, the stochastic bilinear jump system under study involves unknown state time-delay, parameter uncertainties, and unknown nonlinear deterministic disturbances. The jumping parameters considered here form a continuous-time discrete-state homogeneous Markov process. The whole system may be regarded as a stochastic bilinear hybrid system that includes both time-evolving and event-driven mechanisms. Our attention is focused on the design of a robust state-feedback controller such that, for all admissible uncertainties as well as nonlinear disturbances, the closed-loop system is stochastically exponentially stable in the mean square, independent of the time delay. Sufficient conditions are established to guarantee the existence of desired robust controllers, which are given in terms of the solutions to a set of either linear matrix inequalities (LMIs), or coupled quadratic matrix inequalities. The developed theory is illustrated by numerical simulatio

Backstepping controller design for a class of stochastic nonlinear systems with Markovian switching

A more general class of stochastic nonlinear systems with irreducible homogenous Markovian switching are considered in this paper. As preliminaries, the stability criteria and the existence theorem of strong solutions are first presented by using the inequality of mathematic expectation of a Lyapunov function. The state-feedback controller is designed by regarding Markovian switching as constant such that the closed-loop system has a unique solution, and the equilibrium is asymptotically stable in probability in the large. The output-feedback controller is designed based on a quadratic-plus-quartic-form Lyapunov function such that the closed-loop system has a unique solution with the equilibrium being asymptotically stable in probability in the large in the unbiased case and has a unique bounded-in-probability solution in the biased case

Static output-feedback stabilization of discrete-time Markovian jump linear systems: a system augmentation approach

This paper studies the static output-feedback (SOF) stabilization problem for discrete-time Markovian jump systems from a novel perspective. The closed-loop system is represented in a system augmentation form, in which input and gain-output matrices are separated. By virtue of the system augmentation, a novel necessary and sufficient condition for the existence of desired controllers is established in terms of a set of nonlinear matrix inequalities, which possess a monotonic structure for a linearized computation, and a convergent iteration algorithm is given to solve such inequalities. In addition, a special property of the feasible solutions enables one to further improve the solvability via a simple D-K type optimization on the initial values. An extension to mode-independent SOF stabilization is provided as well. Compared with some existing approaches to SOF synthesis, the proposed one has several advantages that make it specific for Markovian jump systems. The effectiveness and merit of the theoretical results are shown through some numerical example

Adaptive Backstepping Controller Design for Stochastic Jump Systems

In this technical note, we improve the results in a paper by Shi et al., in which problems of stochastic stability and sliding mode control for a class of linear continuous-time systems with stochastic jumps were considered. However, the system considered is switching stochastically between different subsystems, the dynamics of the jump system can not stay on each sliding surface of subsystems forever, therefore, it is difficult to determine whether the closed-loop system is stochastically stable. In this technical note, the backstepping techniques are adopted to overcome the problem in a paper by Shi et al.. The resulting closed-loop system is bounded in probability. It has been shown that the adaptive control problem for the Markovian jump systems is solvable if a set of coupled linear matrix inequalities (LMIs) have solutions. A numerical example is given to show the potential of the proposed techniques

On almost sure stability of hybrid stochastic systems with mode-dependent interval delays

This note develops a criterion for almost sure stability of hybrid stochastic systems with mode-dependent interval time delays, which improves an existing result by exploiting the relation between the bounds of the time delays and the generator of the continuous-time Markov chain. The improved result shows that the presence of Markovian switching is quite involved in the stability analysis of delay systems. Numerical examples are given to verify the effectiveness

Stability Optimization of Positive Semi-Markov Jump Linear Systems via Convex Optimization

In this paper, we study the problem of optimizing the stability of positive semi-Markov jump linear systems. We specifically consider the problem of tuning the coefficients of the system matrices for maximizing the exponential decay rate of the system under a budget-constraint. By using a result from the matrix theory on the log-log convexity of the spectral radius of nonnegative matrices, we show that the stability optimization problem reduces to a convex optimization problem under certain regularity conditions on the system matrices and the cost function. We illustrate the validity and effectiveness of the proposed results by using an example from the population biology