Analysis and Design of Singular Markovian Jump Systems

This monograph is an up-to-date presentation of the analysis and design of singular Markovian jump systems (SMJSs) in which the transition rate matrix of the underlying systems is generally uncertain, partially unknown and designed. The problems addressed include stability, stabilization, H? control and filtering, observer design, and adaptive control. applications of Markov process are investigated by using Lyapunov theory, linear matrix inequalities (LMIs), S-procedure and the stochastic Barbalat’s Lemma, among other techniques. Features of the book include: · study of the stability problem for SMJSs with general transition rate matrices (TRMs); · stabilization for SMJSs by TRM design, noise control, proportional-derivative and partially mode-dependent control, in terms of LMIs with and without equation constraints; · mode-dependent and mode-independent H? control solutions with development of a type of disordered controller; · observer-based controllers of SMJSs in which both the designed observer and controller are either mode-dependent or mode-independent; · consideration of robust H? filtering in terms of uncertain TRM or filter parameters leading to a method for totally mode-independent filtering · development of LMI-based conditions for a class of adaptive state feedback controllers with almost-certainly-bounded estimated error and almost-certainly-asymptotically-stable corresponding closed-loop system states · applications of Markov process on singular systems with norm bounded uncertainties and time-varying delays Analysis and Design of Singular Markovian Jump Systems contains valuable reference material for academic researchers wishing to explore the area. The contents are also suitable for a one-semester graduate course

Adaptive Backstepping Controller Design for Stochastic Jump Systems

In this technical note, we improve the results in a paper by Shi et al., in which problems of stochastic stability and sliding mode control for a class of linear continuous-time systems with stochastic jumps were considered. However, the system considered is switching stochastically between different subsystems, the dynamics of the jump system can not stay on each sliding surface of subsystems forever, therefore, it is difficult to determine whether the closed-loop system is stochastically stable. In this technical note, the backstepping techniques are adopted to overcome the problem in a paper by Shi et al.. The resulting closed-loop system is bounded in probability. It has been shown that the adaptive control problem for the Markovian jump systems is solvable if a set of coupled linear matrix inequalities (LMIs) have solutions. A numerical example is given to show the potential of the proposed techniques

Backstepping controller design for a class of stochastic nonlinear systems with Markovian switching

A more general class of stochastic nonlinear systems with irreducible homogenous Markovian switching are considered in this paper. As preliminaries, the stability criteria and the existence theorem of strong solutions are first presented by using the inequality of mathematic expectation of a Lyapunov function. The state-feedback controller is designed by regarding Markovian switching as constant such that the closed-loop system has a unique solution, and the equilibrium is asymptotically stable in probability in the large. The output-feedback controller is designed based on a quadratic-plus-quartic-form Lyapunov function such that the closed-loop system has a unique solution with the equilibrium being asymptotically stable in probability in the large in the unbiased case and has a unique bounded-in-probability solution in the biased case