Stabilizing Randomly Switched Systems

This article is concerned with stability analysis and stabilization of randomly switched systems under a class of switching signals. The switching signal is modeled as a jump stochastic (not necessarily Markovian) process independent of the system state; it selects, at each instant of time, the active subsystem from a family of systems. Sufficient conditions for stochastic stability (almost sure, in the mean, and in probability) of the switched system are established when the subsystems do not possess control inputs, and not every subsystem is required to be stable. These conditions are employed to design stabilizing feedback controllers when the subsystems are affine in control. The analysis is carried out with the aid of multiple Lyapunov-like functions, and the analysis results together with universal formulae for feedback stabilization of nonlinear systems constitute our primary tools for control designComment: 22 pages. Submitte

Almost Sure Stabilization for Adaptive Controls of Regime-switching LQ Systems with A Hidden Markov Chain

This work is devoted to the almost sure stabilization of adaptive control systems that involve an unknown Markov chain. The control system displays continuous dynamics represented by differential equations and discrete events given by a hidden Markov chain. Different from previous work on stabilization of adaptive controlled systems with a hidden Markov chain, where average criteria were considered, this work focuses on the almost sure stabilization or sample path stabilization of the underlying processes. Under simple conditions, it is shown that as long as the feedback controls have linear growth in the continuous component, the resulting process is regular. Moreover, by appropriate choice of the Lyapunov functions, it is shown that the adaptive system is stabilizable almost surely. As a by-product, it is also established that the controlled process is positive recurrent

Stability Optimization of Positive Semi-Markov Jump Linear Systems via Convex Optimization

In this paper, we study the problem of optimizing the stability of positive semi-Markov jump linear systems. We specifically consider the problem of tuning the coefficients of the system matrices for maximizing the exponential decay rate of the system under a budget-constraint. By using a result from the matrix theory on the log-log convexity of the spectral radius of nonnegative matrices, we show that the stability optimization problem reduces to a convex optimization problem under certain regularity conditions on the system matrices and the cost function. We illustrate the validity and effectiveness of the proposed results by using an example from the population biology

Exponential stabilization of a class of stochastic system with Markovian jump parameters and mode-dependent mixed time-delays

Copyright [2010] IEEE. This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way imply IEEE endorsement of any of Brunel University's products or services. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to [email protected]. By choosing to view this document, you agree to all provisions of the copyright laws protecting it.In this technical note, the globally exponential stabilization problem is investigated for a general class of stochastic systems with both Markovian jumping parameters and mixed time-delays. The mixed mode-dependent time-delays consist of both discrete and distributed delays. We aim to design a memoryless state feedback controller such that the closed-loop system is stochastically exponentially stable in the mean square sense. First, by introducing a new Lyapunov-Krasovskii functional that accounts for the mode-dependent mixed delays, stochastic analysis is conducted in order to derive a criterion for the exponential stabilizability problem. Then, a variation of such a criterion is developed to facilitate the controller design by using the linear matrix inequality (LMI) approach. Finally, it is shown that the desired state feedback controller can be characterized explicitly in terms of the solution to a set of LMIs. Numerical simulation is carried out to demonstrate the effectiveness of the proposed methods.This work was supported in part by the Engineering and Physical Sciences Research Council (EPSRC) of the U.K. under Grant GR/S27658/01, the Royal Society of the U.K., the National 973 Program of China under Grant 2009CB320600, and the Alexander von Humboldt Foundation of Germany. Recommended by Associate Editor G. Chesi

A Gel'fand-type spectral radius formula and stability of linear constrained switching systems

Using ergodic theory, in this paper we present a Gel'fand-type spectral radius formula which states that the joint spectral radius is equal to the generalized spectral radius for a matrix multiplicative semigroup \bS^+ restricted to a subset that need not carry the algebraic structure of \bS^+. This generalizes the Berger-Wang formula. Using it as a tool, we study the absolute exponential stability of a linear switched system driven by a compact subshift of the one-sided Markov shift associated to \bS.Comment: 16 pages; to appear in Linear Algebra and its Application

On the asymptotic behavior of highly nonlinear hybrid stochastic delay differential equations

In this paper, under a local Lipschitz condition and a monotonicity condition, the problems on the existence and uniqueness theorem as well as the almost surely asymptotic behavior for the global solution of highly nonlinear stochastic differential equations with time-varying delay and Markovian switching are discussed by using the Lyapunov function and some stochastic analysis techniques. Two integral lemmas are firstly established to overcome the difficulty stemming from the coexistence of the stochastic perturbation and the time-varying delay. Then, without any redundant restrictive condition on the time-varying delay, by utilizing the integral inequality, the exponential stability in pth(p ≥ 1)-moment for such equations is investigated. By employing the nonnegative semi-martingale convergence theorem, the almost sure exponential stability is analyzed. Finally, two examples are given to show the usefulness of the results obtained.National Natural Science Foundation of ChinaNatural Science Foundation of Jiangxi Province of ChinaFoundation of Jiangxi Provincial Educations of ChinaMinisterio de Economía y Competitividad (MINECO). EspañaJunta de Andalucí

On control of discrete-time state-dependent jump linear systems with probabilistic constraints: A receding horizon approach

In this article, we consider a receding horizon control of discrete-time state-dependent jump linear systems, particular kind of stochastic switching systems, subject to possibly unbounded random disturbances and probabilistic state constraints. Due to a nature of the dynamical system and the constraints, we consider a one-step receding horizon. Using inverse cumulative distribution function, we convert the probabilistic state constraints to deterministic constraints, and obtain a tractable deterministic receding horizon control problem. We consider the receding control law to have a linear state-feedback and an admissible offset term. We ensure mean square boundedness of the state variable via solving linear matrix inequalities off-line, and solve the receding horizon control problem on-line with control offset terms. We illustrate the overall approach applied on a macroeconomic system