Static output-feedback stabilization of discrete-time Markovian jump linear systems: a system augmentation approach

This paper studies the static output-feedback (SOF) stabilization problem for discrete-time Markovian jump systems from a novel perspective. The closed-loop system is represented in a system augmentation form, in which input and gain-output matrices are separated. By virtue of the system augmentation, a novel necessary and sufficient condition for the existence of desired controllers is established in terms of a set of nonlinear matrix inequalities, which possess a monotonic structure for a linearized computation, and a convergent iteration algorithm is given to solve such inequalities. In addition, a special property of the feasible solutions enables one to further improve the solvability via a simple D-K type optimization on the initial values. An extension to mode-independent SOF stabilization is provided as well. Compared with some existing approaches to SOF synthesis, the proposed one has several advantages that make it specific for Markovian jump systems. The effectiveness and merit of the theoretical results are shown through some numerical example

Stabilizing Randomly Switched Systems

This article is concerned with stability analysis and stabilization of randomly switched systems under a class of switching signals. The switching signal is modeled as a jump stochastic (not necessarily Markovian) process independent of the system state; it selects, at each instant of time, the active subsystem from a family of systems. Sufficient conditions for stochastic stability (almost sure, in the mean, and in probability) of the switched system are established when the subsystems do not possess control inputs, and not every subsystem is required to be stable. These conditions are employed to design stabilizing feedback controllers when the subsystems are affine in control. The analysis is carried out with the aid of multiple Lyapunov-like functions, and the analysis results together with universal formulae for feedback stabilization of nonlinear systems constitute our primary tools for control designComment: 22 pages. Submitte

On stability of randomly switched nonlinear systems

This article is concerned with stability analysis and stabilization of randomly switched nonlinear systems. These systems may be regarded as piecewise deterministic stochastic systems: the discrete switches are triggered by a stochastic process which is independent of the state of the system, and between two consecutive switching instants the dynamics are deterministic. Our results provide sufficient conditions for almost sure global asymptotic stability using Lyapunov-based methods when individual subsystems are stable and a certain ``slow switching'' condition holds. This slow switching condition takes the form of an asymptotic upper bound on the probability mass function of the number of switches that occur between the initial and current time instants. This condition is shown to hold for switching signals coming from the states of finite-dimensional continuous-time Markov chains; our results therefore hold for Markov jump systems in particular. For systems with control inputs we provide explicit control schemes for feedback stabilization using the universal formula for stabilization of nonlinear systems.Comment: 13 pages, no figures. A slightly modified version is scheduled to appear in IEEE Transactions on Automatic Control, Dec 200

On stabilization of bilinear uncertain time-delay stochastic systems with Markovian jumping parameters

Copyright [2002] IEEE. This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way imply IEEE endorsement of any of Brunel University's products or services. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to [email protected]. By choosing to view this document, you agree to all provisions of the copyright laws protecting it.In this paper, we investigate the stochastic stabilization problem for a class of bilinear continuous time-delay uncertain systems with Markovian jumping parameters. Specifically, the stochastic bilinear jump system under study involves unknown state time-delay, parameter uncertainties, and unknown nonlinear deterministic disturbances. The jumping parameters considered here form a continuous-time discrete-state homogeneous Markov process. The whole system may be regarded as a stochastic bilinear hybrid system that includes both time-evolving and event-driven mechanisms. Our attention is focused on the design of a robust state-feedback controller such that, for all admissible uncertainties as well as nonlinear disturbances, the closed-loop system is stochastically exponentially stable in the mean square, independent of the time delay. Sufficient conditions are established to guarantee the existence of desired robust controllers, which are given in terms of the solutions to a set of either linear matrix inequalities (LMIs), or coupled quadratic matrix inequalities. The developed theory is illustrated by numerical simulatio

Stochastic stability and stabilization of discrete-time singular Markovian jump systems with partially unknown transition probabilities

This paper considers the stochastic stability and stabilization of discrete-time singular Markovian jump systems with partially unknown transition probabilities. Firstly, a set of necessary and sufficient conditions for the stochastic stability is proposed in terms of LMIs, then a set of sufficient conditions is proposed for the design of a state feedback controller to guarantee that the corresponding closed-loop systems are regular, causal, and stochastically stable by employing the LMI technique. Finally, some examples are provided to demonstrate the effectiveness of the proposed approaches

Robust normalization and guaranteed cost control for a class of uncertain singular Markovian jump systems via hybrid impulsive control

This paper investigates the problem of robust normalization and guaranteed cost control for a class of uncertain singular Markovian jump systems. The uncertainties exhibit in both system matrices and transition rate matrix of the Markovian chain. A new impulsive and proportional-derivative control strategy is presented, where the derivative gain is to make the closed-loop system of the singular plant to be a normal one, and the impulsive control part is to make the value of the Lyapunov function does not increase at each time instant of the Markovian switching. A linearization approach via congruence transformations is proposed to solve the controller design problem. The cost function is minimized via solving an optimization problem under the designed control scheme. Finally, three examples (two numerical examples and an RC pulse divider circuit example) are provided to illustrate the effectiveness and applicability of the proposed methods

A review on analysis and synthesis of nonlinear stochastic systems with randomly occurring incomplete information

Copyright q 2012 Hongli Dong et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.In the context of systems and control, incomplete information refers to a dynamical system in which knowledge about the system states is limited due to the difficulties in modeling complexity in a quantitative way. The well-known types of incomplete information include parameter uncertainties and norm-bounded nonlinearities. Recently, in response to the development of network technologies, the phenomenon of randomly occurring incomplete information has become more and more prevalent. Such a phenomenon typically appears in a networked environment. Examples include, but are not limited to, randomly occurring uncertainties, randomly occurring nonlinearities, randomly occurring saturation, randomly missing measurements and randomly occurring quantization. Randomly occurring incomplete information, if not properly handled, would seriously deteriorate the performance of a control system. In this paper, we aim to survey some recent advances on the analysis and synthesis problems for nonlinear stochastic systems with randomly occurring incomplete information. The developments of the filtering, control and fault detection problems are systematically reviewed. Latest results on analysis and synthesis of nonlinear stochastic systems are discussed in great detail. In addition, various distributed filtering technologies over sensor networks are highlighted. Finally, some concluding remarks are given and some possible future research directions are pointed out. © 2012 Hongli Dong et al.This work was supported in part by the National Natural Science Foundation of China under Grants 61273156, 61134009, 61273201, 61021002, and 61004067, the Engineering and Physical Sciences Research Council (EPSRC) of the UK under Grant GR/S27658/01, the Royal Society of the UK, the National Science Foundation of the USA under Grant No. HRD-1137732, and the Alexander von Humboldt Foundation of German

Exponential stabilization of a class of stochastic system with Markovian jump parameters and mode-dependent mixed time-delays

Copyright [2010] IEEE. This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way imply IEEE endorsement of any of Brunel University's products or services. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to [email protected]. By choosing to view this document, you agree to all provisions of the copyright laws protecting it.In this technical note, the globally exponential stabilization problem is investigated for a general class of stochastic systems with both Markovian jumping parameters and mixed time-delays. The mixed mode-dependent time-delays consist of both discrete and distributed delays. We aim to design a memoryless state feedback controller such that the closed-loop system is stochastically exponentially stable in the mean square sense. First, by introducing a new Lyapunov-Krasovskii functional that accounts for the mode-dependent mixed delays, stochastic analysis is conducted in order to derive a criterion for the exponential stabilizability problem. Then, a variation of such a criterion is developed to facilitate the controller design by using the linear matrix inequality (LMI) approach. Finally, it is shown that the desired state feedback controller can be characterized explicitly in terms of the solution to a set of LMIs. Numerical simulation is carried out to demonstrate the effectiveness of the proposed methods.This work was supported in part by the Engineering and Physical Sciences Research Council (EPSRC) of the U.K. under Grant GR/S27658/01, the Royal Society of the U.K., the National 973 Program of China under Grant 2009CB320600, and the Alexander von Humboldt Foundation of Germany. Recommended by Associate Editor G. Chesi

Dissipative stabilization of entangled cat states using a driven Bose-Hubbard dimer

We analyze a modified Bose-Hubbard model, where two cavities having on-site Kerr interactions are subject to two-photon driving and correlated dissipation. We derive an exact solution for the steady state of this interacting driven-dissipative system, and use it show that the system permits the preparation and stabilization of pure entangled non-Gaussian states, so-called entangled cat states. Unlike previous proposals for dissipative stabilization of such states, our approach requires only a linear coupling to a single engineered reservoir (as opposed to nonlinear couplings to two or more reservoirs). Our scheme is within the reach of state-of-the-art experiments in circuit QED.Comment: 5 pages main text, 5 pages appendices, 6 figure