Backstepping controller design for a class of stochastic nonlinear systems with Markovian switching

A more general class of stochastic nonlinear systems with irreducible homogenous Markovian switching are considered in this paper. As preliminaries, the stability criteria and the existence theorem of strong solutions are first presented by using the inequality of mathematic expectation of a Lyapunov function. The state-feedback controller is designed by regarding Markovian switching as constant such that the closed-loop system has a unique solution, and the equilibrium is asymptotically stable in probability in the large. The output-feedback controller is designed based on a quadratic-plus-quartic-form Lyapunov function such that the closed-loop system has a unique solution with the equilibrium being asymptotically stable in probability in the large in the unbiased case and has a unique bounded-in-probability solution in the biased case

Adaptive Backstepping Controller Design for Stochastic Jump Systems

In this technical note, we improve the results in a paper by Shi et al., in which problems of stochastic stability and sliding mode control for a class of linear continuous-time systems with stochastic jumps were considered. However, the system considered is switching stochastically between different subsystems, the dynamics of the jump system can not stay on each sliding surface of subsystems forever, therefore, it is difficult to determine whether the closed-loop system is stochastically stable. In this technical note, the backstepping techniques are adopted to overcome the problem in a paper by Shi et al.. The resulting closed-loop system is bounded in probability. It has been shown that the adaptive control problem for the Markovian jump systems is solvable if a set of coupled linear matrix inequalities (LMIs) have solutions. A numerical example is given to show the potential of the proposed techniques

New advances in H∞ control and filtering for nonlinear systems

The main objective of this special issue is to summarise recent advances in H∞ control and filtering for nonlinear systems, including time-delay, hybrid and stochastic systems. The published papers provide new ideas and approaches, clearly indicating the advances made in problem statements, methodologies or applications with respect to the existing results. The special issue also includes papers focusing on advanced and non-traditional methods and presenting considerable novelties in theoretical background or experimental setup. Some papers present applications to newly emerging fields, such as network-based control and estimation

Switching Controller Design for a Class of Markovian Jump Nonlinear Systems Using Stochastic Small-Gain Theorem

Switching controller design for a class of Markovian jump nonlinear systems with unmodeled dynamics is considered in this paper. Based on the differential equation and infinitesimal generator of jump systems, the concept of Jump Input-to-State practical Stability (JISpS) in probability and stochastic Lyapunov stability criterion are put forward. By using backsetpping technology and stochastic small-gain theorem, a switching controller is proposed which ensures JISpS in probability for the jump nonlinear system. A simulation example illustrates the validity of this design

Almost sure exponential stabilisation of stochastic systems by state-feedback control

So far, a major part of the literature on the stabilisation issues of stochastic systems has been dedicated to mean square stability. This paper develops a new class of criteria for designing a controller to stabilise a stochastic system almost surely which is unable to be stabilised in mean-square sense. The results are expressed in terms of linear matrix inequalities (LMIs) which are easy to be checked in practice by using MATLAB Toolbox. Moreover, the control structure in this paper appears not only in the drift part but also in the diusion part of the underlying stochastic system

Robust H-infinity finite-horizon control for a class of stochastic nonlinear time-varying systems subject to sensor and actuator saturations

Copyright [2010] IEEE. This material is posted here with permission of the IEEE. Such permission of the IEEE does not in any way imply IEEE endorsement of any of Brunel University's products or services. Internal or personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution must be obtained from the IEEE by writing to [email protected]. By choosing to view this document, you agree to all provisions of the copyright laws protecting it.This technical note addresses the robust H∞ finite-horizon output feedback control problem for a class of uncertain discrete stochastic nonlinear time-varying systems with both sensor and actuator saturations. In the system under investigation, all the system parameters are allowed to be time-varying, the parameter uncertainties are assumed to be of the polytopic type, and the stochastic nonlinearities are described by statistical means which can cover several classes of well-studied nonlinearities. The purpose of the problem addressed is to design an output feedback controller, over a given finite-horizon, such that the H∞ disturbance attenuation level is guaranteed for the nonlinear stochastic polytopic system in the presence of saturated sensor and actuator outputs. Sufficient conditions are first established for the robust H∞ performance through intensive stochastic analysis, and then a recursive linear matrix inequality (RLMI) approach is employed to design the desired output feedback controller achieving the prescribed H∞ disturbance rejection level. Simulation results demonstrate the effectiveness of the developed controller design scheme.This work was supported under Australian Research Council’s Discovery Projects funding scheme (project DP0880494) and by the German Science Foundation (DFG) within the priority programme 1305: Control Theory of Digitally Networked Dynamical Systems. Recommended by Associate Editor H. Ito

Stochastic Systems: Modeling, Optimization, and Applications

The special issue of Mathematical Problems in Engineering deals with the issues of modeling, optimization, and applications associated with stochastic systems. This special issue provides a forum for researchers and practitioners to publish quality research work on modeling, optimization approaches, and their applications in the context of theory analysis and engineering developments. The accepted papers in this special issue include stochastic stability, stabilization and control optimization, stochastic optimization, particle swarm optimization, modeling and identification methods, signal processing, and robust filtering. The issue includes thirty-nine papers out of which six consider the stability and stabilization problems of stochastic systems. Twelve papers cover the problems of the controller design and relevant optimization algorithms

Variance-constrained multiobjective control and filtering for nonlinear stochastic systems: A survey

The multiobjective control and filtering problems for nonlinear stochastic systems with variance constraints are surveyed. First, the concepts of nonlinear stochastic systems are recalled along with the introduction of some recent advances. Then, the covariance control theory, which serves as a practical method for multi-objective control design as well as a foundation for linear system theory, is reviewed comprehensively. The multiple design requirements frequently applied in engineering practice for the use of evaluating system performances are introduced, including robustness, reliability, and dissipativity. Several design techniques suitable for the multi-objective variance-constrained control and filtering problems for nonlinear stochastic systems are discussed. In particular, as a special case for the multi-objective design problems, the mixed H 2 / H ∞ control and filtering problems are reviewed in great detail. Subsequently, some latest results on the variance-constrained multi-objective control and filtering problems for the nonlinear stochastic systems are summarized. Finally, conclusions are drawn, and several possible future research directions are pointed out