A review on analysis and synthesis of nonlinear stochastic systems with randomly occurring incomplete information

Copyright q 2012 Hongli Dong et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.In the context of systems and control, incomplete information refers to a dynamical system in which knowledge about the system states is limited due to the difficulties in modeling complexity in a quantitative way. The well-known types of incomplete information include parameter uncertainties and norm-bounded nonlinearities. Recently, in response to the development of network technologies, the phenomenon of randomly occurring incomplete information has become more and more prevalent. Such a phenomenon typically appears in a networked environment. Examples include, but are not limited to, randomly occurring uncertainties, randomly occurring nonlinearities, randomly occurring saturation, randomly missing measurements and randomly occurring quantization. Randomly occurring incomplete information, if not properly handled, would seriously deteriorate the performance of a control system. In this paper, we aim to survey some recent advances on the analysis and synthesis problems for nonlinear stochastic systems with randomly occurring incomplete information. The developments of the filtering, control and fault detection problems are systematically reviewed. Latest results on analysis and synthesis of nonlinear stochastic systems are discussed in great detail. In addition, various distributed filtering technologies over sensor networks are highlighted. Finally, some concluding remarks are given and some possible future research directions are pointed out. © 2012 Hongli Dong et al.This work was supported in part by the National Natural Science Foundation of China under Grants 61273156, 61134009, 61273201, 61021002, and 61004067, the Engineering and Physical Sciences Research Council (EPSRC) of the UK under Grant GR/S27658/01, the Royal Society of the UK, the National Science Foundation of the USA under Grant No. HRD-1137732, and the Alexander von Humboldt Foundation of German

Stability Analysis for Markovian Jump Neutral Systems with Mixed Delays and Partially Known Transition Rates

The delay-dependent stability problem is studied for Markovian jump neutral systems with partial information on transition probabilities, and the considered delays are mixed and model dependent. By constructing the new stochastic Lyapunov-Krasovskii functional, which combined the introduced free matrices with the analysis technique of matrix inequalities, a sufficient condition for the systems with fully known transition rates is firstly established. Then, making full use of the transition rate matrix, the results are obtained for the other case, and the uncertain neutral Markovian jump system with incomplete transition rates is also considered. Finally, to show the validity of the obtained results, three numerical examples are provided

Variance-constrained multiobjective control and filtering for nonlinear stochastic systems: A survey

The multiobjective control and filtering problems for nonlinear stochastic systems with variance constraints are surveyed. First, the concepts of nonlinear stochastic systems are recalled along with the introduction of some recent advances. Then, the covariance control theory, which serves as a practical method for multi-objective control design as well as a foundation for linear system theory, is reviewed comprehensively. The multiple design requirements frequently applied in engineering practice for the use of evaluating system performances are introduced, including robustness, reliability, and dissipativity. Several design techniques suitable for the multi-objective variance-constrained control and filtering problems for nonlinear stochastic systems are discussed. In particular, as a special case for the multi-objective design problems, the mixed H 2 / H ∞ control and filtering problems are reviewed in great detail. Subsequently, some latest results on the variance-constrained multi-objective control and filtering problems for the nonlinear stochastic systems are summarized. Finally, conclusions are drawn, and several possible future research directions are pointed out

A delay-dependent approach to H∞ filtering for stochastic delayed jumping systems with sensor non-linearities

This is the post print version of the article. The official published version can be obtained from the link below - Copyright 2007 Taylor & Francis Ltd.In this paper, a delay-dependent approach is developed to deal with the stochastic H∞ filtering problem for a class of It type stochastic time-delay jumping systems subject to both the sensor non-linearities and the exogenous non-linear disturbances. The time delays enter into the system states, the sensor non-linearities and the external non-linear disturbances. The purpose of the addressed filtering problem is to seek an H∞ filter such that, in the simultaneous presence of non-linear disturbances, sensor non-linearity as well as Markovian jumping parameters, the filtering error dynamics for the stochastic time-delay system is stochastically stable with a guaranteed disturbance rejection attenuation level γ. By using It's differential formula and the Lyapunov stability theory, we develop a linear matrix inequality approach to derive sufficient conditions under which the desired filters exist. These conditions are dependent on the length of the time delay. We then characterize the expression of the filter parameters, and use a simulation example to demonstrate the effectiveness of the proposed results.This work was supported in part by the Engineering and Physical Sciences Research Council (EPSRC) of the U.K. under Grant GR/S27658/01, the Nuffield Foundation of the U.K.under Grant NAL/00630/G, and the Alexander von Humboldt Foundation of Germany

Formal Controller Synthesis for Markov Jump Linear Systems with Uncertain Dynamics

Automated synthesis of provably correct controllers for cyber-physical systems is crucial for deployment in safety-critical scenarios. However, hybrid features and stochastic or unknown behaviours make this problem challenging. We propose a method for synthesising controllers for Markov jump linear systems (MJLSs), a class of discrete-time models for cyber-physical systems, so that they certifiably satisfy probabilistic computation tree logic (PCTL) formulae. An MJLS consists of a finite set of stochastic linear dynamics and discrete jumps between these dynamics that are governed by a Markov decision process (MDP). We consider the cases where the transition probabilities of this MDP are either known up to an interval or completely unknown. Our approach is based on a finite-state abstraction that captures both the discrete (mode-jumping) and continuous (stochastic linear) behaviour of the MJLS. We formalise this abstraction as an interval MDP (iMDP) for which we compute intervals of transition probabilities using sampling techniques from the so-called 'scenario approach', resulting in a probabilistically sound approximation. We apply our method to multiple realistic benchmark problems, in particular, a temperature control and an aerial vehicle delivery problem.Comment: 14 pages, 6 figures, under review at QES

Distributed state estimation for uncertain Markov-type sensor networks with mode-dependent distributed delays

This the post-print version of the Article. The official published version can be accessed from the link below - Copyright @ 2012 John Wiley & Sons, Ltd.In this paper, the distributed state estimation problem is investigated for a class of sensor networks described by uncertain discrete-time dynamical systems with Markovian jumping parameters and distributed time-delays. The sensor network consists of sensor nodes characterized by a directed graph with a nonnegative adjacency matrix that specifies the interconnection topology (or the distribution in the space) of the network. Both the parameters of the target plant and the sensor measurements are subject to the switches from one mode to another at different times according to a Markov chain. The parameter uncertainties are norm-bounded that enter into both the plant system as well as the network outputs. Furthermore, the distributed time-delays are considered, which are also dependent on the Markovian jumping mode. Through the measurements from a small fraction of the sensors, this paper aims to design state estimators that allow the nodes of the sensor network to track the states of the plant in a distributed way. It is verified that such state estimators do exist if a set of matrix inequalities is solvable. A numerical example is provided to demonstrate the effectiveness of the designed distributed state estimators.This work was supported in part by the Royal Society of the U.K., the National Natural Science Foundation of China under Grants 60804028 and 61028008, the Specialized Research Fund for the Doctoral Program of Higher Education for New Teachers in China under Grant 200802861044, the Teaching and Research Fund for Excellent Young Teachers at Southeast University of China, the International Science and Technology Cooperation Project of China under Grant No. 2009DFA32050, and the Alexander von Humboldt Foundation of Germany

Stability analysis of markovian jump systems with multiple delay components and polytopic uncertainties

This paper investigates the stability problem of Markovian jump systems with multiple delay components and polytopic uncertainties. A new Lyapunov-Krasovskii functional is used for the stability analysis of Markovian jump systems with or without polytopic uncertainties. Two numerical examples are provided to demonstrate the applicability of the proposed approach. © Springer Science+Business Media, LLC 2011.published_or_final_versio