Discrete Razumikhin-type technique and stability of the Euler-Maruyama method to stochastic functional differential equations

A discrete stochastic Razumikhin-type theorem is established to investigate whether the Euler--Maruyama (EM) scheme can reproduce the moment exponential stability of exact solutions of stochastic functional differential equations (SFDEs). In addition, the Chebyshev inequality and the Borel-Cantelli lemma are applied to show the almost sure stability of the EM approximate solutions of SFDEs. To show our idea clearly, these results are used to discuss stability of numerical solutions of two classes of special SFDEs, including stochastic delay differential equations (SDDEs) with variable delay and stochastically perturbed equations

Stability of hybrid stochastic retarded systems

Abstract-In the past few years, hybrid stochastic retarded systems (also known as stochastic retarded systems with Markovian switching), including hybrid stochastic delay systems, have been intensively studied. Among the key results, Mao et al. proposed the Razumikhin-type theorem on exponential stability of stochastic functional differential equations with Markovian switching and its application to hybrid stochastic delay interval systems. However, the importance of general asymptotic stability has not been considered. This paper is to study Razumikhin-type theorems on general theorem moment asymptotic stability of hybrid stochastic retarded systems. The proposed theorems apply to complex systems including some cases when the existing results cannot be used

Razumikhin-type theorems on exponential stability of SDDEs containing singularly perturbed random processes

This paper concerns Razumikhin-type theorems on exponential stability of stochastic differential delay equations with Markovian switching, where the modulating Markov chain involves small parameters. The smaller the parameter is, the rapider switching the system will experience. In order to reduce the complexity, we will “replace” the original systems by limit systems with a simple structure. Under Razumikhin-type conditions, we establish theorems that if the limit systems are pth-moment exponentially stable; then, the original systems are pth-moment exponentially stable in an appropriate sense

Razumikhin-type theorems on exponential stability of SDDEs containing singularly perturbed random processes

This paper concerns Razumikhin-type theorems on exponential stability of stochastic differential delay equations with Markovian switching, where the modulating Markov chain involves small parameters. The smaller the parameter is, the rapider switching the system will experience. In order to reduce the complexity, we will “replace” the original systems by limit systems with a simple structure. Under Razumikhin-type conditions, we establish theorems that if the limit systems are pth-moment exponentially stable; then, the original systems are pth-moment exponentially stable in an appropriate sense

Stability analysis and control of discrete-time systems with delay

The research presented in this thesis considers the stability analysis and control of discrete-time systems with delay. The interest in this class of systems has been motivated traditionally by sampled-data systems in which a process is sampled periodically and then controlled via a computer. This setting leads to relatively cheap control solutions, but requires the discretization of signals which typically introduces time delays. Therefore, controller design for sampled-data systems is often based on a model consisting of a discrete-time system with delay. More recently the interest in discrete-time systems with delay has been motivated by networked control systems in which the connection between the process and the controller is made through a shared communication network. This communication network increases the flexibility of the control architecture but also introduces effects such as packet dropouts, uncertain time-varying delays and timing jitter. To take those effects into account, typically a discrete-time system with delay is formulated that represents the process together with the communication network, this model is then used for controller design While most researchers that work on sampled-data and networked control systems make use of discrete-time systems with delay as a modeling class, they merely use these models as a tool to analyse the properties of their original control problem. Unfortunately, a relatively small amount of research on discrete-time systems with delay addresses fundamental questions such as: What trade-off between computational complexity and conceptual generality or potential control performance is provided by the different stability analysis methods that underlie existing results? Are there other stability analysis methods possible that provide a better trade-off between these properties? In this thesis we try to address these and other related questions. Motivated by the fact that almost every system in practice is subject to constraints and Lyapunov theory is one of the few methods that can be easily adapted to deal with constraints, all results in this thesis are based on Lyapunov theory. In Chapter 2 we introduce delay difference inclusions (DDIs) as a modeling class for systems with delay and discuss their generality and advantages. Furthermore, the two standard stability analysis results for DDIs that make use of Lyapunov theory, i.e., the Krasovskii and Razumikhin approaches, are considered. The Krasovskii approach provides necessary and sufficient conditions for stability while the Razumikhin approach provides conditions that are relatively simple to verify but conservative. An important conclusion is that the Razumikhin approach makes use of conditions that involve the system state only while those corresponding to the Krasovskii approach involve trajectory segments. Therefore, only the Razumikhin approach yields information about DDI trajectories directly, such that the corresponding computations can be executed in the low-dimensional state space of the DDI dynamics. Hence, we focus on the Razumikhin approach in the remainder of the thesis. In Chapter 3 it is shown that by considering each delayed state as a subsystem, the behavior of a DDI can be described by an interconnected system. Thus, the Razumikhin approach is found to be an exact application of the small-gain theorem, which provides an explanation for the conservatism that is typically associated with this approach. Then, inspired by the relation of DDIs to interconnected systems, we propose a new Razumikhin-type stability analysis method that makes use of a stability analysis result for interconnected systems with dissipative subsystems. The proposed method is shown to provide a trade-off between the conceptual generality of the Krasovskii approach and the computationally convenience of the Razumikhin approach. Unfortunately, these novel Razumikhin-type stability analysis conditions still remain conservative. Therefore, in Chapter 4 we propose a relaxation of the Razumikhin approach that provides necessary and sufficient conditions for stability. Thus, we obtain a Razumikhin-type result that makes use of conditions that involve the system state only and are non-conservative. Interestingly, we prove that for positive linear systems these conditions equivalent to the standard Razumikhin approach and hence both are necessary and sufficient for stability. This establishes the dominance of the standard Razumikhin approach over the Krasovskii approach for positive linear discrete-time systems with delay. Next, in Chapter 5 the stability analysis of constrained DDIs is considered. To this end, we study the construction of invariant sets. In this context the Krasovskii approach leads to algorithms that are not computationally tractable while the Razumikhin approach is, due to its conservatism, not always able to provide a suitable invariant set. Based on the non-conservative Razumikhin-type conditions that were proposed in Chapter 4, a novel invariance notion is proposed. This notion, called the invariant family of sets, preserves the conceptual generality of the Krasovskii approach while, at the same time, it has a computational complexity comparable to the Razumikhin approach. The properties of invariant families of sets are analyzed and synthesis methods are presented. Then, in Chapter 6 the stabilization of constrained linear DDIs is considered. In particular, we propose two advanced control schemes that make use of online optimization. The first scheme is designed specifically to handle constraints in a non-conservative way and is based on the Razumikhin approach. The second control scheme reduces the computational complexity that is typically associated with the stabilization of constrained DDIs and is based on a set of necessary and sufficient Razumikhin-type conditions for stability. In Chapter 7 interconnected systems with delay are considered. In particular, the standard stability analysis results based on the Krasovskii as well as the Razumikhin approach are extended to interconnected systems with delay using small-gain arguments. This leads, among others, to the insight that delays on the channels that connect the various subsystems can not cause the instability of the overall interconnected system with delay if a small-gain condition holds. This result stands in sharp contrast with the typical destabilizing effect that time delays have. The aforementioned results are used to analyse the stability of a classical power systems example where the power plants are controlled only locally via a communication network, which gives rise to local delays in the power plants. A reflection on the work that has been presented in this thesis and a set of conclusions and recommendations for future work are presented in Chapter 8

Delay-dependent exponential stability of neutral stochastic delay systems (vol 54, pg 147, 2009)

In the above titled paper originally published in vol. 54, no. 1, pp. 147-152) of IEEE Transactions on Automatic Control, there were some typographical errors in inequalities. Corrections are presented here

On Input-to-State Stability of Impulsive Stochastic Systems with Time Delays

This paper is concerned with pth moment input-to-state stability (p-ISS) and stochastic input-to-state stability (SISS) of impulsive stochastic systems with time delays. Razumikhin-type theorems ensuring p-ISS/SISS are established for the mentioned systems with external input affecting both the continuous and the discrete dynamics. It is shown that when the impulse-free delayed stochastic dynamics are p-ISS/SISS but the impulses are destabilizing, the p-ISS/SISS property of the impulsive stochastic systems can be preserved if the length of the impulsive interval is large enough. In particular, if the impulse-free delayed stochastic dynamics are p-ISS/SISS and the discrete dynamics are marginally stable for the zero input, the impulsive stochastic system is p-ISS/SISS regardless of how often or how seldom the impulses occur. To overcome the difficulties caused by the coexistence of time delays, impulses, and stochastic effects, Razumikhin techniques and piecewise continuous Lyapunov functions as well as stochastic analysis techniques are involved together. An example is provided to illustrate the effectiveness and advantages of our results

Qualitative Studies of Nonlinear Hybrid Systems

A hybrid system is a dynamical system that exhibits both continuous and discrete dynamic behavior. Hybrid systems arise in a wide variety of important applications in diverse areas, ranging from biology to computer science to air traffic dynamics. The interaction of continuous- and discrete-time dynamics in a hybrid system often leads to very rich dynamical behavior and phenomena that are not encountered in purely continuous- or discrete-time systems. Investigating the dynamical behavior of hybrid systems is of great theoretical and practical importance. The objectives of this thesis are to develop the qualitative theory of nonlinear hybrid systems with impulses, time-delay, switching modes, and stochastic disturbances, to develop algorithms and perform analysis for hybrid systems with an emphasis on stability and control, and to apply the theory and methods to real-world application problems. Switched nonlinear systems are formulated as a family of nonlinear differential equations, called subsystems, together with a switching signal that selects the continuous dynamics among the subsystems. Uniform stability is studied emphasizing the situation where both stable and unstable subsystems are present. Uniformity of stability refers to both the initial time and a family of switching signals. Stabilization of nonlinear systems via state-dependent switching signal is investigated. Based on assumptions on a convex linear combination of the nonlinear vector fields, a generalized minimal rule is proposed to generate stabilizing switching signals that are well-defined and do not exhibit chattering or Zeno behavior. Impulsive switched systems are hybrid systems exhibiting both impulse and switching effects, and are mathematically formulated as a switched nonlinear system coupled with a sequence of nonlinear difference equations that act on the switched system at discrete times. Impulsive switching signals integrate both impulsive and switching laws that specify when and how impulses and switching occur. Invariance principles can be used to investigate asymptotic stability in the absence of a strict Lyapunov function. An invariance principle is established for impulsive switched systems under weak dwell-time signals. Applications of this invariance principle provide several asymptotic stability criteria. Input-to-state stability notions are formulated in terms of two different measures, which not only unify various stability notions under the stability theory in two measures, but also bridge this theory with the existent input/output theories for nonlinear systems. Input-to-state stability results are obtained for impulsive switched systems under generalized dwell-time signals. Hybrid time-delay systems are hybrid systems with dependence on the past states of the systems. Switched delay systems and impulsive switched systems are special classes of hybrid time-delay systems. Both invariance property and input-to-state stability are extended to cover hybrid time-delay systems. Stochastic hybrid systems are hybrid systems subject to random disturbances, and are formulated using stochastic differential equations. Focused on stochastic hybrid systems with time-delay, a fundamental theory regarding existence and uniqueness of solutions is established. Stabilization schemes for stochastic delay systems using state-dependent switching and stabilizing impulses are proposed, both emphasizing the situation where all the subsystems are unstable. Concerning general stochastic hybrid systems with time-delay, the Razumikhin technique and multiple Lyapunov functions are combined to obtain several Razumikhin-type theorems on both moment and almost sure stability of stochastic hybrid systems with time-delay. Consensus problems in networked multi-agent systems and global convergence of artificial neural networks are related to qualitative studies of hybrid systems in the sense that dynamic switching, impulsive effects, communication time-delays, and random disturbances are ubiquitous in networked systems. Consensus protocols are proposed for reaching consensus among networked agents despite switching network topologies, communication time-delays, and measurement noises. Focused on neural networks with discontinuous neuron activation functions and mixed time-delays, sufficient conditions for existence and uniqueness of equilibrium and global convergence and stability are derived using both linear matrix inequalities and M-matrix type conditions. Numerical examples and simulations are presented throughout this thesis to illustrate the theoretical results