A note on control of a class of discrete-time stochastic systems with distributed delays and nonlinear disturbances

The official published version of this article can be found at the link below.This paper is concerned with the state feedback control problem for a class of discrete-time stochastic systems involving sector nonlinearities and mixed time-delays. The mixed time-delays comprise both discrete and distributed delays, and the sector nonlinearities appear in the system states and all delayed states. The distributed time-delays in the discrete-time domain are first defined and then a special matrix inequality is developed to handle the distributed time-delays within an algebraic framework. An effective linear matrix inequality (LMI) approach is proposed to design the state feedback controllers such that, for all admissible nonlinearities and time-delays, the overall closed-loop system is asymptotically stable in the mean square sense. Sufficient conditions are established for the nonlinear stochastic time-delay systems to be asymptotically stable in the mean square sense, and then the explicit expression of the desired controller gains is derived. A numerical example is provided to show the usefulness and effectiveness of the proposed design method.This work was supported in part by the Engineering and Physical Sciences Research Council (EPSRC) of the U.K. under Grant GR/S27658/01, the Royal Society of the U.K., the National Natural Science Foundation of China under Grants 60774073 and 60974030, the National 973 Program of China under Grant 2009CB320600, and the Alexander von Humboldt Foundation of Germany

Almost surely asymptotic stability of neutral stochastic differential delay equations with Markovian switching

The main aim of this paper is to discuss the almost surely asymptotic stability of the neutral stochastic differential delay equations (NSDDEs) with Markovian switching. Linear NSDDEs with Markovian switching and nonlinear examples will be discussed to illustrate the theory

Convergence rate of numerical solutions to SFDEs with jumps

In this paper, we are interested in numerical solutions of stochastic functional differential equations with jumps. Under a global Lipschitz condition, we show that the pth-moment convergence of Euler–Maruyama numerical solutions to stochastic functional differential equations with jumps has order 1/p for any p ≥ 2. This is significantly different from the case of stochastic functional differential equations without jumps, where the order is 1/2 for any p ≥ 2. It is therefore best to use the mean-square convergence for stochastic functional differential equations with jumps. Moreover, under a local Lipschitz condition, we reveal that the order of mean-square convergence is close to 1/2, provided that local Lipschitz constants, valid on balls of radius j, do not grow faster than log j

Robust H∞ control for a class of nonlinear stochastic systems with mixed time delay

This is the post print version of the article. The official published version can be obtained from the link - Copyright 2007 Wiley-Blackwell LtdThis paper is concerned with the problem of robust H∞ control for a class of uncertain nonlinear Itô-type stochastic systems with mixed time delays. The parameter uncertainties are assumed to be norm bounded, the mixed time delays comprise both the discrete and distributed delays, and the sector nonlinearities appear in both the system states and delayed states. The problem addressed is the design of a linear state feedback controller such that, in the simultaneous presence of parameter uncertainties, system nonlinearities and mixed time delays, the resulting closed-loop system is asymptotically stable in the mean square and also achieves a prescribed H∞ disturbance rejection attenuation level. By using the Lyapunov stability theory and the Itô differential rule, some new techniques are developed to derive the sufficient conditions guaranteeing the existence of the desired feedback controllers. A unified linear matrix inequality is proposed to deal with the problem under consideration and a numerical example is exploited to show the usefulness of the results obtained.This work was funded by the Engineering and Physical Sciences Research Council Grant Number: GR/S27658/01, Nuffield Foundation. Grant Number: NAL/00630/G, Alexander von Humboldt Foundation, National Natural Science Foundation of Jiangsu Education Committee of China Grant Number: 06KJD110206, National Natural Science Foundation Grant Numbers: 10471119, 10671172, Scientific Innovation Fund of Yangzhou University of China. Grant Number: 2006CXJ002

Stochasticity and Non-locality of Time

We present simple classical dynamical models to illustrate the idea of introducing a stochasticity with non-locality into the time variable. For stochasticity in time, these models include noise in the time variable but not in the "space" variable, which is opposite to the normal description of stochastic dynamics. Similarly with respect to non-locality, we discuss delayed and predictive dynamics which involve two points separated on the time axis. With certain combinations of fluctuations and non-locality in time, we observe a ``resonance'' effect. This is an effect similar to stochastic resonance, which has been discussed within the normal context of stochastic dynamics, but with different mechanisms. We discuss how these models may be developed to fit a broader context of generalized dynamical systems where fluctuations and non-locality are present in both space and time.Comment: 12 pages, 5 figures, Accepted and to appear in Physica A. (reference corrected for ver. 2

Hopf bifurcations in time-delay systems with band-limited feedback

We investigate the steady-state solution and its bifurcations in time-delay systems with band-limited feedback. This is a first step in a rigorous study concerning the effects of AC-coupled components in nonlinear devices with time-delayed feedback. We show that the steady state is globally stable for small feedback gain and that local stability is lost, generically, through a Hopf bifurcation for larger feedback gain. We provide simple criteria that determine whether the Hopf bifurcation is supercritical or subcritical based on the knowledge of the first three terms in the Taylor-expansion of the nonlinearity. Furthermore, the presence of double-Hopf bifurcations of the steady state is shown, which indicates possible quasiperiodic and chaotic dynamics in these systems. As a result of this investigation, we find that AC-coupling introduces fundamental differences to systems of Ikeda-type [Ikeda et al., Physica D 29 (1987) 223-235] already at the level of steady-state bifurcations, e.g. bifurcations exist in which limit cycles are created with periods other than the fundamental ``period-2'' mode found in Ikeda-type systems.Comment: 32 pages, 5 figures, accepted for publication in Physica D: Nonlinear Phenomen

Sampled-data sliding mode observer for robust fault reconstruction: A time-delay approach

A sliding mode observer in the presence of sampled output information and its application to robust fault reconstruction is studied. The observer is designed by using the delayed continuous-time representation of the sampled-data system, for which sufficient conditions are given in the form of linear matrix inequalities (LMIs) to guarantee the ultimate boundedness of the error dynamics. Though an ideal sliding motion cannot be achieved in the observer when the outputs are sampled, ultimately bounded solutions can be obtained provided the sampling frequency is fast enough. The bound on the solution is proportional to the sampling interval and the magnitude of the switching gain. The proposed observer design is applied to the problem of fault reconstruction under sampled outputs and system uncertainties. It is shown that actuator or sensor faults can be reconstructed reliably from the output error dynamics. An example of observer design for an inverted pendulum system is used to demonstrate the merit of the proposed methodology compared to existing sliding mode observer design approaches

A Delayed Black and Scholes Formula I

In this article we develop an explicit formula for pricing European options when the underlying stock price follows a non-linear stochastic differential delay equation (sdde). We believe that the proposed model is sufficiently flexible to fit real market data, and is yet simple enough to allow for a closed-form representation of the option price. Furthermore, the model maintains the no-arbitrage property and the completeness of the market. The derivation of the option-pricing formula is based on an equivalent martingale measure