Towards a General Theory of Stochastic Hybrid Systems

In this paper we set up a mathematical structure, called Markov string, to obtaining a very general class of models for stochastic hybrid systems. Markov Strings are, in fact, a class of Markov processes, obtained by a mixing mechanism of stochastic processes, introduced by Meyer. We prove that Markov strings are strong Markov processes with the cadlag property. We then show how a very general class of stochastic hybrid processes can be embedded in the framework of Markov strings. This class, which is referred to as the General Stochastic Hybrid Systems (GSHS), includes as special cases all the classes of stochastic hybrid processes, proposed in the literature

Stability Analysis of Continuous-Time Switched Systems with a Random Switching Signal

This paper is concerned with the stability analysis of continuous-time switched systems with a random switching signal. The switching signal manifests its characteristics with that the dwell time in each subsystem consists of a fixed part and a random part. The stochastic stability of such switched systems is studied using a Lyapunov approach. A necessary and sufficient condition is established in terms of linear matrix inequalities. The effect of the random switching signal on system stability is illustrated by a numerical example and the results coincide with our intuition.Comment: 6 pages, 6 figures, accepted by IEEE-TA

Multilevel Monte Carlo methods for applications in finance

Since Giles introduced the multilevel Monte Carlo path simulation method [18], there has been rapid development of the technique for a variety of applications in computational finance. This paper surveys the progress so far, highlights the key features in achieving a high rate of multilevel variance convergence, and suggests directions for future research.Comment: arXiv admin note: text overlap with arXiv:1202.6283; and with arXiv:1106.4730 by other author

Approximation methods for hybrid diffusion systems with state-dependent switching processes : numerical algorithms and existence and uniqueness of solutions

By focusing on hybrid diffusions in which continuous dynamics and discrete events coexist, this work is concerned with approximation of solutions for hybrid stochastic differential equations with a state-dependent switching process. Iterative algorithms are developed. The continuous-state dependent switching process presents added difficulties in analyzing the numerical procedures. Weak convergence of the algorithms is established by a martingale problem formulation first. This weak convergence result is then used as a bridge to obtain strong convergence. In this process, the existence and uniqueness of the solution of the switching diffusions with continuous-state-dependent switching are obtained. Different from the existing results of solutions of stochastic differential equations in which the Picard iterations are utilized, Euler's numerical schemes are considered here. Moreover, decreasing stepsize algorithms together with their weak convergence are given. Numerical experiments are also provided for demonstration

On the stability of stochastic jump kinetics

Motivated by the lack of a suitable constructive framework for analyzing popular stochastic models of Systems Biology, we devise conditions for existence and uniqueness of solutions to certain jump stochastic differential equations (SDEs). Working from simple examples we find reasonable and explicit assumptions on the driving coefficients for the SDE representation to make sense. By `reasonable' we mean that stronger assumptions generally do not hold for systems of practical interest. In particular, we argue against the traditional use of global Lipschitz conditions and certain common growth restrictions. By `explicit', finally, we like to highlight the fact that the various constants occurring among our assumptions all can be determined once the model is fixed. We show how basic long time estimates and some limit results for perturbations can be derived in this setting such that these can be contrasted with the corresponding estimates from deterministic dynamics. The main complication is that the natural path-wise representation is generated by a counting measure with an intensity that depends nonlinearly on the state

Stochastic model predictive control for constrained networked control systems with random time delay

In this paper the continuous time stochastic constrained optimal control problem is formulated for the class of networked control systems assuming that time delays follow a discrete-time, finite Markov chain . Polytopic overapproximations of the system's trajectories are employed to produce a polyhedral inner approximation of the non-convex constraint set resulting from imposing the constraints in continuous time. The problem is cast in a Markov jump linear systems (MJLS) framework and a stochastic MPC controller is calculated explicitly, oine, coupling dynamic programming with parametric piecewise quadratic (PWQ) optimization. The calculated control law leads to stochastic stability of the closed loop system, in the mean square sense and respects the state and input constraints in continuous time