Controlled diffusion processes with markovian switchings for modeling dynamical engineering systems

Abstract

A modeling approach to treat noisy engineering systems is presented. We deal with controlled systems that evolve in a continuous-time over finite time intervals, but also in continuous interaction with environments of intrinsic variability. We face the complexity of these systems by introducing a methodology based on Stochastic Differential Equations (SDE) models. We focus on specific type of complexity derived from unpredictable abrupt and/or structural changes. In this paper an approach based on controlled Stochastic Differential Equations with Markovian Switchings (SDEMS) is proposed. Technical conditions for the existence and uniqueness of the solution of these models are provided. We treat with nonlinear SDEMS that does not have closed solutions. Then, a numerical approximation to the exact solution based on the Euler- Maruyama Method (EM) is proposed. Convergence in strong sense and stability are provided. Promising applications for selected industrial biochemical systems are showed.markov chains, stochastic dynamical systems, numerical approaches for SDE