Communicating piecewise deterministic Markov processes

In this chapter we introduce the automata framework CPDP, which stands for Communicating Piecewise Deterministic Markov Processes. CPDP is developed for compositional modelling and analysis for a class of stochastic hybrid systems. We define a parallel composition operator, denoted as |PA|, for CPDPs, which can be used to interconnect component-CPDPs, to form the composite system (which consists of all components, interacting with each other). We show that the result of composing CPDPs with |PA| is again a CPDP (i.e., the class of CPDPs is closed under |PA|). Under certain conditions, the evolution of the state of a CPDP can be modelled as a stochastic process. We show that for these CPDPs, this stochastic process can always be modelled as a PDP (Piecewise Deterministic Markov Process) and we present an algorithm that finds the corresponding PDP of a CPDP. After that, we present an extended CPDP framework called value-passing CPDP. This framework provides richer interaction possibilities, where components can communicate information about their continuous states to each other. We give an Air Traffic Management example, modelled as a value-passing CPDP and we show that according to the algorithm, this CPDP behavior can be modelled as a PDP. Finally, we define bisimulation relations for CPDPs. We prove that bisimilar CPDPs exhibit equal stochastic behavior. Bisimulation can be used as a state reduction technique by substituting a CPDP (or a CPDP component) by a bisimulation-equivalent CPDP (or CPDP component) with a smaller state space. This can be done because we know that such a substitution will not change the stochastic behavior

Bisimulation for general stochastic hybrid systems

In this paper we define a bisimulation concept for some very general models for stochastic hybrid systems (general stochastic hybrid systems). The definition of bisimulation builds on the ideas of Edalat and of Larsen and Skou and of Joyal, Nielsen and Winskel. The main result is that this bisimulation for GSHS is indeed an equivalence relation. The secondary result is that this bisimulation relation for the stochastic hybrid system models used in this paper implies the same kind of bisimulation for their continuous parts and respectively for their jumping structures