29 research outputs found
Bisimulations and Logical Characterizations on Continuous-time Markov Decision Processes
In this paper we study strong and weak bisimulation equivalences for
continuous-time Markov decision processes (CTMDPs) and the logical
characterizations of these relations with respect to the continuous-time
stochastic logic (CSL). For strong bisimulation, it is well known that it is
strictly finer than CSL equivalence. In this paper we propose strong and weak
bisimulations for CTMDPs and show that for a subclass of CTMDPs, strong and
weak bisimulations are both sound and complete with respect to the equivalences
induced by CSL and the sub-logic of CSL without next operator respectively. We
then consider a standard extension of CSL, and show that it and its sub-logic
without X can be fully characterized by strong and weak bisimulations
respectively over arbitrary CTMDPs.Comment: The conference version of this paper was published at VMCAI 201
A Probabilistic Temporal Logic with Frequency Operators and Its Model Checking
Probabilistic Computation Tree Logic (PCTL) and Continuous Stochastic Logic
(CSL) are often used to describe specifications of probabilistic properties for
discrete time and continuous time, respectively. In PCTL and CSL, the
possibility of executions satisfying some temporal properties can be
quantitatively represented by the probabilistic extension of the path
quantifiers in their basic Computation Tree Logic (CTL), however, path formulae
of them are expressed via the same operators in CTL. For this reason, both of
them cannot represent formulae with quantitative temporal properties, such as
those of the form "some properties hold to more than 80% of time points (in a
certain bounded interval) on the path." In this paper, we introduce a new
temporal operator which expressed the notion of frequency of events, and define
probabilistic frequency temporal logic (PFTL) based on CTL\star. As a result,
we can easily represent the temporal properties of behavior in probabilistic
systems. However, it is difficult to develop a model checker for the full PFTL,
due to rich expressiveness. Accordingly, we develop a model-checking algorithm
for the CTL-like fragment of PFTL against finite-state Markov chains, and an
approximate model-checking algorithm for the bounded Linear Temporal Logic
(LTL) -like fragment of PFTL against countable-state Markov chains.Comment: In Proceedings INFINITY 2011, arXiv:1111.267
A Sample-Driven Solving Procedure for the Repeated Reachability of Quantum CTMCs
Reachability analysis plays a central role in system design and verification.
The reachability problem, denoted , asks whether the system
will meet the property after some time in a given time interval .
Recently, it has been considered on a novel kind of real-time systems --
quantum continuous-time Markov chains (QCTMCs), and embedded into the
model-checking algorithm. In this paper, we further study the repeated
reachability problem in QCTMCs, denoted , which
concerns whether the system starting from each \emph{absolute} time in will
meet the property after some coming \emph{relative} time in . First
of all, we reduce it to the real root isolation of a class of real-valued
functions (exponential polynomials), whose solvability is conditional to
Schanuel's conjecture being true. To speed up the procedure, we employ the
strategy of sampling. The original problem is shown to be equivalent to the
existence of a finite collection of satisfying samples. We then present a
sample-driven procedure, which can effectively refine the sample space after
each time of sampling, no matter whether the sample itself is successful or
conflicting. The improvement on efficiency is validated by randomly generated
instances. Hence the proposed method would be promising to attack the repeated
reachability problems together with checking other -regular properties
in a wide scope of real-time systems
SBIP 2.0: Statistical Model Checking Stochastic Real-time Systems
International audienceThis paper presents a major new release of SBIP, an extensi-ble statistical model checker for Metric (MTL) and Linear-time Temporal Logic (LTL) properties on respectively Generalized Semi-Markov Processes (GSMP), Continuous-Time (CTMC) and Discrete-Time Markov Chain (DTMC) models. The newly added support for MTL, GSMPs, CTMCs and rare events allows to capture both real-time and stochastic aspects, allowing faithful specification, modeling and analysis of real-life systems. SBIP is redesigned as an IDE providing project management, model edition, compilation, simulation, and statistical analysis
Fluid Model Checking
In this paper we investigate a potential use of fluid approximation
techniques in the context of stochastic model checking of CSL formulae. We
focus on properties describing the behaviour of a single agent in a (large)
population of agents, exploiting a limit result known also as fast simulation.
In particular, we will approximate the behaviour of a single agent with a
time-inhomogeneous CTMC which depends on the environment and on the other
agents only through the solution of the fluid differential equation. We will
prove the asymptotic correctness of our approach in terms of satisfiability of
CSL formulae and of reachability probabilities. We will also present a
procedure to model check time-inhomogeneous CTMC against CSL formulae
Bounding Mean First Passage Times in Population Continuous-Time Markov Chains
We consider the problem of bounding mean first passage times and reachability probabilities for the class of population continuous-time Markov chains, which capture stochastic interactions between groups of identical agents. The quantitative analysis of such models is notoriously difficult since typically neither state-based numerical approaches nor methods based on stochastic sampling give efficient and accurate results. Here, we propose a novel approach that leverages techniques from martingale theory and stochastic processes to generate constraints on the statistical moments of first passage time distributions. These constraints induce a semi-definite program that can be used to compute exact bounds on reachability probabilities and mean first passage times without numerically solving the transient probability distribution of the process or sampling from it. We showcase the method on some test examples and tailor it to models exhibiting multimodality, a class of particularly challenging scenarios from biology
On the robustness of temporal properties for stochastic models
Stochastic models such as Continuous-Time Markov Chains (CTMC) and Stochastic Hybrid Automata (SHA) are powerful formalisms to model and to reason about the dynamics of biological systems, due to their ability to capture the stochasticity inherent in biological processes. A classical question in formal modelling with clear relevance to biological modelling is the model checking problem. i.e. calculate the probability that a behaviour, expressed for instance in terms of a certain temporal logic formula, may occur in a given stochastic process. However, one may not only be interested in the notion of satisfiability, but also in the capacity of a system to mantain a particular emergent behaviour unaffected by the perturbations, caused e.g. from extrinsic noise, or by possible small changes in the model parameters. To address this issue, researchers from the verification community have recently proposed several notions of robustness for temporal logic providing suitable definitions of distance between a trajectory of a (deterministic) dynamical system and the boundaries of the set of trajectories satisfying the property of interest. The contributions of this paper are twofold. First, we extend the notion of robustness to stochastic systems, showing that this naturally leads to a distribution of robustness scores. By discussing two examples, we show how to approximate the distribution of the robustness score and its key indicators: the average robustness and the conditional average robustness. Secondly, we show how to combine these indicators with the satisfaction probability to address the system design problem, where the goal is to optimize some control parameters of a stochastic model in order to best maximize robustness of the desired specifications