3,779 research outputs found
New insights on stochastic reachability
In this paper, we give new characterizations of the stochastic reachability problem for stochastic hybrid systems in the language of different theories that can be employed in studying stochastic processes (Markov processes, potential theory, optimal control). These characterizations are further used to obtain the probabilities involved in the context of stochastic reachability as viscosity solutions of some variational inequalities
Different Approaches on Stochastic Reachability as an Optimal Stopping Problem
Reachability analysis is the core of model checking of time systems. For
stochastic hybrid systems, this safety verification method is very little supported mainly
because of complexity and difficulty of the associated mathematical problems. In this
paper, we develop two main directions of studying stochastic reachability as an optimal
stopping problem. The first approach studies the hypotheses for the dynamic programming
corresponding with the optimal stopping problem for stochastic hybrid systems.
In the second approach, we investigate the reachability problem considering approximations
of stochastic hybrid systems. The main difficulty arises when we have to prove the
convergence of the value functions of the approximating processes to the value function
of the initial process. An original proof is provided
Abstractions of stochastic hybrid systems
Many control systems have large, infinite state space that can not be easily abstracted. One method to analyse and verify these systems is reachability analysis. It is frequently used for air traffic control and power plants. Because of lack of complete information about the environment or unpredicted changes, the stochastic approach is a viable alternative. In this paper, different ways of introducing rechability under uncertainty are presented. A new concept of stochastic bisimulation is introduced and its connection with the reachability analysis is established. The work is mainly motivated by safety critical situations in air traffic control (like collision detection and avoidance) and formal tools are based on stochastic analysis
A statistical inference method for the stochastic reachability analysis.
The main contribution of this paper is the characterization of reachability problem associated to stochastic hybrid systems in terms of imprecise probabilities. This provides the connection between reachability problem and Bayesian statistics. Using generalised Bayesian statistical inference, a new concept of conditional reach set probabilities is defined. Then possible algorithms to compute the reach set probabilities are derived
A Framework for Worst-Case and Stochastic Safety Verification Using Barrier Certificates
This paper presents a methodology for safety verification of continuous and hybrid systems in the worst-case and stochastic settings. In the worst-case setting, a function of state termed barrier certificate is used to certify that all trajectories of the system starting from a given initial set do not enter an unsafe region. No explicit computation of reachable sets is required in the construction of barrier certificates, which makes it possible to handle nonlinearity, uncertainty, and constraints directly within this framework. In the stochastic setting, our method computes an upper bound on the probability that a trajectory of the system reaches the unsafe set, a bound whose validity is proven by the existence of a barrier certificate. For polynomial systems, barrier certificates can be constructed using convex optimization, and hence the method is computationally tractable. Some examples are provided to illustrate the use of the method
Forward Stochastic Reachability Analysis for Uncontrolled Linear Systems using Fourier Transforms
We propose a scalable method for forward stochastic reachability analysis for
uncontrolled linear systems with affine disturbance. Our method uses Fourier
transforms to efficiently compute the forward stochastic reach probability
measure (density) and the forward stochastic reach set. This method is
applicable to systems with bounded or unbounded disturbance sets. We also
examine the convexity properties of the forward stochastic reach set and its
probability density. Motivated by the problem of a robot attempting to capture
a stochastically moving, non-adversarial target, we demonstrate our method on
two simple examples. Where traditional approaches provide approximations, our
method provides exact analytical expressions for the densities and probability
of capture.Comment: V3: HSCC 2017 (camera-ready copy), DOI updated, minor changes | V2:
Review comments included | V1: 10 pages, 12 figure
- …