434 research outputs found
Verification and Control of Partially Observable Probabilistic Real-Time Systems
We propose automated techniques for the verification and control of
probabilistic real-time systems that are only partially observable. To formally
model such systems, we define an extension of probabilistic timed automata in
which local states are partially visible to an observer or controller. We give
a probabilistic temporal logic that can express a range of quantitative
properties of these models, relating to the probability of an event's
occurrence or the expected value of a reward measure. We then propose
techniques to either verify that such a property holds or to synthesise a
controller for the model which makes it true. Our approach is based on an
integer discretisation of the model's dense-time behaviour and a grid-based
abstraction of the uncountable belief space induced by partial observability.
The latter is necessarily approximate since the underlying problem is
undecidable, however we show how both lower and upper bounds on numerical
results can be generated. We illustrate the effectiveness of the approach by
implementing it in the PRISM model checker and applying it to several case
studies, from the domains of computer security and task scheduling
10271 Abstracts Collection -- Verification over discrete-continuous boundaries
From 4 July 2010 to 9 July 2010, the Dagstuhl Seminar 10271
``Verification over discrete-continuous boundaries\u27\u27
was held in Schloss Dagstuhl~--~Leibniz Center for Informatics.
During the seminar, several participants presented their current
research, and ongoing work and open problems were discussed. Abstracts of
the presentations given during the seminar as well as abstracts of
seminar results and ideas are put together in this paper. The first section
describes the seminar topics and goals in general.
Links to extended abstracts or full papers are provided, if available
Verification and control of partially observable probabilistic systems
We present automated techniques for the verification and control of partially observable, probabilistic systems for both discrete and dense models of time. For the discrete-time case, we formally model these systems using partially observable Markov decision processes; for dense time, we propose an extension of probabilistic timed automata in which local states are partially visible to an observer or controller. We give probabilistic temporal logics that can express a range of quantitative properties of these models, relating to the probability of an event’s occurrence or the expected value of a reward measure. We then propose techniques to either verify that such a property holds or synthesise a controller for the model which makes it true. Our approach is based on a grid-based abstraction of the uncountable belief space induced by partial observability and, for dense-time models, an integer discretisation of real-time behaviour. The former is necessarily approximate since the underlying problem is undecidable, however we show how both lower and upper bounds on numerical results can be generated. We illustrate the effectiveness of the approach by implementing it in the PRISM model checker and applying it to several case studies from the domains of task and network scheduling, computer security and planning
Deterministic and Probabilistic Boolean Control Networks and their application to Gene Regulatory Networks
This thesis focuses on Deterministic and Probabilistic Boolean Control Networks and their application to some specific Gene Regulatory Networks.
At first, some introductory materials about Boolean Logic, Left Semi-tensor Product and Probability are presented in order to explain in detail the concepts of Boolean Networks, Boolean Control Networks, Probabilistic Boolean Networks and Probabilistic Boolean Control Networks. These networks can be modelled in state-space and their representation, obtained by means of the left semi-tensor product, is called algebraic form.
Subsequently, the thesis concentrates on presenting the fundamental properties of these networks such as the classical Systems Theory properties of stability, reachability, controllability and stabilisation. Afterwards, the attention is drawn towards the comparison between deterministic and probabilistic boolean networks.
Finally, two examples of Gene Regulatory Networks are modelled and analysed by means of a Boolean Network and a Probabilistic Boolean Network.This thesis focuses on Deterministic and Probabilistic Boolean Control Networks and their application to some specific Gene Regulatory Networks.
At first, some introductory materials about Boolean Logic, Left Semi-tensor Product and Probability are presented in order to explain in detail the concepts of Boolean Networks, Boolean Control Networks, Probabilistic Boolean Networks and Probabilistic Boolean Control Networks. These networks can be modelled in state-space and their representation, obtained by means of the left semi-tensor product, is called algebraic form.
Subsequently, the thesis concentrates on presenting the fundamental properties of these networks such as the classical Systems Theory properties of stability, reachability, controllability and stabilisation. Afterwards, the attention is drawn towards the comparison between deterministic and probabilistic boolean networks.
Finally, two examples of Gene Regulatory Networks are modelled and analysed by means of a Boolean Network and a Probabilistic Boolean Network
Conformal Quantitative Predictive Monitoring of STL Requirements for Stochastic Processes
We consider the problem of predictive monitoring (PM), i.e., predicting at
runtime the satisfaction of a desired property from the current system's state.
Due to its relevance for runtime safety assurance and online control, PM
methods need to be efficient to enable timely interventions against predicted
violations, while providing correctness guarantees. We introduce
\textit{quantitative predictive monitoring (QPM)}, the first PM method to
support stochastic processes and rich specifications given in Signal Temporal
Logic (STL). Unlike most of the existing PM techniques that predict whether or
not some property is satisfied, QPM provides a quantitative measure of
satisfaction by predicting the quantitative (aka robust) STL semantics of
. QPM derives prediction intervals that are highly efficient to compute
and with probabilistic guarantees, in that the intervals cover with arbitrary
probability the STL robustness values relative to the stochastic evolution of
the system. To do so, we take a machine-learning approach and leverage recent
advances in conformal inference for quantile regression, thereby avoiding
expensive Monte-Carlo simulations at runtime to estimate the intervals. We also
show how our monitors can be combined in a compositional manner to handle
composite formulas, without retraining the predictors nor sacrificing the
guarantees. We demonstrate the effectiveness and scalability of QPM over a
benchmark of four discrete-time stochastic processes with varying degrees of
complexity
Deep Learning for Abstraction, Control and Monitoring of Complex Cyber-Physical Systems
Cyber-Physical Systems (CPS) consist of digital devices that interact with some physical components. Their popularity and complexity are growing exponentially, giving birth to new, previously unexplored, safety-critical application domains. As CPS permeate our daily lives, it becomes imperative
to reason about their reliability. Formal methods provide rigorous techniques for verification, control and synthesis of safe and reliable CPS. However, these methods do not scale with the complexity of the system, thus their applicability to real-world problems is limited. A promising strategy is to leverage deep learning techniques to tackle the scalability issue of formal methods, transforming unfeasible problems into approximately solvable ones. The approximate models are trained over observations which are solutions of the formal problem. In this thesis, we focus on the following tasks, which are computationally challenging: the modeling and the simulation of a complex stochastic model, the design of a safe and robust control policy for a system acting in a highly uncertain environment and the runtime verification problem under full or partial observability. Our approaches, based on deep
learning, are indeed applicable to real-world complex and safety-critical systems acting under strict real-time constraints and in presence of a significant
amount of uncertainty.Cyber-Physical Systems (CPS) consist of digital devices that interact with some physical components. Their popularity and complexity are growing exponentially, giving birth to new, previously unexplored, safety-critical application domains. As CPS permeate our daily lives, it becomes imperative
to reason about their reliability. Formal methods provide rigorous techniques for verification, control and synthesis of safe and reliable CPS. However, these methods do not scale with the complexity of the system, thus their applicability to real-world problems is limited. A promising strategy is to leverage deep learning techniques to tackle the scalability issue of formal methods, transforming unfeasible problems into approximately solvable ones. The approximate models are trained over observations which are solutions of the formal problem. In this thesis, we focus on the following tasks, which are computationally challenging: the modeling and the simulation of a complex stochastic model, the design of a safe and robust control policy for a system acting in a highly uncertain environment and the runtime verification problem under full or partial observability. Our approaches, based on deep
learning, are indeed applicable to real-world complex and safety-critical systems acting under strict real-time constraints and in presence of a significant
amount of uncertainty
- …