1,697 research outputs found
Algorithmic Analysis of Qualitative and Quantitative Termination Problems for Affine Probabilistic Programs
In this paper, we consider termination of probabilistic programs with
real-valued variables. The questions concerned are:
1. qualitative ones that ask (i) whether the program terminates with
probability 1 (almost-sure termination) and (ii) whether the expected
termination time is finite (finite termination); 2. quantitative ones that ask
(i) to approximate the expected termination time (expectation problem) and (ii)
to compute a bound B such that the probability to terminate after B steps
decreases exponentially (concentration problem).
To solve these questions, we utilize the notion of ranking supermartingales
which is a powerful approach for proving termination of probabilistic programs.
In detail, we focus on algorithmic synthesis of linear ranking-supermartingales
over affine probabilistic programs (APP's) with both angelic and demonic
non-determinism. An important subclass of APP's is LRAPP which is defined as
the class of all APP's over which a linear ranking-supermartingale exists.
Our main contributions are as follows. Firstly, we show that the membership
problem of LRAPP (i) can be decided in polynomial time for APP's with at most
demonic non-determinism, and (ii) is NP-hard and in PSPACE for APP's with
angelic non-determinism; moreover, the NP-hardness result holds already for
APP's without probability and demonic non-determinism. Secondly, we show that
the concentration problem over LRAPP can be solved in the same complexity as
for the membership problem of LRAPP. Finally, we show that the expectation
problem over LRAPP can be solved in 2EXPTIME and is PSPACE-hard even for APP's
without probability and non-determinism (i.e., deterministic programs). Our
experimental results demonstrate the effectiveness of our approach to answer
the qualitative and quantitative questions over APP's with at most demonic
non-determinism.Comment: 24 pages, full version to the conference paper on POPL 201
Strong, Weak and Branching Bisimulation for Transition Systems and Markov Reward Chains: A Unifying Matrix Approach
We first study labeled transition systems with explicit successful
termination. We establish the notions of strong, weak, and branching
bisimulation in terms of boolean matrix theory, introducing thus a novel and
powerful algebraic apparatus. Next we consider Markov reward chains which are
standardly presented in real matrix theory. By interpreting the obtained matrix
conditions for bisimulations in this setting, we automatically obtain the
definitions of strong, weak, and branching bisimulation for Markov reward
chains. The obtained strong and weak bisimulations are shown to coincide with
some existing notions, while the obtained branching bisimulation is new, but
its usefulness is questionable
On the relation between Differential Privacy and Quantitative Information Flow
Differential privacy is a notion that has emerged in the community of
statistical databases, as a response to the problem of protecting the privacy
of the database's participants when performing statistical queries. The idea is
that a randomized query satisfies differential privacy if the likelihood of
obtaining a certain answer for a database is not too different from the
likelihood of obtaining the same answer on adjacent databases, i.e. databases
which differ from for only one individual. Information flow is an area of
Security concerned with the problem of controlling the leakage of confidential
information in programs and protocols. Nowadays, one of the most established
approaches to quantify and to reason about leakage is based on the R\'enyi min
entropy version of information theory. In this paper, we analyze critically the
notion of differential privacy in light of the conceptual framework provided by
the R\'enyi min information theory. We show that there is a close relation
between differential privacy and leakage, due to the graph symmetries induced
by the adjacency relation. Furthermore, we consider the utility of the
randomized answer, which measures its expected degree of accuracy. We focus on
certain kinds of utility functions called "binary", which have a close
correspondence with the R\'enyi min mutual information. Again, it turns out
that there can be a tight correspondence between differential privacy and
utility, depending on the symmetries induced by the adjacency relation and by
the query. Depending on these symmetries we can also build an optimal-utility
randomization mechanism while preserving the required level of differential
privacy. Our main contribution is a study of the kind of structures that can be
induced by the adjacency relation and the query, and how to use them to derive
bounds on the leakage and achieve the optimal utility
Value Iteration for Long-run Average Reward in Markov Decision Processes
Markov decision processes (MDPs) are standard models for probabilistic
systems with non-deterministic behaviours. Long-run average rewards provide a
mathematically elegant formalism for expressing long term performance. Value
iteration (VI) is one of the simplest and most efficient algorithmic approaches
to MDPs with other properties, such as reachability objectives. Unfortunately,
a naive extension of VI does not work for MDPs with long-run average rewards,
as there is no known stopping criterion. In this work our contributions are
threefold. (1) We refute a conjecture related to stopping criteria for MDPs
with long-run average rewards. (2) We present two practical algorithms for MDPs
with long-run average rewards based on VI. First, we show that a combination of
applying VI locally for each maximal end-component (MEC) and VI for
reachability objectives can provide approximation guarantees. Second, extending
the above approach with a simulation-guided on-demand variant of VI, we present
an anytime algorithm that is able to deal with very large models. (3) Finally,
we present experimental results showing that our methods significantly
outperform the standard approaches on several benchmarks
Stochastic Invariants for Probabilistic Termination
Termination is one of the basic liveness properties, and we study the
termination problem for probabilistic programs with real-valued variables.
Previous works focused on the qualitative problem that asks whether an input
program terminates with probability~1 (almost-sure termination). A powerful
approach for this qualitative problem is the notion of ranking supermartingales
with respect to a given set of invariants. The quantitative problem
(probabilistic termination) asks for bounds on the termination probability. A
fundamental and conceptual drawback of the existing approaches to address
probabilistic termination is that even though the supermartingales consider the
probabilistic behavior of the programs, the invariants are obtained completely
ignoring the probabilistic aspect.
In this work we address the probabilistic termination problem for
linear-arithmetic probabilistic programs with nondeterminism. We define the
notion of {\em stochastic invariants}, which are constraints along with a
probability bound that the constraints hold. We introduce a concept of {\em
repulsing supermartingales}. First, we show that repulsing supermartingales can
be used to obtain bounds on the probability of the stochastic invariants.
Second, we show the effectiveness of repulsing supermartingales in the
following three ways: (1)~With a combination of ranking and repulsing
supermartingales we can compute lower bounds on the probability of termination;
(2)~repulsing supermartingales provide witnesses for refutation of almost-sure
termination; and (3)~with a combination of ranking and repulsing
supermartingales we can establish persistence properties of probabilistic
programs.
We also present results on related computational problems and an experimental
evaluation of our approach on academic examples.Comment: Full version of a paper published at POPL 2017. 20 page
Women candidates and councillors in Scottish local government, 1974-2012
While significant attention has been paid to the levels of representation of women in both the Westminster Parliament and the Scottish Parliament, much less considered has been given to the position within local government. This article addresses that deficit for Scotland. It shows that for twenty-five years following the reorganisation of local government in Scotland in 1974 there was a slow but relatively steady increase in the numbers of female candidates and councillors, although more recently this appears to have since plateaued somewhat, together with a similar increase in the number of women councillors taking up more senior roles in Scotland’s councils. The article analyses the representation of women in Scottish local government over the period from 1974 to 2012 against the backdrop of significant change in Scotland, including a further restructuring of local government and the introduction of the Single Transferable Vote for council elections, the creation of the Scottish Parliament, the rise of the SNP and the decline of the Conservative Party
Recommended from our members
Avoidant Coping Style to High Imminence Threat Is Linked to Higher Anxiety-Like Behavior.
Human studies with self-reported measures have suggested a link between an avoidant coping style and high anxiety. Here, using the common marmoset as a model, we characterize the latent factors underlying behavioral responses of these monkeys towards low and high imminence threat and investigate if a predominantly avoidant behavioral response to high imminence threat is associated with greater anxiety-like behavior in a context of low imminence threat. Exploratory factor analysis (EFA) of the human intruder test of low imminence threat revealed a single factor in which a combination of active vigilance and avoidance responses underpinned anxiety-like behavior. In contrast, two negatively-associated factors were revealed in the model snake test reflecting active and avoidant coping to high imminence threat. Subsequent analysis showed that animals with a predominantly avoidant coping style on the model snake test displayed higher anxiety-like behavior on the human intruder test, findings consistent with those described in humans. Together they illustrate the richness of the behavioral repertoire displayed by marmosets in low and high imminence threatening contexts and the additional insight that factor analysis can provide by identifying the latent factors underlying these complex behavioral datasets. They also highlight the translational value of this approach when studying the neural circuits underlying complex anxiety-like states in this primate model
Quantum Markov Channels for Qubits
We examine stochastic maps in the context of quantum optics. Making use of
the master equation, the damping basis, and the Bloch picture we calculate a
non-unital, completely positive, trace-preserving map with unequal damping
eigenvalues. This results in what we call the squeezed vacuum channel. A
geometrical picture of the effect of stochastic noise on the set of pure state
qubit density operators is provided. Finally, we study the capacity of the
squeezed vacuum channel to transmit quantum information and to distribute EPR
states.Comment: 18 pages, 4 figure
Bandgaps in the propagation and scattering of surface water waves over cylindrical steps
Here we investigate the propagation and scattering of surface water waves by
arrays of bottom-mounted cylindrical steps. Both periodic and random
arrangements of the steps are considered. The wave transmission through the
arrays is computed using the multiple scattering method based upon a recently
derived formulation. For the periodic case, the results are compared to the
band structure calculation. We demonstrate that complete band gaps can be
obtained in such a system. Furthermore, we show that the randomization of the
location of the steps can significantly reduce the transmission of water waves.
Comparison with other systems is also discussed.Comment: 4 pages, 3 figure
Finding polynomial loop invariants for probabilistic programs
Quantitative loop invariants are an essential element in the verification of
probabilistic programs. Recently, multivariate Lagrange interpolation has been
applied to synthesizing polynomial invariants. In this paper, we propose an
alternative approach. First, we fix a polynomial template as a candidate of a
loop invariant. Using Stengle's Positivstellensatz and a transformation to a
sum-of-squares problem, we find sufficient conditions on the coefficients.
Then, we solve a semidefinite programming feasibility problem to synthesize the
loop invariants. If the semidefinite program is unfeasible, we backtrack after
increasing the degree of the template. Our approach is semi-complete in the
sense that it will always lead us to a feasible solution if one exists and
numerical errors are small. Experimental results show the efficiency of our
approach.Comment: accompanies an ATVA 2017 submissio
- …