7 research outputs found
Contributions to a computational theory of policy advice and avoidability
We present the starting elements of a mathematical theory of policy advice and avoidability. More specifically, we formalize a cluster of notions related to policy advice, such as policy, viability, reachability, and propose a novel approach for assisting decision making, based on the concept of avoidability. We formalize avoidability as a relation between current and future states, investigate under which conditions this relation is decidable and propose a generic procedure for assessing avoidability. The formalization is constructive and makes extensive use of the correspondence between dependent types and logical propositions, decidable judgments are obtained through computations. Thus, we aim for a computational theory, and emphasize the role that computer science can play in global system science
Semantic verification of dynamic programming
We prove that the generic framework for specifying and solving
finite-horizon, monadic sequential decision problems proposed in (Botta et
al.,2017) is semantically correct. By semantically correct we mean that, for a
problem specification and for any initial state compatible with ,
the verified optimal policies obtained with the framework maximize the
-measure of the -sums of the -rewards along all the possible
trajectories rooted in . In short, we prove that, given , the verified
computations encoded in the framework are the correct computations to do. The
main theorem is formulated as an equivalence between two value functions: the
first lies at the core of dynamic programming as originally formulated in
(Bellman,1957) and formalized by Botta et al. in Idris (Brady,2017), and the
second is a specification. The equivalence requires the two value functions to
be extensionally equal. Further, we identify and discuss three requirements
that measures of uncertainty have to fulfill for the main theorem to hold.
These turn out to be rather natural conditions that the expected-value measure
of stochastic uncertainty fulfills. The formal proof of the main theorem
crucially relies on a principle of preservation of extensional equality for
functors. We formulate and prove the semantic correctness of dynamic
programming as an extension of the Botta et al. Idris framework. However, the
theory can easily be implemented in Coq or Agda.Comment: Manuscript ID: JFP-2020-003
Extensional equality preservation and verified generic programming
In verified generic programming, one cannot exploit the structure of concrete
data types but has to rely on well chosen sets of specifications or abstract
data types (ADTs). Functors and monads are at the core of many applications of
functional programming. This raises the question of what useful ADTs for
verified functors and monads could look like. The functorial map of many
important monads preserves extensional equality. For instance, if are extensionally equal, that is, , then and are also
extensionally equal. This suggests that preservation of extensional equality
could be a useful principle in verified generic programming. We explore this
possibility with a minimalist approach: we deal with (the lack of) extensional
equality in Martin-L\"of's intensional type theories without extending the
theories or using full-fledged setoids. Perhaps surprisingly, this minimal
approach turns out to be extremely useful. It allows one to derive simple
generic proofs of monadic laws but also verified, generic results in dynamical
systems and control theory. In turn, these results avoid tedious code
duplication and ad-hoc proofs. Thus, our work is a contribution towards
pragmatic, verified generic programming.Comment: Manuscript ID: JFP-2020-003
Type theory as a framework for modelling and programming
In the context provided by the proceedings of the UVMP track of ISoLA 2016, we propose Type Theory as a suitable framework for both modelling and programming. We show that it fits most of the requirements put forward on such frameworks by Broy et al. and discuss some of the objections that can be raised against it
On the correctness of monadic backward induction
In control theory, to solve a finite-horizon sequential decision problem (SDP) commonly means to find a list of decision rules that result in an optimal expected total reward (or cost) when taking a given number of decision steps. SDPs are routinely solved using Bellman\u27s backward induction. Textbook authors (e.g. Bertsekas or Puterman) typically give more or less formal proofs to show that the backward induction algorithm is correct as solution method for deterministic and stochastic SDPs. Botta, Jansson and Ionescu propose a generic framework for finite horizon, monadic SDPs together with a monadic version of backward induction for solving such SDPs. In monadic SDPs, the monad captures a generic notion of uncertainty, while a generic measure function aggregates rewards. In the present paper, we define a notion of correctness for monadic SDPs and identify three conditions that allow us to prove a correctness result for monadic backward induction that is comparable to textbook correctness proofs for ordinary backward induction. The conditions that we impose are fairly general and can be cast in category-theoretical terms using the notion of Eilenberg-Moore algebra. They hold in familiar settings like those of deterministic or stochastic SDPs, but we also give examples in which they fail. Our results show that backward induction can safely be employed for a broader class of SDPs than usually treated in textbooks. However, they also rule out certain instances that were considered admissible in the context of Botta et al. \u27s generic framework. Our development is formalised in Idris as an extension of the Botta et al. framework and the sources are available as supplementary material
Responsibility Under Uncertainty: Which Climate Decisions Matter Most?
We propose a new method for estimating how much decisions under monadic uncertainty matter. The method is generic and suitable for measuring responsibility in finite horizon sequential decision processes. It fulfills âfairnessâ requirements and three natural conditions for responsibility measures: agency, avoidance and causal relevance. We apply the method to study how much decisions matter in a stylized greenhouse gas emissions process in which a decision maker repeatedly faces two options: start a âgreenâ transition to a decarbonized society or further delay such a transition. We account for the fact that climate decisions are rarely implemented with certainty and that their consequences on the climate and on the global economy are uncertain. We discover that a âmoralâ approach towards decision making â doing the right thing even though the probability of success becomes increasingly small â is rational over a wide range of uncertainties