Sequential stopping for high-throughput experiments

In high-throughput experiments, the sample size is typically chosen informally. Most formal sample-size calculations depend critically on prior knowledge. We propose a sequential strategy that, by updating knowledge when new data are available, depends less critically on prior assumptions. Experiments are stopped or continued based on the potential benefits in obtaining additional data. The underlying decision-theoretic framework guarantees the design to proceed in a coherent fashion. We propose intuitively appealing, easy-to-implement utility functions. As in most sequential design problems, an exact solution is prohibitive. We propose a simulation-based approximation that uses decision boundaries. We apply the method to RNA-seq, microarray, and reverse-phase protein array studies and show its potential advantages. The approach has been added to the Bioconductor package gaga

Adversarial Risk Análysis for Counterterrorism Modelling

Recent large scale terrorist attacks have raised interest in models for resource allocation against terrorist threats. The unifying theme in this area is the need to develop methods for the analysis of allocation decisions when risks stem from the intentional actions of intelligent adversaries. Most approaches to these problems have a game theoretic flavor although there are also several interesting decision analytic based proposals. One of them is the recently introduced framework for adversarial risk analysis, which deals with decision making problems that involve intelligent opponents and uncertain outcomes. We explore how adversarial risk analysis addresses some standard counterterrorism models: simultaneous defend-attack models, sequential defend-attack-defend models and sequential defend-attack models with private information. For each model, we first assess critically what would be a typical game theoretic approach and then provide the corresponding solution proposed by the adversarial risk analysis framework, emphasizing how to coherently assess a predictive probability model of the adversary’s actions, in a context in which we aim at supporting decisions of a defender versus an attacker. This illustrates the application of adversarial risk analysis to basic counterterrorism models that may be used as basic building blocks for more complex risk analysis of counterterrorism problems

Potentials and Limits of Bayesian Networks to Deal with Uncertainty in the Assessment of Climate Change Adaptation Policies

Bayesian networks (BNs) have been increasingly applied to support management and decision-making processes under conditions of environmental variability and uncertainty, providing logical and holistic reasoning in complex systems since they succinctly and effectively translate causal assertions between variables into patterns of probabilistic dependence. Through a theoretical assessment of the features and the statistical rationale of BNs, and a review of specific applications to ecological modelling, natural resource management, and climate change policy issues, the present paper analyses the effectiveness of the BN model as a synthesis framework, which would allow the user to manage the uncertainty characterising the definition and implementation of climate change adaptation policies. The review will let emerge the potentials of the model to characterise, incorporate and communicate the uncertainty, with the aim to provide an efficient support to an informed and transparent decision making process. The possible drawbacks arising from the implementation of BNs are also analysed, providing potential solutions to overcome them.Adaptation to Climate Change, Bayesian Network, Uncertainty

Probabilistic analysis of cost-effectiveness models: choosing between treatment strategies for gastroesophageal reflux disease

When choosing between mutually exclusive treatment options, it is common to construct a cost-effectiveness frontier on the cost-effectiveness plane that represents efficient points from among the treatment choices. Treatment options internal to the frontier are considered inefficient and are excluded either by strict dominance or by appealing to the principle of extended dominance. However, when uncertainty is considered, options excluded under the baseline analysis may form part of the cost-effectiveness frontier. By adopting a Bayesian approach, where distributions for model parameters are specified, uncertainty in the decision concerning which treatment option should be implemented is addressed directly. The approach is illustrated using an example from a recently published cost-effectiveness analysis of different possible treatment strategies for gastroesophageal reflux disease.It is argued that probabilistic analyses should be encouraged because they have potential to quantify the strength of evidence in favor of particular treatment choices

Integration of biological, economic and sociological knowledge by Bayesian belief networks: the interdisciplinary evaluation of potential Baltic salmon management plan

There is a growing need to evaluate fisheries management plans in a comprehensive interdisciplinary context involving stakeholders. In this paper we demonstrate a probabilistic management model to evaluate potential management plans for Baltic salmon fisheries. The analysis is based on several studies carried out by scientists from respective disciplines. The main part consisted of biological and ecological stock assessment with integrated economic analysis of the commercial fisheries. Recreational fisheries were evaluated separately. Finally, a sociological study was conducted aimed at understanding stakeholder perspectives and potential commitment to alternative management plans. In order to synthesize the findings from these disparate studies a Bayesian Belief Network (BBN) methodology is used. The ranking of management options can depend on the stakeholder perspective. The trade-offs can be analysed quantitatively with the BBN model by combining, according to the decision maker’s set of priorities, utility functions that represent stakeholders’ views. We show how BBN can be used to evaluate robustness of management decisions to different priorities and various sources of uncertainty. In particular, the importance of sociological studies in quantifying uncertainty about the commitment of fishermen to management plans is highlighted by modelling the link between commitment and implementation success.Baltic salmon, bio-economic modelling, Bayesian Belief Network, expert knowledge, fisheries management, commitment and implementation uncertainty, management plan, recreational fisheries, stakeholders., Resource /Energy Economics and Policy,

Defining and characterising structural uncertainty in decision analytic models

An inappropriate structure for a decision analytic model can potentially invalidate estimates of cost-effectiveness and estimates of the value of further research. However, there are often a number of alternative and credible structural assumptions which can be made. Although it is common practice to acknowledge potential limitations in model structure, there is a lack of clarity about methods to characterize the uncertainty surrounding alternative structural assumptions and their contribution to decision uncertainty. A review of decision models commissioned by the NHS Health Technology Programme was undertaken to identify the types of model uncertainties described in the literature. A second review was undertaken to identify approaches to characterise these uncertainties. The assessment of structural uncertainty has received little attention in the health economics literature. A common method to characterise structural uncertainty is to compute results for each alternative model specification, and to present alternative results as scenario analyses. It is then left to decision maker to assess the credibility of the alternative structures in interpreting the range of results. The review of methods to explicitly characterise structural uncertainty identified two methods: 1) model averaging, where alternative models, with different specifications, are built, and their results averaged, using explicit prior distributions often based on expert opinion and 2) Model selection on the basis of prediction performance or goodness of fit. For a number of reasons these methods are neither appropriate nor desirable methods to characterize structural uncertainty in decision analytic models. When faced with a choice between multiple models, another method can be employed which allows structural uncertainty to be explicitly considered and does not ignore potentially relevant model structures. Uncertainty can be directly characterised (or parameterised) in the model itself. This method is analogous to model averaging on individual or sets of model inputs, but also allows the value of information associated with structural uncertainties to be resolved.