Structured Possibilistic Planning Using Decision Diagrams

National audienceQualitative Possibilistic Mixed-Observable MDPs (π-MOMDPs), generalizing π-MDPs and π-POMDPs, are well-suited models to planning under uncertainty with mixed-observability when transition, observation and reward functions are not precisely known and can be qualitatively described. Functions defining the model as well as intermediate calculations are valued in a finite possibilistic scale L, which induces a finite belief state space under partial observability contrary to its probabilistic counterpart. In this paper, we propose the first study of factored π-MOMDP models in order to solve large structured planning problems under qualitative uncertainty, or considered as qualitative approximations of probabilistic problems. Building upon the SPUDD algorithm for solving factored (probabilistic) MDPs, we conceived a symbolic algorithm named PPUDD for solving factored π-MOMDPs. Whereas SPUDD’s decision diagrams’ leaves may be as large as the state space since their values are real numbers aggregated through additions and multiplications, PPUDD’s ones always remain in the finite scale L via min and max operations only. Our experiments show that PPUDD’s computation time is much lower than SPUDD, Symbolic-HSVI and APPL for possibilistic and probabilistic versions of the same benchmarks under either total or mixed observability, while still providing high-quality policies

Qualitative Possibilistic Mixed-Observable MDPs

National audiencePossibilistic and qualitative POMDPs (pi-POMDPs) are counterparts of POMDPs used to model situations where the agent's initial belief or observation probabilities are imprecise due to lack of past experiences or insufficient data collection. However, like probabilistic POMDPs, optimally solving pi-POMDPs is intractable: the finite belief state space exponentially grows with the number of system's states. In this paper, a possibilistic version of Mixed-Observable MDPs is presented to get around this issue: the complexity of solving pi-POMDPs, some state variables of which are fully observable, can be then dramatically reduced. A value iteration algorithm for this new formulation under infinite horizon is next proposed and the optimality of the returned policy (for a specified criterion) is shown assuming the existence of a "stay" action in some goal states. Experimental work finally shows that this possibilistic model outperforms probabilistic POMDPs commonly used in robotics, for a target recognition problem where the agent's observations are imprecise

Solving multi-criteria decision problems under possibilistic uncertainty using optimistic and pessimistic utilities

International audienceThis paper proposes a qualitative approach to solve multi-criteria decision making problems under possibilistic uncertainty. De-pending on the decision maker attitude with respect to uncertainty (i.e. optimistic or pessimistic) and on her attitude with respect to criteria (i.e. conjunctive or disjunctive), four ex-ante and four ex-post decision rules are dened and investigated. In particular, their coherence w.r.t. the principle of monotonicity, that allows Dynamic Programming is studied

Uncertainty in life cycle costing for long-range infrastructure. Part I: leveling the playing field to address uncertainties

Purpose Life cycle costing (LCC) is a state-of-the-art method to analyze investment decisions in infrastructure projects. However, uncertainties inherent in long-term planning question the credibility of LCC results. Previous research has not systematically linked sources and methods to address this uncertainty. Part I of this series develops a framework to collect and categorize different sources of uncertainty and addressing methods. This systematization is a prerequisite to further analyze the suitability of methods and levels the playing field for part II. Methods Past reviews have dealt with selected issues of uncertainty in LCC. However, none has systematically collected uncertainties and linked methods to address them. No comprehensive categorization has been published to date. Part I addresses these two research gaps by conducting a systematic literature review. In a rigorous four-step approach, we first scrutinized major databases. Second, we performed a practical and methodological screening to identify in total 115 relevant publications, mostly case studies. Third, we applied content analysis using MAXQDA. Fourth, we illustrated results and concluded upon the research gaps. Results and discussion We identified 33 sources of uncertainty and 24 addressing methods. Sources of uncertainties were categorized according to (i) its origin, i.e., parameter, model, and scenario uncertainty and (ii) the nature of uncertainty, i.e., aleatoric or epistemic uncertainty. The methods to address uncertainties were classified into deterministic, probabilistic, possibilistic, and other methods. With regard to sources of uncertainties, lack of data and data quality was analyzed most often. Most uncertainties having been discussed were located in the use stage. With regard to methods, sensitivity analyses were applied most widely, while more complex methods such as Bayesian models were used less frequently. Data availability and the individual expertise of LCC practitioner foremost influence the selection of methods. Conclusions This article complements existing research by providing a thorough systematization of uncertainties in LCC. However, an unambiguous categorization of uncertainties is difficult and overlapping occurs. Such a systemizing approach is nevertheless necessary for further analyses and levels the playing field for readers not yet familiar with the topic. Part I concludes the following: First, an investigation about which methods are best suited to address a certain type of uncertainty is still outstanding. Second, an analysis of types of uncertainty that have been insufficiently addressed in previous LCC cases is still missing. Part II will focus on these research gaps

Unsupervised tracking of time-evolving data streams and an application to short-term urban traffic flow forecasting

I am indebted to many people for their help and support I receive during my Ph.D. study and research at DIBRIS-University of Genoa. First and foremost, I would like to express my sincere thanks to my supervisors Prof.Dr. Masulli, and Prof.Dr. Rovetta for the invaluable guidance, frequent meetings, and discussions, and the encouragement and support on my way of research. I thanks all the members of the DIBRIS for their support and kindness during my 4 years Ph.D. I would like also to acknowledge the contribution of the projects Piattaforma per la mobili\ue0 Urbana con Gestione delle INformazioni da sorgenti eterogenee (PLUG-IN) and COST Action IC1406 High Performance Modelling and Simulation for Big Data Applications (cHiPSet). Last and most importantly, I wish to thanks my family: my wife Shaimaa who stays with me through the joys and pains; my daughter and son whom gives me happiness every-day; and my parents for their constant love and encouragement

Economic and regulatory uncertainty in renewable energy system design: a review

Renewable energy is increasingly mobilizing more investment around the globe. However, there has been little attention to evaluating economic and regulatory (E&R) uncertainties, despite their enormous impact on the project cashflows. Consequently, this review analyzes, classifies, and discusses 130 articles dealing with the design of renewable energy projects under E&R uncertainties. After performing a survey and identifying the selected manuscripts, and the few previous reviews on the matter, the following innovative categorization is designed: sources of uncertainty, uncertainty characterization methods, problem formulations, solution methods, and regulatory frameworks. The classification reveals that electricity price is the most considered source of uncertainty, often alone, despite the existence of six other equally influential groups of E&R uncertainties. In addition, real options and optimization arise as the two main approaches researchers use to solve problems in energy system design. Subsequently, the following aspects of interest are discussed in depth: how modeling can be improved, which are the most influential variables, and potential lines of research. Conclusions show the necessity of modeling E&R uncertainties with currently underrepresented methods, suggest several policy recommendations, and encourage the integration of prevailing approaches.Peer ReviewedObjectius de Desenvolupament Sostenible::7 - Energia Assequible i No Contaminant::7.2 - Per a 2030, augmentar substancialment el percentatge d’energia renovable en el con­junt de fonts d’energiaObjectius de Desenvolupament Sostenible::7 - Energia Assequible i No ContaminantPostprint (published version

Operational Decision Making under Uncertainty: Inferential, Sequential, and Adversarial Approaches

Modern security threats are characterized by a stochastic, dynamic, partially observable, and ambiguous operational environment. This dissertation addresses such complex security threats using operations research techniques for decision making under uncertainty in operations planning, analysis, and assessment. First, this research develops a new method for robust queue inference with partially observable, stochastic arrival and departure times, motivated by cybersecurity and terrorism applications. In the dynamic setting, this work develops a new variant of Markov decision processes and an algorithm for robust information collection in dynamic, partially observable and ambiguous environments, with an application to a cybersecurity detection problem. In the adversarial setting, this work presents a new application of counterfactual regret minimization and robust optimization to a multi-domain cyber and air defense problem in a partially observable environment