CORE
🇺🇦
make metadata, not war
Services
Services overview
Explore all CORE services
Access to raw data
API
Dataset
FastSync
Content discovery
Recommender
Discovery
OAI identifiers
OAI Resolver
Managing content
Dashboard
Bespoke contracts
Consultancy services
Support us
Support us
Membership
Sponsorship
Community governance
Advisory Board
Board of supporters
Research network
About
About us
Our mission
Team
Blog
FAQs
Contact us
research
Anytime Algorithms for Solving Possibilistic MDPs and Hybrid MDPs
Authors
D Dubois
D Dubois
+11 more
D Dubois
D Dubois
G Klir
G Shafer
L Kocsis
M Vose
P Auer
Philippe SMETS
R Bellman
R Sabbadin
R Yager
Publication date
4 March 2016
Publisher
'Springer Science and Business Media LLC'
Doi
Cite
Abstract
The ability of an agent to make quick, rational decisions in an uncertain environment is paramount for its applicability in realistic settings. Markov Decision Processes (MDP) provide such a framework, but can only model uncertainty that can be expressed as probabilities. Possibilistic counterparts of MDPs allow to model imprecise beliefs, yet they cannot accurately represent probabilistic sources of uncertainty and they lack the efficient online solvers found in the probabilistic MDP community. In this paper we advance the state of the art in three important ways. Firstly, we propose the first online planner for possibilistic MDP by adapting the Monte-Carlo Tree Search (MCTS) algorithm. A key component is the development of efficient search structures to sample possibility distributions based on the DPY transformation as introduced by Dubois, Prade, and Yager. Secondly, we introduce a hybrid MDP model that allows us to express both possibilistic and probabilistic uncertainty, where the hybrid model is a proper extension of both probabilistic and possibilistic MDPs. Thirdly, we demonstrate that MCTS algorithms can readily be applied to solve such hybrid models. © Springer International Publishing Switzerland 2016.This work is partially funded by EPSRC PACES project (Ref: EP/J012149/1).Peer Reviewe
Similar works
Full text
Open in the Core reader
Download PDF
Available Versions
Supporting member
Queen's University Belfast Research Portal
See this paper in CORE
Go to the repository landing page
Download from data provider
oai:pure.qub.ac.uk/portal:publ...
Last time updated on 10/05/2016
Digital.CSIC
See this paper in CORE
Go to the repository landing page
Download from data provider
oai:digital.csic.es:10261/1557...
Last time updated on 15/10/2017
Supporting member
Explore Bristol Research
See this paper in CORE
Go to the repository landing page
Download from data provider
oai:research-information.bris....
Last time updated on 30/06/2017
Crossref
See this paper in CORE
Go to the repository landing page
Download from data provider
info:doi/10.1007%2F978-3-319-3...
Last time updated on 30/03/2019