3,288 research outputs found
Batch Policy Learning under Constraints
When learning policies for real-world domains, two important questions arise:
(i) how to efficiently use pre-collected off-policy, non-optimal behavior data;
and (ii) how to mediate among different competing objectives and constraints.
We thus study the problem of batch policy learning under multiple constraints,
and offer a systematic solution. We first propose a flexible meta-algorithm
that admits any batch reinforcement learning and online learning procedure as
subroutines. We then present a specific algorithmic instantiation and provide
performance guarantees for the main objective and all constraints. To certify
constraint satisfaction, we propose a new and simple method for off-policy
policy evaluation (OPE) and derive PAC-style bounds. Our algorithm achieves
strong empirical results in different domains, including in a challenging
problem of simulated car driving subject to multiple constraints such as lane
keeping and smooth driving. We also show experimentally that our OPE method
outperforms other popular OPE techniques on a standalone basis, especially in a
high-dimensional setting
Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluation
This paper surveys the current state of the art in Natural Language
Generation (NLG), defined as the task of generating text or speech from
non-linguistic input. A survey of NLG is timely in view of the changes that the
field has undergone over the past decade or so, especially in relation to new
(usually data-driven) methods, as well as new applications of NLG technology.
This survey therefore aims to (a) give an up-to-date synthesis of research on
the core tasks in NLG and the architectures adopted in which such tasks are
organised; (b) highlight a number of relatively recent research topics that
have arisen partly as a result of growing synergies between NLG and other areas
of artificial intelligence; (c) draw attention to the challenges in NLG
evaluation, relating them to similar challenges faced in other areas of Natural
Language Processing, with an emphasis on different evaluation methods and the
relationships between them.Comment: Published in Journal of AI Research (JAIR), volume 61, pp 75-170. 118
pages, 8 figures, 1 tabl
Proceedings of the SAB'06 Workshop on Adaptive Approaches for Optimizing Player Satisfaction in Computer and Physical Games
These proceedings contain the papers presented at the Workshop on Adaptive approaches
for Optimizing Player Satisfaction in Computer and Physical Games held at the Ninth
international conference on the Simulation of Adaptive Behavior (SAB’06): From
Animals to Animats 9 in Rome, Italy on 1 October 2006.
We were motivated by the current state-of-the-art in intelligent game design using
adaptive approaches. Artificial Intelligence (AI) techniques are mainly focused on
generating human-like and intelligent character behaviors. Meanwhile there is generally
little further analysis of whether these behaviors contribute to the satisfaction of the
player. The implicit hypothesis motivating this research is that intelligent opponent
behaviors enable the player to gain more satisfaction from the game. This hypothesis may
well be true; however, since no notion of entertainment or enjoyment is explicitly
defined, there is therefore little evidence that a specific character behavior generates
enjoyable games.
Our objective for holding this workshop was to encourage the study, development,
integration, and evaluation of adaptive methodologies based on richer forms of humanmachine
interaction for augmenting gameplay experiences for the player. We wanted to
encourage a dialogue among researchers in AI, human-computer interaction and
psychology disciplines who investigate dissimilar methodologies for improving gameplay
experiences. We expected that this workshop would yield an understanding of state-ofthe-
art approaches for capturing and augmenting player satisfaction in interactive systems
such as computer games.
Our invited speaker was Hakon Steinø, Technical Producer of IO-Interactive, who
discussed applied AI research at IO-Interactive, portrayed the future trends of AI in
computer game industry and debated the use of academic-oriented methodologies for
augmenting player satisfaction. The sessions of presentations and discussions where
classified into three themes: Adaptive Learning, Examples of Adaptive Games and Player
Modeling.
The Workshop Committee did a great job in providing suggestions and informative
reviews for the submissions; thank you! This workshop was in part supported by the
Danish National Research Council (project no: 274-05-0511). Finally, thanks to all the
participants; we hope you found this to be useful!peer-reviewe
- …