CORE
🇺🇦
make metadata, not war
Services
Services overview
Explore all CORE services
Access to raw data
API
Dataset
FastSync
Content discovery
Recommender
Discovery
OAI identifiers
OAI Resolver
Managing content
Dashboard
Bespoke contracts
Consultancy services
Support us
Support us
Membership
Sponsorship
Community governance
Advisory Board
Board of supporters
Research network
About
About us
Our mission
Team
Blog
FAQs
Contact us
unknown
Data-Efficient Generalization of Robot Skills with Contextual Policy Search
Authors
MP Deisenroth
A Kupcsik
G Neumann
J Peters
Publication date
1 January 2013
Publisher
'Association for the Advancement of Artificial Intelligence (AAAI)'
Abstract
In robotics, controllers make the robot solve a task within a specific context. The context can describe the objectives of the robot or physical properties of the environment and is always specified before task execution. To generalize the controller to multiple contexts, we follow a hierarchical approach for policy learning: A lower-level policy controls the robot for a given context and an upper-level policy generalizes among contexts. Current approaches for learning such upper-level policies are based on model-free policy search, which require an excessive number of interactions of the robot with its environment. More data-efficient policy search approaches are model based but, thus far, without the capability of learning hierarchical policies. We propose a new model-based policy search approach that can also learn contextual upper-level policies. Our approach is based on learning probabilistic forward models for long-term predictions. Using these predictions, we use information-theoretic insights to improve the upper-level policy. Our method achieves a substantial improvement in learning speed compared to existing methods on simulated and real robotic tasks. Copyright © 2013, Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved
Similar works
Full text
Open in the Core reader
Download PDF
Available Versions
TUbiblio
See this paper in CORE
Go to the repository landing page
Download from data provider
oai:tubiblio.ulb.tu-darmstadt....
Last time updated on 05/04/2020
MPG.PuRe
See this paper in CORE
Go to the repository landing page
Download from data provider
oai:escidoc.org:escidoc:191002...
Last time updated on 23/08/2016
MPG.PuRe
See this paper in CORE
Go to the repository landing page
Download from data provider
oai:pure.mpg.de:item_1910025
Last time updated on 15/06/2019
Supporting member
Spiral - Imperial College Digital Repository
See this paper in CORE
Go to the repository landing page
Download from data provider
oai:spiral.imperial.ac.uk:1004...
Last time updated on 22/12/2013
University of Lincoln Institutional Repository
See this paper in CORE
Go to the repository landing page
Download from data provider
oai:eprints.lincoln.ac.uk:2577...
Last time updated on 17/02/2017