van Hoof, H.

Wang, Q.

English

Reinforcement learning is a promising paradigm for solving sequential decision-making problems, but low data efficiency and weak generalization across tasks are bottlenecks in real-world applications. Model-based meta reinforcement learning addresses these issues by learning dynamics and leveraging knowledge from prior experience. In this paper, we take a closer look at this framework and propose a new posterior sampling based approach that consists of a new model to identify task dynamics together with an amortized policy optimization step. We show that our model, called a graph structured surrogate model (GSSM), achieves competitive dynamics prediction performance with lower model complexity. Moreover, our approach in policy search is able to obtain high returns and allows fast execution by avoiding test-time policy gradient updates

International Migration, Integration and Social Cohesion online publications

Model-based Meta Reinforcement Learning using Graph Structured Surrogate Models and Amortized Policy Search

https://pure.uva.nl/ws/files/124300107/wang22z.pdf

Model-based Meta Reinforcement Learning using Graph Structured Surrogate Models and Amortized Policy Search

Abstract

Similar works

Full text

Available Versions

International Migration, Integration and Social Cohesion online publications