7,008 research outputs found
Successor features for transfer in reinforcement learning
Transfer in reinforcement learning refers to the notion that generalization should occur not only within a task but also across tasks. Our focus is on transfer where the reward functions vary across tasks while the environment's dynamics remain the same. The method we propose rests on two key ideas: "successor features," a value function representation that decouples the dynamics of the environment from the rewards, and "generalized policy improvement," a generalization of dynamic programming's policy improvement step that considers a set of policies rather than a single one. Put together, the two ideas lead to an approach that integrates seamlessly within the reinforcement learning framework and allows transfer to take place between tasks without any restriction. The proposed method also provides performance guarantees for the transferred policy even before any learning has taken place. We derive two theorems that set our approach in firm theoretical ground and present experiments that show that it successfully promotes transfer in practice
Recommended from our members
Blue and Red Cathodoluminescent Emission of Y2O3:Eu Phosphor Studied as a Function of Temperature in a Transmission Electron Microscope
Combined EELS, CL and STEM imaging are used to characterize and study Y2O3:Eu to confirm the variation in CL properties and photo-luminescent properties observed. The synthetic procedures used have facilitated this material to manifest a strong blue emission at low temperature with the expected red emission dominating at room temperature
A combinatorial approach to knot recognition
This is a report on our ongoing research on a combinatorial approach to knot
recognition, using coloring of knots by certain algebraic objects called
quandles. The aim of the paper is to summarize the mathematical theory of knot
coloring in a compact, accessible manner, and to show how to use it for
computational purposes. In particular, we address how to determine colorability
of a knot, and propose to use SAT solving to search for colorings. The
computational complexity of the problem, both in theory and in our
implementation, is discussed. In the last part, we explain how coloring can be
utilized in knot recognition
Competition Between Antiferromagnetic Order and Spin-Liquid Behavior in the Two-Dimensional Periodic Anderson Model at Half-Filling
We study the two-dimensional periodic Anderson model at half-filling using
quantum Monte Carlo (QMC) techniques. The ground state undergoes a magnetic
order-disorder transition as a function of the effective exchange coupling
between the conduction and localized bands. Low-lying spin and charge
excitations are determined using the maximum entropy method to analytically
continue the QMC data. At finite temperature we find a competition between the
Kondo effect and antiferromagnetic order which develops in the localized band
through Ruderman-Kittel-Kasuya-Yosida interactions.Comment: Revtex 3.0, 10 pages + 5 figures, UCSBTH-94-2
Polaron band formation in the Holstein model
We present numerical exact results for the polaronic band structure of the
Holstein molecular crystal model in one and two dimensions. The use of direct
Lanczos diagonalization technique, preserving the full dynamics and quantum
nature of phonons, allows us to analyze in detail the renormalization of both
quasiparticle bandwidth and dispersion by the electron-phonon interaction. For
the two-dimensional case some of our exact data are compared with the results
obtained in the framework of a recently developed finite cluster
strong-coupling perturbation theory.Comment: 10 pages (LaTeX), 6 figures (ps), submitted to Phys. Rev.
Description of recent large- neutron inclusive scattering data from liquid He
We report dynamical calculations for large- structure functions of liquid
He at =1.6 and 2.3 K and compare those with recent MARI data. We extend
those calculations far beyond the experimental range q\le 29\Ain in order to
study the approach of the response to its asymptotic limit for a system with
interactions having a strong short-range repulsion. We find only small
deviations from theoretical behavior, valid for smooth . We repeat an
extraction by Glyde et al of cumulant coefficients from data. We argue that
fits determine the single atom momentum distribution, but express doubt as to
the extraction of meaningful Final State Interaction parameters.Comment: 37 pages, 13 postscript fig
Changes in energy content of lunchtime purchases from fast food restaurants after introduction of calorie labelling: cross sectional customer surveys
Objective To assess the impact of fast food restaurants adding calorie labelling to menu items on the energy content of individual purchases
Fast algorithm for calculating two-photon absorption spectra
We report a numerical calculation of the two-photon absorption coefficient of
electrons in a binding potential using the real-time real-space higher-order
difference method. By introducing random vector averaging for the intermediate
state, the task of evaluating the two-dimensional time integral is reduced to
calculating two one-dimensional integrals. This allows the reduction of the
computation load down to the same order as that for the linear response
function. The relative advantage of the method compared to the straightforward
multi-dimensional time integration is greater for the calculation of non-linear
response functions of higher order at higher energy resolution.Comment: 4 pages, 2 figures. It will be published in Phys. Rev. E on 1, March,
199
LP 133-373: A New Chromospherically Active Eclipsing dMe Binary with a Distant, Cool White Dwarf Companion
We report the discovery of the partially eclipsing binary LP 133-373. Nearly identical eclipses along with observed photometric colors and spectroscopy indicate that it is a pair of chromospherically active dM4 stars in a circular 1.6 day orbit. Light and velocity curve modeling to our differential photometry and velocity data show that each star has a mass and radius of 0.340+/-0.014 Msolar and 0.33+/-0.02 Rsolar. The binary is itself part of a common proper motion pair with LP 133-374, a cool DC or possible DA white dwarf with a mass of 0.49-0.82 Msolar, which would make the system at least 3 Gyr ol
- …