Reinforcement Learning: A Survey

This paper surveys the field of reinforcement learning from a computer-science perspective. It is written to be accessible to researchers familiar with machine learning. Both the historical basis of the field and a broad selection of current work are summarized. Reinforcement learning is the problem faced by an agent that learns behavior through trial-and-error interactions with a dynamic environment. The work described here has a resemblance to work in psychology, but differs considerably in the details and in the use of the word ``reinforcement.'' The paper discusses central issues of reinforcement learning, including trading off exploration and exploitation, establishing the foundations of the field via Markov decision theory, learning from delayed reinforcement, constructing empirical models to accelerate learning, making use of generalization and hierarchy, and coping with hidden state. It concludes with a survey of some implemented systems and an assessment of the practical utility of current methods for reinforcement learning.Comment: See http://www.jair.org/ for any accompanying file

Time evolution of one-dimensional Quantum Many Body Systems

The level of current understanding of the physics of time-dependent strongly correlated quantum systems is far from complete, principally due to the lack of effective controlled approaches. Recently, there has been progress in the development of approaches for one-dimensional systems. We describe recent developments in the construction of numerical schemes for general (one-dimensional) Hamiltonians: in particular, schemes based on exact diagonalization techniques and on the density matrix renormalization group method (DMRG). We present preliminary results for spinless fermions with nearest-neighbor-interaction and investigate their accuracy by comparing with exact results.Comment: Contribution for the conference proceedings of the "IX. Training Course in the Physics of Correlated Electron Systems and High-Tc Superconductors" held in Vietri sul Mare (Salerno, Italy) in October 200