180 research outputs found
Multiscale Markov Decision Problems: Compression, Solution, and Transfer Learning
Many problems in sequential decision making and stochastic control often have
natural multiscale structure: sub-tasks are assembled together to accomplish
complex goals. Systematically inferring and leveraging hierarchical structure,
particularly beyond a single level of abstraction, has remained a longstanding
challenge. We describe a fast multiscale procedure for repeatedly compressing,
or homogenizing, Markov decision processes (MDPs), wherein a hierarchy of
sub-problems at different scales is automatically determined. Coarsened MDPs
are themselves independent, deterministic MDPs, and may be solved using
existing algorithms. The multiscale representation delivered by this procedure
decouples sub-tasks from each other and can lead to substantial improvements in
convergence rates both locally within sub-problems and globally across
sub-problems, yielding significant computational savings. A second fundamental
aspect of this work is that these multiscale decompositions yield new transfer
opportunities across different problems, where solutions of sub-tasks at
different levels of the hierarchy may be amenable to transfer to new problems.
Localized transfer of policies and potential operators at arbitrary scales is
emphasized. Finally, we demonstrate compression and transfer in a collection of
illustrative domains, including examples involving discrete and continuous
statespaces.Comment: 86 pages, 15 figure
Synchronization and Noise: A Mechanism for Regularization in Neural Systems
To learn and reason in the presence of uncertainty, the brain must be capable
of imposing some form of regularization. Here we suggest, through theoretical
and computational arguments, that the combination of noise with synchronization
provides a plausible mechanism for regularization in the nervous system. The
functional role of regularization is considered in a general context in which
coupled computational systems receive inputs corrupted by correlated noise.
Noise on the inputs is shown to impose regularization, and when synchronization
upstream induces time-varying correlations across noise variables, the degree
of regularization can be calibrated over time. The proposed mechanism is
explored first in the context of a simple associative learning problem, and
then in the context of a hierarchical sensory coding task. The resulting
qualitative behavior coincides with experimental data from visual cortex.Comment: 32 pages, 7 figures. under revie
Olympia and the epinikion. A creation of symbols
Papers from the second and third international symposia on symbolism at The Norwegian institute at Athens, September 21-24, 2000 and September 19-22, 2002
Multiple Resolution Image Classification
Binary image classifiction is a problem that has received much attention in recent years. In this paper we evaluate a selection of popular techniques in an effort to find a feature set/ classifier combination which generalizes well to full resolution image data. We then apply that system to images at one-half through one-sixteenth resolution, and consider the corresponding error rates. In addition, we further observe generalization performance as it depends on the number of training images, and lastly, compare the system's best error rates to that of a human performing an identical classification task given teh same set of test images
The definition of myth. Symbolical phenomena in ancient culture
Papers from the first international symposium
on symbolism at the University of Tromsø, June 4-7,1998
The symbol of the warrior in Greek tragedy?
Papers from the first international symposium
on symbolism at the University of Tromsø, June 4-7,1998
- …