1 research outputs found
Controlling Recurrent Neural Networks by Conceptors
The human brain is a dynamical system whose extremely complex sensor-driven
neural processes give rise to conceptual, logical cognition. Understanding the
interplay between nonlinear neural dynamics and concept-level cognition remains
a major scientific challenge. Here I propose a mechanism of neurodynamical
organization, called conceptors, which unites nonlinear dynamics with basic
principles of conceptual abstraction and logic. It becomes possible to learn,
store, abstract, focus, morph, generalize, de-noise and recognize a large
number of dynamical patterns within a single neural system; novel patterns can
be added without interfering with previously acquired ones; neural noise is
automatically filtered. Conceptors help explaining how conceptual-level
information processing emerges naturally and robustly in neural systems, and
remove a number of roadblocks in the theory and applications of recurrent
neural networks.Comment: 200 pages, 50 figure