Article thumbnail

Short term memory in echo state networks

By H. Jaeger

Abstract

The report investigates the short-term memory capacity of echo state recurrent neural networks. A quantitative measure MC of short-term memory capacity is introduced. The main result is that MC 5 N for networks with linear Output units and i.i.d. input, where N is network size. Conditions under which these maximal memory capacities are realized are described. Several theoretical and practical examples demonstrate how the short-term memory capacities of echo state networks can be exploited for dynamic Pattern recognition and stochastic sequence modeling tasks

Topics: neuronales Netz, Echo-State Netz, überwachtes Lernen, Kurzzeitgedächtnis, neural network, echo state network, short-term memory, supervised learning
Publisher: GMD Forschungszentrum Informationstechnik, Sankt Augustin
Year: 2001
OAI identifier: oai:fraunhofer.de:B-73131
Provided by: Fraunhofer-ePrints
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://publica.fraunhofer.de/d... (external link)
  • Suggested articles


    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.