Location of Repository

2009 13th Panhellenic Conference on Informatics On Descent Spectral CG algorithms for Training Recurrent Neural Networks

By I. E. Livieris, D. G. Sotiropoulos and P. Pintelas

Abstract

Abstract—In this paper, we evaluate the performance of descent conjugate gradient methods and we propose a new algorithm for training recurrent neural networks. The presented algorithm preserves the advantages of classical conjugate gradient methods while simultaneously avoids the usually inefficient restarts. Simulation results are also presented using three different recurrent neural network architectures in a variety of benchmarks. Index Terms—Recurrent neural networks, descent spectral conjugate gradient methods, sufficient descent property, performance profiles. I

Year: 2013
OAI identifier: oai:CiteSeerX.psu:10.1.1.309.6897
Provided by: CiteSeerX
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://citeseerx.ist.psu.edu/v... (external link)
  • http://www.math.upatras.gr/~dg... (external link)
  • Suggested articles


    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.