Article thumbnail
Location of Repository

A New Gradient Search Method Based on Grey Prediction Theory

By C. M. Hong

Abstract

[[abstract]]Optimization theory and methods play very important role for engineering design and applications. In many domains of engineering applications, it is usually the most important process to find near optimal solution. The gradient-descent method is widely used to solve many engineering optimization problems. But the gradient-descent method has some disadvantages for searching optimal solution. Firstly, its convergent speed is very slowly and is easy to trap into local minimum in the applications of many actual problems. Secondly, the learning rate of gradient-descent method must been determined adequately for different engineering problem. If the learning rate set very small, the convergent speed will be very slowly. If the learning rate is set very large, the searching of solution is very easy to generate trashing or divergence. The main goal of this research is to propose a new method that is based on grey prediction theory to improve the gradient-descent method. We use the idea of grey prediction to speed up effectively the searching speed of gradient-descent method, and improve the drawback that gradient-descent method is very easy trap into local minimum. From the experimental results, we can show the workings of the proposed method that can speed up effectively the searching speed of gradient-descent method, and improve the drawback that gradientdescent method is easy to trapped into local minimum.

Topics: Gradient-descent Method; Grey Prediction; Grey-Gradient Method; Optimization Method, [[classification]]53
Publisher: Springer-Verlag Berlin Heidelberg
Year: 2013
OAI identifier: oai:ir.lib.ntnu.edu.tw:309250000Q/123308
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://ir.lib.ntnu.edu.tw/ir/h... (external link)
  • Suggested articles


    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.