An accelerated gradient descent method based on a non-monotone backtracking line search scheme for unconstrained optimization and image restoration problems

Abstract

summary:This study introduces an accelerated gradient descent method based on a non-monotone backtracking line search scheme. A simple adaptive quadratic model is enhanced by utilizing a real, positive definite scalar matrix derived from the Taylor expansion of the objective function, rather than relying on the exact Hessian. The global and superlinear convergence of the defined model is established under appropriate conditions. Numerical experiments on a set of standard unconstrained optimization problems and image restoration problems show that the new algorithm outperforms other comparable methods in terms of efficiency and robustness