A regularization algorithm allowing random noise in derivatives and inexact
function values is proposed for computing approximate local critical points of
any order for smooth unconstrained optimization problems. For an objective
function with Lipschitz continuous p-th derivative and given an arbitrary
optimality order qβ€p, it is shown that this algorithm will, in
expectation, compute such a point in at most
O((minjβ{1,β¦,q}βΟ΅jβ)βpβq+1p+1β)
inexact evaluations of f and its derivatives whenever qβ{1,2}, where
Ο΅jβ is the tolerance for jth order accuracy. This bound becomes at
most
O((minjβ{1,β¦,q}βΟ΅jβ)βpq(p+1)β)
inexact evaluations if q>2 and all derivatives are Lipschitz continuous.
Moreover these bounds are sharp in the order of the accuracy tolerances. An
extension to convexly constrained problems is also outlined.Comment: 22 page