508 research outputs found
On the Optimal Linear Convergence Rate of a Generalized Proximal Point Algorithm
The proximal point algorithm (PPA) has been well studied in the literature.
In particular, its linear convergence rate has been studied by Rockafellar in
1976 under certain condition. We consider a generalized PPA in the generic
setting of finding a zero point of a maximal monotone operator, and show that
the condition proposed by Rockafellar can also sufficiently ensure the linear
convergence rate for this generalized PPA. Indeed we show that these linear
convergence rates are optimal. Both the exact and inexact versions of this
generalized PPA are discussed. The motivation to consider this generalized PPA
is that it includes as special cases the relaxed versions of some splitting
methods that are originated from PPA. Thus, linear convergence results of this
generalized PPA can be used to better understand the convergence of some widely
used algorithms in the literature. We focus on the particular convex
minimization context and specify Rockafellar's condition to see how to ensure
the linear convergence rate for some efficient numerical schemes, including the
classical augmented Lagrangian method proposed by Hensen and Powell in 1969 and
its relaxed version, the original alternating direction method of multipliers
(ADMM) by Glowinski and Marrocco in 1975 and its relaxed version (i.e., the
generalized ADMM by Eckstein and Bertsekas in 1992). Some refined conditions
weaker than existing ones are proposed in these particular contexts.Comment: 22 pages, 1 figur
A Douglas-Rachford splitting for semi-decentralized equilibrium seeking in generalized aggregative games
We address the generalized aggregative equilibrium seeking problem for
noncooperative agents playing average aggregative games with affine coupling
constraints. First, we use operator theory to characterize the generalized
aggregative equilibria of the game as the zeros of a monotone set-valued
operator. Then, we massage the Douglas-Rachford splitting to solve the monotone
inclusion problem and derive a single layer, semi-decentralized algorithm whose
global convergence is guaranteed under mild assumptions. The potential of the
proposed Douglas-Rachford algorithm is shown on a simplified resource
allocation game, where we observe faster convergence with respect to
forward-backward algorithms.Comment: arXiv admin note: text overlap with arXiv:1803.1044
- …