136 research outputs found
Inertial Douglas-Rachford splitting for monotone inclusion problems
We propose an inertial Douglas-Rachford splitting algorithm for finding the
set of zeros of the sum of two maximally monotone operators in Hilbert spaces
and investigate its convergence properties. To this end we formulate first the
inertial version of the Krasnosel'ski\u{\i}--Mann algorithm for approximating
the set of fixed points of a nonexpansive operator, for which we also provide
an exhaustive convergence analysis. By using a product space approach we employ
these results to the solving of monotone inclusion problems involving linearly
composed and parallel-sum type operators and provide in this way iterative
schemes where each of the maximally monotone mappings is accessed separately
via its resolvent. We consider also the special instance of solving a
primal-dual pair of nonsmooth convex optimization problems and illustrate the
theoretical results via some numerical experiments in clustering and location
theory.Comment: arXiv admin note: text overlap with arXiv:1402.529
Advanced Algorithms and Common Solutions to Variational Inequalities
The paper aims to present advanced algorithms arising out of adding the inertial technical and shrinking projection terms to ordinary parallel and cyclic hybrid inertial sub-gradient extra-gradient algorithms (for short, PCHISE). Via these algorithms, common solutions of variational inequality problems (CSVIP) and strong convergence results are obtained in Hilbert spaces. The structure of this problem is to find a solution to a system of unrelated VI fronting for set-valued mappings. To clarify the acceleration, effectiveness, and performance of our parallel and cyclic algorithms, numerical contributions have been incorporated. In this direction, our results unify and generalize some related papers in the literature.This work was supported in part by the Basque Government under Grant IT1207-19
A first-order stochastic primal-dual algorithm with correction step
We investigate the convergence properties of a stochastic primal-dual
splitting algorithm for solving structured monotone inclusions involving the
sum of a cocoercive operator and a composite monotone operator. The proposed
method is the stochastic extension to monotone inclusions of a proximal method
studied in {\em Y. Drori, S. Sabach, and M. Teboulle, A simple algorithm for a
class of nonsmooth convex-concave saddle-point problems, 2015} and {\em I.
Loris and C. Verhoeven, On a generalization of the iterative soft-thresholding
algorithm for the case of non-separable penalty, 2011} for saddle point
problems. It consists in a forward step determined by the stochastic evaluation
of the cocoercive operator, a backward step in the dual variables involving the
resolvent of the monotone operator, and an additional forward step using the
stochastic evaluation of the cocoercive introduced in the first step. We prove
weak almost sure convergence of the iterates by showing that the primal-dual
sequence generated by the method is stochastic quasi Fej\'er-monotone with
respect to the set of zeros of the considered primal and dual inclusions.
Additional results on ergodic convergence in expectation are considered for the
special case of saddle point models
On Mann-type accelerated projection methods for pseudomonotone variational inequalities and common fixed points in Banach spaces
In this paper, we investigate two Mann-type accelerated projection procedures with line search method for solving the pseudomonotone variational inequality (VIP) and the common fixed-point problem (CFPP) of finitely many Bregman relatively nonexpansive mappings and a Bregman relatively asymptotically nonexpansive mapping in -uniformly convex and uniformly smooth Banach spaces. Under mild conditions, we show weak and strong convergence of the proposed algorithms to a common solution of the VIP and CFPP, respectively
A stochastic inertial forward-backward splitting algorithm for multivariate monotone inclusions
We propose an inertial forward-backward splitting algorithm to compute the
zero of a sum of two monotone operators allowing for stochastic errors in the
computation of the operators. More precisely, we establish almost sure
convergence in real Hilbert spaces of the sequence of iterates to an optimal
solution. Then, based on this analysis, we introduce two new classes of
stochastic inertial primal-dual splitting methods for solving structured
systems of composite monotone inclusions and prove their convergence. Our
results extend to the stochastic and inertial setting various types of
structured monotone inclusion problems and corresponding algorithmic solutions.
Application to minimization problems is discussed
- …