4,580 research outputs found
Plug-and-Play Methods Provably Converge with Properly Trained Denoisers
Plug-and-play (PnP) is a non-convex framework that integrates modern
denoising priors, such as BM3D or deep learning-based denoisers, into ADMM or
other proximal algorithms. An advantage of PnP is that one can use pre-trained
denoisers when there is not sufficient data for end-to-end training. Although
PnP has been recently studied extensively with great empirical success,
theoretical analysis addressing even the most basic question of convergence has
been insufficient. In this paper, we theoretically establish convergence of
PnP-FBS and PnP-ADMM, without using diminishing stepsizes, under a certain
Lipschitz condition on the denoisers. We then propose real spectral
normalization, a technique for training deep learning-based denoisers to
satisfy the proposed Lipschitz condition. Finally, we present experimental
results validating the theory.Comment: Published in the International Conference on Machine Learning, 201
Variational image regularization with Euler's elastica using a discrete gradient scheme
This paper concerns an optimization algorithm for unconstrained non-convex
problems where the objective function has sparse connections between the
unknowns. The algorithm is based on applying a dissipation preserving numerical
integrator, the Itoh--Abe discrete gradient scheme, to the gradient flow of an
objective function, guaranteeing energy decrease regardless of step size. We
introduce the algorithm, prove a convergence rate estimate for non-convex
problems with Lipschitz continuous gradients, and show an improved convergence
rate if the objective function has sparse connections between unknowns. The
algorithm is presented in serial and parallel versions. Numerical tests show
its use in Euler's elastica regularized imaging problems and its convergence
rate and compare the execution time of the method to that of the iPiano
algorithm and the gradient descent and Heavy-ball algorithms
- …