35,246 research outputs found
Convex optimization over intersection of simple sets: improved convergence rate guarantees via an exact penalty approach
We consider the problem of minimizing a convex function over the intersection
of finitely many simple sets which are easy to project onto. This is an
important problem arising in various domains such as machine learning. The main
difficulty lies in finding the projection of a point in the intersection of
many sets. Existing approaches yield an infeasible point with an
iteration-complexity of for nonsmooth problems with no
guarantees on the in-feasibility. By reformulating the problem through exact
penalty functions, we derive first-order algorithms which not only guarantees
that the distance to the intersection is small but also improve the complexity
to and for smooth functions. For
composite and smooth problems, this is achieved through a saddle-point
reformulation where the proximal operators required by the primal-dual
algorithms can be computed in closed form. We illustrate the benefits of our
approach on a graph transduction problem and on graph matching
Templates for Convex Cone Problems with Applications to Sparse Signal Recovery
This paper develops a general framework for solving a variety of convex cone
problems that frequently arise in signal processing, machine learning,
statistics, and other fields. The approach works as follows: first, determine a
conic formulation of the problem; second, determine its dual; third, apply
smoothing; and fourth, solve using an optimal first-order method. A merit of
this approach is its flexibility: for example, all compressed sensing problems
can be solved via this approach. These include models with objective
functionals such as the total-variation norm, ||Wx||_1 where W is arbitrary, or
a combination thereof. In addition, the paper also introduces a number of
technical contributions such as a novel continuation scheme, a novel approach
for controlling the step size, and some new results showing that the smooth and
unsmoothed problems are sometimes formally equivalent. Combined with our
framework, these lead to novel, stable and computationally efficient
algorithms. For instance, our general implementation is competitive with
state-of-the-art methods for solving intensively studied problems such as the
LASSO. Further, numerical experiments show that one can solve the Dantzig
selector problem, for which no efficient large-scale solvers exist, in a few
hundred iterations. Finally, the paper is accompanied with a software release.
This software is not a single, monolithic solver; rather, it is a suite of
programs and routines designed to serve as building blocks for constructing
complete algorithms.Comment: The TFOCS software is available at http://tfocs.stanford.edu This
version has updated reference
Uniform Penalty inversion of two-dimensional NMR Relaxation data
The inversion of two-dimensional NMR data is an ill-posed problem related to
the numerical computation of the inverse Laplace transform. In this paper we
present the 2DUPEN algorithm that extends the Uniform Penalty (UPEN) algorithm
[Borgia, Brown, Fantazzini, {\em Journal of Magnetic Resonance}, 1998] to
two-dimensional data. The UPEN algorithm, defined for the inversion of
one-dimensional NMR relaxation data, uses Tikhonov-like regularization and
optionally non-negativity constraints in order to implement locally adapted
regularization. In this paper, we analyze the regularization properties of this
approach. Moreover, we extend the one-dimensional UPEN algorithm to the
two-dimensional case and present an efficient implementation based on the
Newton Projection method. Without any a-priori information on the noise norm,
2DUPEN automatically computes the locally adapted regularization parameters and
the distribution of the unknown NMR parameters by using variable smoothing.
Results of numerical experiments on simulated and real data are presented in
order to illustrate the potential of the proposed method in reconstructing
peaks and flat regions with the same accuracy
- …