13,563 research outputs found
Computational Methods for Sparse Solution of Linear Inverse Problems
The goal of the sparse approximation problem is to approximate a target signal using a linear combination of a few elementary signals drawn from a fixed collection. This paper surveys the major practical algorithms for sparse approximation. Specific attention is paid to computational issues, to the circumstances in which individual methods tend to perform well, and to the theoretical guarantees available. Many fundamental questions in electrical engineering, statistics, and applied mathematics can be posed as sparse approximation problems, making these algorithms versatile and relevant to a plethora of applications
Solving Large-Scale Optimization Problems Related to Bell's Theorem
Impossibility of finding local realistic models for quantum correlations due
to entanglement is an important fact in foundations of quantum physics, gaining
now new applications in quantum information theory. We present an in-depth
description of a method of testing the existence of such models, which involves
two levels of optimization: a higher-level non-linear task and a lower-level
linear programming (LP) task. The article compares the performances of the
existing implementation of the method, where the LPs are solved with the
simplex method, and our new implementation, where the LPs are solved with a
matrix-free interior point method. We describe in detail how the latter can be
applied to our problem, discuss the basic scenario and possible improvements
and how they impact on overall performance. Significant performance advantage
of the matrix-free interior point method over the simplex method is confirmed
by extensive computational results. The new method is able to solve problems
which are orders of magnitude larger. Consequently, the noise resistance of the
non-classicality of correlations of several types of quantum states, which has
never been computed before, can now be efficiently determined. An extensive set
of data in the form of tables and graphics is presented and discussed. The
article is intended for all audiences, no quantum-mechanical background is
necessary.Comment: 19 pages, 7 tables, 1 figur
Differential-Algebraic Equations and Beyond: From Smooth to Nonsmooth Constrained Dynamical Systems
The present article presents a summarizing view at differential-algebraic
equations (DAEs) and analyzes how new application fields and corresponding
mathematical models lead to innovations both in theory and in numerical
analysis for this problem class. Recent numerical methods for nonsmooth
dynamical systems subject to unilateral contact and friction illustrate the
topicality of this development.Comment: Preprint of Book Chapte
Decomposition Algorithms for Stochastic Programming on a Computational Grid
We describe algorithms for two-stage stochastic linear programming with
recourse and their implementation on a grid computing platform. In particular,
we examine serial and asynchronous versions of the L-shaped method and a
trust-region method. The parallel platform of choice is the dynamic,
heterogeneous, opportunistic platform provided by the Condor system. The
algorithms are of master-worker type (with the workers being used to solve
second-stage problems, and the MW runtime support library (which supports
master-worker computations) is key to the implementation. Computational results
are presented on large sample average approximations of problems from the
literature.Comment: 44 page
Low Complexity Regularization of Linear Inverse Problems
Inverse problems and regularization theory is a central theme in contemporary
signal processing, where the goal is to reconstruct an unknown signal from
partial indirect, and possibly noisy, measurements of it. A now standard method
for recovering the unknown signal is to solve a convex optimization problem
that enforces some prior knowledge about its structure. This has proved
efficient in many problems routinely encountered in imaging sciences,
statistics and machine learning. This chapter delivers a review of recent
advances in the field where the regularization prior promotes solutions
conforming to some notion of simplicity/low-complexity. These priors encompass
as popular examples sparsity and group sparsity (to capture the compressibility
of natural signals and images), total variation and analysis sparsity (to
promote piecewise regularity), and low-rank (as natural extension of sparsity
to matrix-valued data). Our aim is to provide a unified treatment of all these
regularizations under a single umbrella, namely the theory of partial
smoothness. This framework is very general and accommodates all low-complexity
regularizers just mentioned, as well as many others. Partial smoothness turns
out to be the canonical way to encode low-dimensional models that can be linear
spaces or more general smooth manifolds. This review is intended to serve as a
one stop shop toward the understanding of the theoretical properties of the
so-regularized solutions. It covers a large spectrum including: (i) recovery
guarantees and stability to noise, both in terms of -stability and
model (manifold) identification; (ii) sensitivity analysis to perturbations of
the parameters involved (in particular the observations), with applications to
unbiased risk estimation ; (iii) convergence properties of the forward-backward
proximal splitting scheme, that is particularly well suited to solve the
corresponding large-scale regularized optimization problem
- …