24,554 research outputs found
Sparse Iterative Learning Control with Application to a Wafer Stage: Achieving Performance, Resource Efficiency, and Task Flexibility
Trial-varying disturbances are a key concern in Iterative Learning Control
(ILC) and may lead to inefficient and expensive implementations and severe
performance deterioration. The aim of this paper is to develop a general
framework for optimization-based ILC that allows for enforcing additional
structure, including sparsity. The proposed method enforces sparsity in a
generalized setting through convex relaxations using norms. The
proposed ILC framework is applied to the optimization of sampling sequences for
resource efficient implementation, trial-varying disturbance attenuation, and
basis function selection. The framework has a large potential in control
applications such as mechatronics, as is confirmed through an application on a
wafer stage.Comment: 12 pages, 14 figure
Sparse Modeling for Image and Vision Processing
In recent years, a large amount of multi-disciplinary research has been
conducted on sparse models and their applications. In statistics and machine
learning, the sparsity principle is used to perform model selection---that is,
automatically selecting a simple model among a large collection of them. In
signal processing, sparse coding consists of representing data with linear
combinations of a few dictionary elements. Subsequently, the corresponding
tools have been widely adopted by several scientific communities such as
neuroscience, bioinformatics, or computer vision. The goal of this monograph is
to offer a self-contained view of sparse modeling for visual recognition and
image processing. More specifically, we focus on applications where the
dictionary is learned and adapted to data, yielding a compact representation
that has been successful in various contexts.Comment: 205 pages, to appear in Foundations and Trends in Computer Graphics
and Visio
Balanced growth path solutions of a Boltzmann mean field game model for knowledge growth
In this paper we study balanced growth path solutions of a Boltzmann mean
field game model proposed by Lucas et al [13] to model knowledge growth in an
economy. Agents can either increase their knowledge level by exchanging ideas
in learning events or by producing goods with the knowledge they already have.
The existence of balanced growth path solutions implies exponential growth of
the overall production in time. We proof existence of balanced growth path
solutions if the initial distribution of individuals with respect to their
knowledge level satisfies a Pareto-tail condition. Furthermore we give first
insights into the existence of such solutions if in addition to production and
knowledge exchange the knowledge level evolves by geometric Brownian motion
Convex and Network Flow Optimization for Structured Sparsity
We consider a class of learning problems regularized by a structured
sparsity-inducing norm defined as the sum of l_2- or l_infinity-norms over
groups of variables. Whereas much effort has been put in developing fast
optimization techniques when the groups are disjoint or embedded in a
hierarchy, we address here the case of general overlapping groups. To this end,
we present two different strategies: On the one hand, we show that the proximal
operator associated with a sum of l_infinity-norms can be computed exactly in
polynomial time by solving a quadratic min-cost flow problem, allowing the use
of accelerated proximal gradient methods. On the other hand, we use proximal
splitting techniques, and address an equivalent formulation with
non-overlapping groups, but in higher dimension and with additional
constraints. We propose efficient and scalable algorithms exploiting these two
strategies, which are significantly faster than alternative approaches. We
illustrate these methods with several problems such as CUR matrix
factorization, multi-task learning of tree-structured dictionaries, background
subtraction in video sequences, image denoising with wavelets, and topographic
dictionary learning of natural image patches.Comment: to appear in the Journal of Machine Learning Research (JMLR
- …