6,399 research outputs found
Design of Optimal Sparse Feedback Gains via the Alternating Direction Method of Multipliers
We design sparse and block sparse feedback gains that minimize the variance
amplification (i.e., the norm) of distributed systems. Our approach
consists of two steps. First, we identify sparsity patterns of feedback gains
by incorporating sparsity-promoting penalty functions into the optimal control
problem, where the added terms penalize the number of communication links in
the distributed controller. Second, we optimize feedback gains subject to
structural constraints determined by the identified sparsity patterns. In the
first step, the sparsity structure of feedback gains is identified using the
alternating direction method of multipliers, which is a powerful algorithm
well-suited to large optimization problems. This method alternates between
promoting the sparsity of the controller and optimizing the closed-loop
performance, which allows us to exploit the structure of the corresponding
objective functions. In particular, we take advantage of the separability of
the sparsity-promoting penalty functions to decompose the minimization problem
into sub-problems that can be solved analytically. Several examples are
provided to illustrate the effectiveness of the developed approach.Comment: To appear in IEEE Trans. Automat. Contro
Structured Sparsity: Discrete and Convex approaches
Compressive sensing (CS) exploits sparsity to recover sparse or compressible
signals from dimensionality reducing, non-adaptive sensing mechanisms. Sparsity
is also used to enhance interpretability in machine learning and statistics
applications: While the ambient dimension is vast in modern data analysis
problems, the relevant information therein typically resides in a much lower
dimensional space. However, many solutions proposed nowadays do not leverage
the true underlying structure. Recent results in CS extend the simple sparsity
idea to more sophisticated {\em structured} sparsity models, which describe the
interdependency between the nonzero components of a signal, allowing to
increase the interpretability of the results and lead to better recovery
performance. In order to better understand the impact of structured sparsity,
in this chapter we analyze the connections between the discrete models and
their convex relaxations, highlighting their relative advantages. We start with
the general group sparse model and then elaborate on two important special
cases: the dispersive and the hierarchical models. For each, we present the
models in their discrete nature, discuss how to solve the ensuing discrete
problems and then describe convex relaxations. We also consider more general
structures as defined by set functions and present their convex proxies.
Further, we discuss efficient optimization solutions for structured sparsity
problems and illustrate structured sparsity in action via three applications.Comment: 30 pages, 18 figure
- …