72,368 research outputs found
Fast Hierarchical Clustering and Other Applications of Dynamic Closest Pairs
We develop data structures for dynamic closest pair problems with arbitrary
distance functions, that do not necessarily come from any geometric structure
on the objects. Based on a technique previously used by the author for
Euclidean closest pairs, we show how to insert and delete objects from an
n-object set, maintaining the closest pair, in O(n log^2 n) time per update and
O(n) space. With quadratic space, we can instead use a quadtree-like structure
to achieve an optimal time bound, O(n) per update. We apply these data
structures to hierarchical clustering, greedy matching, and TSP heuristics, and
discuss other potential applications in machine learning, Groebner bases, and
local improvement algorithms for partition and placement problems. Experiments
show our new methods to be faster in practice than previously used heuristics.Comment: 20 pages, 9 figures. A preliminary version of this paper appeared at
the 9th ACM-SIAM Symp. on Discrete Algorithms, San Francisco, 1998, pp.
619-628. For source code and experimental results, see
http://www.ics.uci.edu/~eppstein/projects/pairs
Structured Sparsity: Discrete and Convex approaches
Compressive sensing (CS) exploits sparsity to recover sparse or compressible
signals from dimensionality reducing, non-adaptive sensing mechanisms. Sparsity
is also used to enhance interpretability in machine learning and statistics
applications: While the ambient dimension is vast in modern data analysis
problems, the relevant information therein typically resides in a much lower
dimensional space. However, many solutions proposed nowadays do not leverage
the true underlying structure. Recent results in CS extend the simple sparsity
idea to more sophisticated {\em structured} sparsity models, which describe the
interdependency between the nonzero components of a signal, allowing to
increase the interpretability of the results and lead to better recovery
performance. In order to better understand the impact of structured sparsity,
in this chapter we analyze the connections between the discrete models and
their convex relaxations, highlighting their relative advantages. We start with
the general group sparse model and then elaborate on two important special
cases: the dispersive and the hierarchical models. For each, we present the
models in their discrete nature, discuss how to solve the ensuing discrete
problems and then describe convex relaxations. We also consider more general
structures as defined by set functions and present their convex proxies.
Further, we discuss efficient optimization solutions for structured sparsity
problems and illustrate structured sparsity in action via three applications.Comment: 30 pages, 18 figure
Learning Optimal Control of Synchronization in Networks of Coupled Oscillators using Genetic Programming-based Symbolic Regression
Networks of coupled dynamical systems provide a powerful way to model systems
with enormously complex dynamics, such as the human brain. Control of
synchronization in such networked systems has far reaching applications in many
domains, including engineering and medicine. In this paper, we formulate the
synchronization control in dynamical systems as an optimization problem and
present a multi-objective genetic programming-based approach to infer optimal
control functions that drive the system from a synchronized to a
non-synchronized state and vice-versa. The genetic programming-based controller
allows learning optimal control functions in an interpretable symbolic form.
The effectiveness of the proposed approach is demonstrated in controlling
synchronization in coupled oscillator systems linked in networks of increasing
order complexity, ranging from a simple coupled oscillator system to a
hierarchical network of coupled oscillators. The results show that the proposed
method can learn highly-effective and interpretable control functions for such
systems.Comment: Submitted to nonlinear dynamic
Model predictive control techniques for hybrid systems
This paper describes the main issues encountered when applying model predictive control to hybrid processes. Hybrid model predictive control (HMPC) is a research field non-fully developed with many open challenges. The paper describes some of the techniques proposed by the research community to overcome the main problems encountered. Issues related to the stability and the solution of the optimization problem are also discussed. The paper ends by describing the results of a benchmark exercise in which several HMPC schemes were applied to a solar air conditioning plant.Ministerio de Eduación y Ciencia DPI2007-66718-C04-01Ministerio de Eduación y Ciencia DPI2008-0581
A distributed accelerated gradient algorithm for distributed model predictive control of a hydro power valley
A distributed model predictive control (DMPC) approach based on distributed
optimization is applied to the power reference tracking problem of a hydro
power valley (HPV) system. The applied optimization algorithm is based on
accelerated gradient methods and achieves a convergence rate of O(1/k^2), where
k is the iteration number. Major challenges in the control of the HPV include a
nonlinear and large-scale model, nonsmoothness in the power-production
functions, and a globally coupled cost function that prevents distributed
schemes to be applied directly. We propose a linearization and approximation
approach that accommodates the proposed the DMPC framework and provides very
similar performance compared to a centralized solution in simulations. The
provided numerical studies also suggest that for the sparsely interconnected
system at hand, the distributed algorithm we propose is faster than a
centralized state-of-the-art solver such as CPLEX
- …