416 research outputs found
Enhanced Lasso Recovery on Graph
This work aims at recovering signals that are sparse on graphs. Compressed
sensing offers techniques for signal recovery from a few linear measurements
and graph Fourier analysis provides a signal representation on graph. In this
paper, we leverage these two frameworks to introduce a new Lasso recovery
algorithm on graphs. More precisely, we present a non-convex, non-smooth
algorithm that outperforms the standard convex Lasso technique. We carry out
numerical experiments on three benchmark graph datasets
An Adaptive Total Variation Algorithm for Computing the Balanced Cut of a Graph
We propose an adaptive version of the total variation algorithm proposed in
[3] for computing the balanced cut of a graph. The algorithm from [3] used a
sequence of inner total variation minimizations to guarantee descent of the
balanced cut energy as well as convergence of the algorithm. In practice the
total variation minimization step is never solved exactly. Instead, an accuracy
parameter is specified and the total variation minimization terminates once
this level of accuracy is reached. The choice of this parameter can vastly
impact both the computational time of the overall algorithm as well as the
accuracy of the result. Moreover, since the total variation minimization step
is not solved exactly, the algorithm is not guarantied to be monotonic. In the
present work we introduce a new adaptive stopping condition for the total
variation minimization that guarantees monotonicity. This results in an
algorithm that is actually monotonic in practice and is also significantly
faster than previous, non-adaptive algorithms
Multiclass Total Variation Clustering
Ideas from the image processing literature have recently motivated a new set
of clustering algorithms that rely on the concept of total variation. While
these algorithms perform well for bi-partitioning tasks, their recursive
extensions yield unimpressive results for multiclass clustering tasks. This
paper presents a general framework for multiclass total variation clustering
that does not rely on recursion. The results greatly outperform previous total
variation algorithms and compare well with state-of-the-art NMF approaches
Convergence and Energy Landscape for Cheeger Cut Clustering
This paper provides both theoretical and algorithmic results for the l 1-relaxation of the Cheeger cut problem. The l2- relaxation, known as spectral clustering, only loosely relates to the Cheeger cut; however, it is convex and leads to a simple optimization problem. The l1-relaxation, in contrast, is non-convex but is provably equivalent to the original problem. The l1-relaxation therefore trades convexity for exactness, yielding improved clustering results at the cost of a more challenging optimization. The first challenge is understanding convergence of algorithms. This paper provides the first complete proof of convergence for algorithms that minimize the l1-relaxation. The second challenge entails comprehending the l1-energy landscape, i.e. the set of possible points to which an algorithm might converge. We show that l 1-algorithms can get trapped in local minima that are not globally optimal and we provide a classification theorem to interpret these local minima. This classification gives meaning to these suboptimal solutions and helps to explain, in terms of graph structure, when the l1-relaxation provides the solution of the original Cheeger cut problem
Convergence of a Steepest Descent Algorithm for Ratio Cut Clustering
Unsupervised clustering of scattered, noisy and high-dimensional data points
is an important and difficult problem. Tight continuous relaxations of balanced
cut problems have recently been shown to provide excellent clustering results.
In this paper, we present an explicit-implicit gradient flow scheme for the
relaxed ratio cut problem, and prove that the algorithm converges to a critical
point of the energy. We also show the efficiency of the proposed algorithm on
the two moons dataset
An Incremental Reseeding Strategy for Clustering
In this work we propose a simple and easily parallelizable algorithm for multiway graph partitioning. The algorithm alternates between three basic components: diffusing seed vertices over the graph, thresholding the diffused seeds, and then randomly reseeding the thresholded clusters. We demonstrate experimentally that the proper combination of these ingredients leads to an algorithm that achieves state-of-the-art performance in terms of cluster purity on standard benchmarks datasets. Moreover, the algorithm runs an order of magnitude faster than the other algorithms that achieve comparable results in terms of accuracy. We also describe a coarsen, cluster and refine approach similar to GRACLUS and METIS that removes an additional order of magnitude from the runtime of our algorithm while still maintaining competitive accuracy
- …