On Variants of k-means Clustering

\textit{Clustering problems} often arise in the fields like data mining, machine learning etc. to group a collection of objects into similar groups with respect to a similarity (or dissimilarity) measure. Among the clustering problems, specifically \textit{$k$-means} clustering has got much attention from the researchers. Despite the fact that $k$-means is a very well studied problem its status in the plane is still an open problem. In particular, it is unknown whether it admits a PTAS in the plane. The best known approximation bound in polynomial time is 9+\eps. In this paper, we consider the following variant of $k$-means. Given a set $C$ of points in $\mathcal{R}^d$ and a real $f > 0$, find a finite set $F$ of points in $\mathcal{R}^d$ that minimizes the quantity $f*|F|+\sum_{p\in C} \min_{q \in F} {||p-q||}^2$. For any fixed dimension $d$, we design a local search PTAS for this problem. We also give a "bi-criterion" local search algorithm for $k$-means which uses (1+\eps)k centers and yields a solution whose cost is at most (1+\eps) times the cost of an optimal $k$-means solution. The algorithm runs in polynomial time for any fixed dimension. The contribution of this paper is two fold. On the one hand, we are being able to handle the square of distances in an elegant manner, which yields near optimal approximation bound. This leads us towards a better understanding of the $k$-means problem. On the other hand, our analysis of local search might also be useful for other geometric problems. This is important considering that very little is known about the local search method for geometric approximation.Comment: 15 page

Local search heuristics for multi-index assignment problems with decomposable costs.

The multi-index assignment problem (MIAP) with decomposable costs is a natural generalization of the well-known assignment problem. Applications of the MIAP arise for instance in the field of multi-target multi-sensor tracking. We describe an (exponentially sized) neighborhood for a solution of the MIAP with decomposable costs, and show that one can find a best solution in this neighborhood in polynomial time. Based on this neighborhood, we propose a local search algorithm. We empirically test the performance of published constructive heuristics and the local search algorithm on random instances; a straightforward tabu search is also tested. Finally, we compute lower bounds to our problem, which enable us to assess the quality of the solutions found.Assignment; Costs; Heuristics; Problems; Applications; Performance;

The continuous p-centre problem: An investigation into variable neighbourhood search with memory

A VNS-based heuristic using both a facility as well as a customer type neighbourhood structure is proposed to solve the p-centre problem in the continuous space. Simple but effective enhancements to the original Elzinga-Hearn algorithm as well as a powerful ‘locate-allocate’ local search used within VNS are proposed. In addition, efficient implementations in both neighbourhood structures are presented. A learning scheme is also embedded into the search to produce a new variant of VNS that uses memory. The effect of incorporating strong intensification within the local search via a VND type structure is also explored with interesting results. Empirical results, based on several existing data set (TSP-Lib) with various values of p, show that the proposed VNS implementations outperform both a multi-start heuristic and the discrete-based optimal approach that use the same local search

The Unreasonable Success of Local Search: Geometric Optimization

What is the effectiveness of local search algorithms for geometric problems in the plane? We prove that local search with neighborhoods of magnitude $1/\epsilon^c$ is an approximation scheme for the following problems in the Euclidian plane: TSP with random inputs, Steiner tree with random inputs, facility location (with worst case inputs), and bicriteria $k$-median (also with worst case inputs). The randomness assumption is necessary for TSP

The Scatter Search Based Algorithm for Beam Angle Optimization in Intensity-Modulated Radiation Therapy

This article introduces a new framework for beam angle optimization (BAO) in intensity-modulated radiation therapy (IMRT) using the Scatter Search Based Algorithm. The potential benefits of plans employing the coplanar optimized beam sets are also examined. In the proposed beam angle selection algorithm, the problem is solved in two steps. Initially, the gantry angles are selected using the Scatter Search Based Algorithm, which is a global optimization method. Then, for each beam configuration, the intensity profile is calculated by the conjugate gradient method to score each beam angle set chosen. A simulated phantom case with obvious optimal beam angles was used to benchmark the validity of the presented algorithm. Two clinical cases (TG-119 phantom and prostate cases) were examined to prepare a dose volume histogram (DVH) and determine the dose distribution to evaluate efficiency of the algorithm. A clinical plan with the optimized beam configuration was compared with an equiangular plan to determine the efficiency of the proposed algorithm. The BAO plans yielded significant improvements in the DVHs and dose distributions compared to the equispaced coplanar beams for each case. The proposed algorithm showed its potential to effectively select the beam direction for IMRT inverse planning at different tumor sites. © 2018 Ali Ghanbarzadeh et al

Heuristics for the traveling repairman problem with profits

In the traveling repairman problem with profits, a repairman (also known as the server) visits a subset of nodes in order to collect time-dependent profits. The objective consists of maximizing the total collected revenue. We restrict our study to the case of a single server with nodes located in the Euclidean plane. We investigate properties of this problem, and we derive a mathematical model assuming that the number of visited nodes is known in advance. We describe a tabu search algorithm with multiple neighborhoods, and we test its performance by running it on instances based on TSPLIB. We conclude that the tabu search algorithm finds good-quality solutions fast, even for large instances

Fast Clustering with Lower Bounds: No Customer too Far, No Shop too Small

We study the \LowerBoundedCenter (\lbc) problem, which is a clustering problem that can be viewed as a variant of the \kCenter problem. In the \lbc problem, we are given a set of points P in a metric space and a lower bound \lambda, and the goal is to select a set C \subseteq P of centers and an assignment that maps each point in P to a center of C such that each center of C is assigned at least \lambda points. The price of an assignment is the maximum distance between a point and the center it is assigned to, and the goal is to find a set of centers and an assignment of minimum price. We give a constant factor approximation algorithm for the \lbc problem that runs in O(n \log n) time when the input points lie in the d-dimensional Euclidean space R^d, where d is a constant. We also prove that this problem cannot be approximated within a factor of 1.8-\epsilon unless P = \NP even if the input points are points in the Euclidean plane R^2.Comment: 14 page