Skip to main content
Article thumbnail
Location of Repository

Single pass clustering for large data sets

By Nikolai Alex, Barbara Hammer and Frank Klawonn

Abstract

The presence of very large data sets poses new problems to standard neural clustering and visualization algorithms such as Neural Gas (NG) and the Self-Organizing-Map (SOM) due to memory and time constraints. In such situations, it is no longer possible to store all data points in the main memory at once and only a few, ideally only one run over the whole data set is still affordable to achieve a feasible training time. In this contribution we propose single pass extensions of the classical clustering algorithms NG and fuzzy-k-means which are based on a simple patch decomposition of the data set and fast batch optimization schemes of the respective cost function. The algorithms maintain the benefits of the original ones including easy implementation and interpretation as well as large flexibility and adaptability because of the underlying cost function. We demonstrate the efficiency of the approach in a variety of experiments

Topics: clustering, neural gas, k-means, large data sets, batch optimization, Data processing, computer science, computer systems
Publisher: Faculties. Faculty of Technology, Research Groups in Informatics
Year: 2007
OAI identifier: oai:biecoll.ub.uni-bielefeld.de:147

Suggested articles


To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.