Skip to main content
Article thumbnail
Location of Repository

Self-organization by optimizing free-energy

By J. J. Verbeek, N. Vlassis and B. J. A. Kröse

Abstract

Abstract. We present a variational Expectation-Maximization algorithm to learn probabilistic mixture models. The algorithm is similar to Kohonen’s Self-Organizing Map algorithm and not limited to Gaussian mixtures. We maximize the variational free-energy that sums data loglikelihood and Kullback-Leibler divergence between a normalized neighborhood function and the posterior distribution on the components, given data. We illustrate the algorithm with an application on word clustering. Keywords: self-organizing map, mixture modeling, variational EM.

Year: 2003
OAI identifier: oai:CiteSeerX.psu:10.1.1.135.4707
Provided by: CiteSeerX
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://citeseerx.ist.psu.edu/v... (external link)
  • http://www.dice.ucl.ac.be/Proc... (external link)
  • Suggested articles


    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.