Skip to main content
Article thumbnail
Location of Repository

Faster Training in Nonlinear ICA using MISEP

By Luis B. Almeida

Abstract

MISEP has been proposed as a generalization of the INFOMAX method in two directions: (1) handling of nonlinear mixtures, and (2) learning the nonlinearities to be used at the outputs, making the method suitable to the separation of components with a wide range of statistical distributions. In all implementations up to now, MISEP had used multilayer perceptrons (MLPs) to perform the nonlinear ICA operation. Use of MLPs sometimes leads to a relatively slow training. This has been attributed, at least in part, to the non-local character of the MLP's units. This paper investigates the possibility of using a network of radial basis function (RBF) units for performing the nonlinear ICA operation. It shows that the local character of the RBF network's units allows a significant speedup in the training of the system. The paper gives a brief introduction to the basics of the MISEP method, and presents experimental results showing the speed advantage of using an RBF-based network to perform the ICA operation

Topics: Statistical Models, Machine Learning, Neural Nets
Year: 2003
OAI identifier: oai:cogprints.org:2854
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://cogprints.org/2854/1/Al... (external link)
  • http://cogprints.org/2854/ (external link)
  • Suggested articles

    Citations

    1. (1996). An objective function for independence,” in
    2. (1992). Blind separation of sources: A nonlinear neural algorithm,”
    3. (1992). Learning factorial codes by predictability minimization,”
    4. (1999). Multi-layer independent component analysis (MLICA),” in
    5. (1999). Nonlinear approaches to independent component analysis,”
    6. (1995). Nonlinear higher-order statistical decorrelation by volume-conserving neural architectures,”

    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.