Attias

Bell

Girolami

Hojen-Sorensen

Hyvärinen

Jordan

Kaare Brandt Petersen

MacKay

Minka

Miskin

Ole Winther

Olsson

Opper

Petersen

Vanduffel

Yedidia

In this paper we present an empirical Bayes method for flexible and efficient independent component analysis (ICA). The method is flexible with respect to choice of source prior, dimensionality and constraints of the mixing matrix (unconstrained or non-negativity), and structure of the noise covariance matrix. Parameter optimization is handled by variants of the expectation maximization (EM) algorithm: overrelaxed adaptive EM and the easy gradient recipe. These retain the simplicity of EM while converging faster. The required expectations over the source posterior, the sufficient statistics, are estimated with mean field methods: variational and the expectation consistent (EC) framework. We describe the derivation of the EC framework for ICA in detail and give empirical results demonstrating the improved performance. The paper is accompanied by the publicly available Matlab toolbox icaMF. (c) 2007 Elsevier B.V. All rights reserved

Winther, Ole

Petersen, Kaare Brandt

Online Research Database In Technology

Flexible and efficient implementations of Bayesian independent component analysis

Crossref

http://orbit.dtu.dk/ws/files/6410695/NEUCOM-D-05-00490-2.pdf

Flexible and efficient implementations of Bayesian independent component analysis

Abstract

Similar works

Full text

Available Versions

Online Research Database In Technology

Crossref