Aggregation of probabilistic PCA mixtures with a variational-Bayes technique over parameters

International audienceThis paper proposes a solution to the problem of aggre- gating versatile probabilistic models, namely mixtures of probabilistic principal component analyzers. These models are a powerful generative form for capturing high-dimensional, non Gaussian, data. They simulta- neously perform mixture adjustment and dimensional- ity reduction. We demonstrate how such models may be advantageously aggregated by accessing mixture pa- rameters only, rather than original data. Aggregation is carried out through Bayesian estimation with a specific prior and an original variational scheme. Experimental results illustrate the effectiveness of the proposal

Component-level aggregation of probabilistic PCA mixtures using variational-Bayes

Technical Report. This report of an extended version of our ICPR'2010 paper.This paper proposes a technique for aggregating mixtures of probabilistic principal component analyzers, which are a powerful probabilistic generative model for coping with a high-dimensional, non linear, data set. Aggregation is carried out through Bayesian estimation with a specific prior and an original variational scheme. We demonstrate how such models may be aggregated by accessing model parameters only, rather than original data, which can be advantageous for learning from distributed data sets. Experimental results illustrate the effectiveness of the proposal