Skip to main content
Article thumbnail
Location of Repository

A Variational Approximation for Bayesian Networks with Discrete and Continuous Latent Variables

By Kevin P. Murphy

Abstract

We show how to use a variational approximation to the logistic function to perform approximate inference in Bayesian networks containing discrete nodes with continuous parents. Essentially, we convert the logistic function to a Gaussian, which facilitates exact inference, and then iteratively adjust the variational parameters to improve the quality of the approximation. We demonstrate experimentally that this approximation is much faster than sampling, but comparable in accuracy. We also introduce a simple new technique for handling evidence, which allows us to handle arbitrary distributionson observed nodes, as well as achieving a significant speedup in networks with discrete variables of large cardinality. 1 Introduction Many probabilistic models naturally contain discrete and continuous variables. (Such models are sometimes called "hybrid".) Unfortunately, exact inference is only possible when all the continuous variables are Gaussian and have no discrete children. I..

Publisher: Morgan Kaufmann
Year: 1999
OAI identifier: oai:CiteSeerX.psu:10.1.1.32.8982
Provided by: CiteSeerX
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://citeseerx.ist.psu.edu/v... (external link)
  • http://http.cs.berkeley.edu/~m... (external link)
  • Suggested articles


    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.