Skip to main content
Article thumbnail
Location of Repository

Gaussian mixture models and semantic gating improve reconstructions from human brain activity

By Sanne eSchoenmakers, Umut eGüçlü, Marcel eVan Gerven and Tom eHeskes


Better acquisition protocols and analysis techniques are making it possible to use fMRI to obtain highly detailed visualizations of brain processes. In particular we focus on the reconstruction of natural images from BOLD responses in visual cortex. We expand our linear Gaussian framework for percept decoding with Gaussian mixture models to better represent the prior distribution of natural images. Reconstruction of such images then boils down to probabilistic inference in a hybrid Bayesian network. In our set-up, different mixture components correspond to different character categories. Our framework can automatically infer higher-order semantic categories from lower-level brain areas. Furthermore the framework can gate semantic information from higher-order brain areas to enforce the correct category during reconstruction. When categorical information is not available, we show that automatically learned clusters in the data give a similar improvement in reconstruction. The hybrid Bayesian network leads to highly accurate reconstructions in both supervised and unsupervised settings

Topics: fMRI, reconstruction, Bayesian network, unsupervised learning, DATA FUSION, Probabilistic inference, Neurosciences. Biological psychiatry. Neuropsychiatry, RC321-571
Publisher: Frontiers Media S.A.
Year: 2015
DOI identifier: 10.3389/fncom.2014.00173
OAI identifier:
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • (external link)
  • (external link)
  • (external link)
  • Suggested articles

    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.