524 research outputs found
Knowing what you know in brain segmentation using Bayesian deep neural networks
In this paper, we describe a Bayesian deep neural network (DNN) for
predicting FreeSurfer segmentations of structural MRI volumes, in minutes
rather than hours. The network was trained and evaluated on a large dataset (n
= 11,480), obtained by combining data from more than a hundred different sites,
and also evaluated on another completely held-out dataset (n = 418). The
network was trained using a novel spike-and-slab dropout-based variational
inference approach. We show that, on these datasets, the proposed Bayesian DNN
outperforms previously proposed methods, in terms of the similarity between the
segmentation predictions and the FreeSurfer labels, and the usefulness of the
estimate uncertainty of these predictions. In particular, we demonstrated that
the prediction uncertainty of this network at each voxel is a good indicator of
whether the network has made an error and that the uncertainty across the whole
brain can predict the manual quality control ratings of a scan. The proposed
Bayesian DNN method should be applicable to any new network architecture for
addressing the segmentation problem.Comment: Submitted to Frontiers in Neuroinformatic
A Survey on Bayesian Deep Learning
A comprehensive artificial intelligence system needs to not only perceive the
environment with different `senses' (e.g., seeing and hearing) but also infer
the world's conditional (or even causal) relations and corresponding
uncertainty. The past decade has seen major advances in many perception tasks
such as visual object recognition and speech recognition using deep learning
models. For higher-level inference, however, probabilistic graphical models
with their Bayesian nature are still more powerful and flexible. In recent
years, Bayesian deep learning has emerged as a unified probabilistic framework
to tightly integrate deep learning and Bayesian models. In this general
framework, the perception of text or images using deep learning can boost the
performance of higher-level inference and in turn, the feedback from the
inference process is able to enhance the perception of text or images. This
survey provides a comprehensive introduction to Bayesian deep learning and
reviews its recent applications on recommender systems, topic models, control,
etc. Besides, we also discuss the relationship and differences between Bayesian
deep learning and other related topics such as Bayesian treatment of neural
networks.Comment: To appear in ACM Computing Surveys (CSUR) 202
- …