84 research outputs found
HINT: Hierarchical Invertible Neural Transport for Density Estimation and Bayesian Inference
A large proportion of recent invertible neural architectures is based on a
coupling block design. It operates by dividing incoming variables into two
sub-spaces, one of which parameterizes an easily invertible (usually affine)
transformation that is applied to the other. While the Jacobian of such a
transformation is triangular, it is very sparse and thus may lack
expressiveness. This work presents a simple remedy by noting that (affine)
coupling can be repeated recursively within the resulting sub-spaces, leading
to an efficiently invertible block with dense triangular Jacobian. By
formulating our recursive coupling scheme via a hierarchical architecture, HINT
allows sampling from a joint distribution p(y,x) and the corresponding
posterior p(x|y) using a single invertible network. We demonstrate the power of
our method for density estimation and Bayesian inference on a novel data set of
2D shapes in Fourier parameterization, which enables consistent visualization
of samples for different dimensionalities
Out of distribution detection for intra-operative functional imaging
Multispectral optical imaging is becoming a key tool in the operating room.
Recent research has shown that machine learning algorithms can be used to
convert pixel-wise reflectance measurements to tissue parameters, such as
oxygenation. However, the accuracy of these algorithms can only be guaranteed
if the spectra acquired during surgery match the ones seen during training. It
is therefore of great interest to detect so-called out of distribution (OoD)
spectra to prevent the algorithm from presenting spurious results. In this
paper we present an information theory based approach to OoD detection based on
the widely applicable information criterion (WAIC). Our work builds upon recent
methodology related to invertible neural networks (INN). Specifically, we make
use of an ensemble of INNs as we need their tractable Jacobians in order to
compute the WAIC. Comprehensive experiments with in silico, and in vivo
multispectral imaging data indicate that our approach is well-suited for OoD
detection. Our method could thus be an important step towards reliable
functional imaging in the operating room.Comment: The final authenticated version is available online at
https://doi.org/10.1007/978-3-030-32689-0_
Augmented Neural ODEs
We show that Neural Ordinary Differential Equations (ODEs) learn
representations that preserve the topology of the input space and prove that
this implies the existence of functions Neural ODEs cannot represent. To
address these limitations, we introduce Augmented Neural ODEs which, in
addition to being more expressive models, are empirically more stable,
generalize better and have a lower computational cost than Neural ODEs.Comment: NeurIPS camera ready, additional experiments, additional datasets,
discussion on relation to other model
- …