707 research outputs found
Rates of contraction of posterior distributions based on Gaussian process priors
We derive rates of contraction of posterior distributions on nonparametric or
semiparametric models based on Gaussian processes. The rate of contraction is
shown to depend on the position of the true parameter relative to the
reproducing kernel Hilbert space of the Gaussian process and the small ball
probabilities of the Gaussian process. We determine these quantities for a
range of examples of Gaussian priors and in several statistical settings. For
instance, we consider the rate of contraction of the posterior distribution
based on sampling from a smooth density model when the prior models the log
density as a (fractionally integrated) Brownian motion. We also consider
regression with Gaussian errors and smooth classification under a logistic or
probit link function combined with various priors.Comment: Published in at http://dx.doi.org/10.1214/009053607000000613 the
Annals of Statistics (http://www.imstat.org/aos/) by the Institute of
Mathematical Statistics (http://www.imstat.org
A Primer on Reproducing Kernel Hilbert Spaces
Reproducing kernel Hilbert spaces are elucidated without assuming prior
familiarity with Hilbert spaces. Compared with extant pedagogic material,
greater care is placed on motivating the definition of reproducing kernel
Hilbert spaces and explaining when and why these spaces are efficacious. The
novel viewpoint is that reproducing kernel Hilbert space theory studies
extrinsic geometry, associating with each geometric configuration a canonical
overdetermined coordinate system. This coordinate system varies continuously
with changing geometric configurations, making it well-suited for studying
problems whose solutions also vary continuously with changing geometry. This
primer can also serve as an introduction to infinite-dimensional linear algebra
because reproducing kernel Hilbert spaces have more properties in common with
Euclidean spaces than do more general Hilbert spaces.Comment: Revised version submitted to Foundations and Trends in Signal
Processin
- …