On boosting kernel regression

In this paper we propose a simple multistep regression smoother which is constructed in an iterative manner, by learning the Nadaraya-Watson estimator with L-2 boosting. We find, in both theoretical analysis and simulation experiments, that the bias converges exponentially fast. and the variance diverges exponentially slow. The first boosting step is analysed in more detail, giving asymptotic expressions as functions of the smoothing parameter, and relationships with previous work are explored. Practical performance is illustrated by both simulated and real data

Kernel Bayes' rule

A nonparametric kernel-based method for realizing Bayes' rule is proposed, based on representations of probabilities in reproducing kernel Hilbert spaces. Probabilities are uniquely characterized by the mean of the canonical map to the RKHS. The prior and conditional probabilities are expressed in terms of RKHS functions of an empirical sample: no explicit parametric model is needed for these quantities. The posterior is likewise an RKHS mean of a weighted sample. The estimator for the expectation of a function of the posterior is derived, and rates of consistency are shown. Some representative applications of the kernel Bayes' rule are presented, including Baysian computation without likelihood and filtering with a nonparametric state-space model.Comment: 27 pages, 5 figure

Nonparametric Estimation of Scalar Diffusion Processes of Interest Rates Using Asymmetric Kernels

This paper proposes a nonparametric regression using asymmetric kernel functions for nonnegative, absolutely regular processes, and specializes this technique to estimating scalar diffusion models of spot interest rate. We illustrate the advantages of asymmetric kernel estimators for bias correction and efficiency gains. The finite-sample properties and the practical relevance of the proposed estimators are evaluated in the context of bond and option pricing. We also present estimation results from empirical analysis of the term structure of U.S. interest rates.Nonparametric regression; Gamma kernel; diffusion estimation; spot interest rate; derivative pricing