30,954 research outputs found
How fast do radial basis function interpolants of analytic functions converge?
The question in the title is answered using tools of potential theory. Convergence and divergence rates of interpolants of analytic functions on the unit interval are analyzed. The starting point is a complex variable contour integral formula for the remainder in RBF interpolation. We study a generalized Runge phenomenon and explore how the location of centers and affects convergence. Special attention is given to Gaussian and inverse quadratic radial functions, but some of the results can be extended to other smooth basis functions. Among other things, we prove that, under mild conditions, inverse quadratic RBF interpolants of functions that are analytic inside the strip , where is the shape parameter, converge exponentially
Nonlinear Approximation Using Gaussian Kernels
It is well-known that non-linear approximation has an advantage over linear
schemes in the sense that it provides comparable approximation rates to those
of the linear schemes, but to a larger class of approximands. This was
established for spline approximations and for wavelet approximations, and more
recently by DeVore and Ron for homogeneous radial basis function (surface
spline) approximations. However, no such results are known for the Gaussian
function, the preferred kernel in machine learning and several engineering
problems. We introduce and analyze in this paper a new algorithm for
approximating functions using translates of Gaussian functions with varying
tension parameters. At heart it employs the strategy for nonlinear
approximation of DeVore and Ron, but it selects kernels by a method that is not
straightforward. The crux of the difficulty lies in the necessity to vary the
tension parameter in the Gaussian function spatially according to local
information about the approximand: error analysis of Gaussian approximation
schemes with varying tension are, by and large, an elusive target for
approximators. We show that our algorithm is suitably optimal in the sense that
it provides approximation rates similar to other established nonlinear
methodologies like spline and wavelet approximations. As expected and desired,
the approximation rates can be as high as needed and are essentially saturated
only by the smoothness of the approximand.Comment: 15 Pages; corrected typos; to appear in J. Funct. Ana
Approximation Error Bounds via Rademacher's Complexity
Approximation properties of some connectionistic models, commonly used to construct approximation schemes for optimization problems with multivariable functions as admissible solutions, are investigated. Such models are made up of linear combinations of computational units
with adjustable parameters. The relationship between model complexity (number of computational units) and approximation error is investigated using tools from Statistical Learning Theory, such as Talagrand's
inequality, fat-shattering dimension, and Rademacher's complexity. For some families of multivariable functions, estimates of the approximation accuracy of models with certain computational units are derived in dependence of the Rademacher's complexities of the families. The
estimates improve previously-available ones, which were expressed in terms of V C dimension and derived by exploiting union-bound techniques. The results are applied to approximation schemes with certain radial-basis-functions as computational units, for which it is shown that
the estimates do not exhibit the curse of dimensionality with respect to the number of variables
A High-Order Kernel Method for Diffusion and Reaction-Diffusion Equations on Surfaces
In this paper we present a high-order kernel method for numerically solving
diffusion and reaction-diffusion partial differential equations (PDEs) on
smooth, closed surfaces embedded in . For two-dimensional
surfaces embedded in , these types of problems have received
growing interest in biology, chemistry, and computer graphics to model such
things as diffusion of chemicals on biological cells or membranes, pattern
formations in biology, nonlinear chemical oscillators in excitable media, and
texture mappings. Our kernel method is based on radial basis functions (RBFs)
and uses a semi-discrete approach (or the method-of-lines) in which the surface
derivative operators that appear in the PDEs are approximated using
collocation. The method only requires nodes at "scattered" locations on the
surface and the corresponding normal vectors to the surface. Additionally, it
does not rely on any surface-based metrics and avoids any intrinsic coordinate
systems, and thus does not suffer from any coordinate distortions or
singularities. We provide error estimates for the kernel-based approximate
surface derivative operators and numerically study the accuracy and stability
of the method. Applications to different non-linear systems of PDEs that arise
in biology and chemistry are also presented
- …