Stable and accurate least squares radial basis function approximations on bounded domains

The computation of global radial basis function (RBF) approximations requires the solution of a linear system which, depending on the choice of RBF parameters, may be ill-conditioned. We study the stability and accuracy of approximation methods using the Gaussian RBF in all scaling regimes of the associated shape parameter. The approximation is based on discrete least squares with function samples on a bounded domain, using RBF centers both inside and outside the domain. This results in a rectangular linear system. We show for one-dimensional approximations that linear scaling of the shape parameter with the degrees of freedom is optimal, resulting in constant overlap between neighbouring RBF's regardless of their number, and we propose an explicit suitable choice of the proportionality constant. We show numerically that highly accurate approximations to smooth functions can also be obtained on bounded domains in several dimensions, using a linear scaling with the degrees of freedom per dimension. We extend the least squares approach to a collocation-based method for the solution of elliptic boundary value problems and illustrate that the combination of centers outside the domain, oversampling and optimal scaling can result in accuracy close to machine precision in spite of having to solve very ill-conditioned linear systems

On the optimal shape parameter for Gaussian radial basis function finite difference approximation of the Poisson equation

We investigate the influence of the shape parameter in the meshless Gaussian RBF finite difference method with irregular centres on the quality of the approximation of the Dirichlet problem for the Poisson equation with smooth solution. Numerical experiments show that the optimal shape parameter strongly depends on the problem, but insignificantly on the density of the centres. Therefore, we suggest a multilevel algorithm that effectively finds near-optimal shape parameter, which helps to significantly reduce the error. Comparison to the finite element method and to the generalised finite differences obtained in the flat limits of the Gaussian RBF is provided

New collocation path-following approach for the optimal shape parameter using Kernel method

The goal of this work is to develop a numerical method combining Radial Basic Functions (RBF) kernel and a high order algorithm based on Taylor series and homotopy continuation method. The local RBF approximation applied in strong form allows us to overcome the difficulties of numerical integration and to treat problems of large deformations. Furthermore, the high order algorithm enables to transform the nonlinear problem to a set of linear problems. Determining the optimal value of the shape parameter in RBF kernel is still an outstanding research topic. This optimal value depends on density and distribution of points and the considered problem for e.g. boundary value problems, integral equations, delay-differential equations etc. These have been extensively attempts in literature which end up choosing this optimal value by tests and error or some other ad-hoc means. Our contribution in this paper is to suggest a new strategy using radial basis functions kernel with an automatic reasonable choice of the shape parameter in the nonlinear case which depends on the accuracy and stability of the results. The computational experiments tested on some examples in structural analysis are performed and the comparison with respect to the state of art algorithms from the literature is given

A radial basis function method for solving optimal control problems.

This work presents two direct methods based on the radial basis function (RBF) interpolation and arbitrary discretization for solving continuous-time optimal control problems: RBF Collocation Method and RBF-Galerkin Method. Both methods take advantage of choosing any global RBF as the interpolant function and any arbitrary points (meshless or on a mesh) as the discretization points. The first approach is called the RBF collocation method, in which states and controls are parameterized using a global RBF, and constraints are satisfied at arbitrary discrete nodes (collocation points) to convert the continuous-time optimal control problem to a nonlinear programming (NLP) problem. The resulted NLP is quite sparse and can be efficiently solved by well-developed sparse solvers. The second proposed method is a hybrid approach combining RBF interpolation with Galerkin error projection for solving optimal control problems. The proposed solution, called the RBF-Galerkin method, applies a Galerkin projection to the residuals of the optimal control problem that make them orthogonal to every member of the RBF basis functions. Also, RBF-Galerkin costate mapping theorem will be developed describing an exact equivalency between the Karush–Kuhn–Tucker (KKT) conditions of the NLP problem resulted from the RBF-Galerkin method and discretized form of the first-order necessary conditions of the optimal control problem, if a set of conditions holds. Several examples are provided to verify the feasibility and viability of the RBF method and the RBF-Galerkin approach as means of finding accurate solutions to general optimal control problems. Then, the RBF-Galerkin method is applied to a very important drug dosing application: anemia management in chronic kidney disease. A multiple receding horizon control (MRHC) approach based on the RBF-Galerkin method is developed for individualized dosing of an anemia drug for hemodialysis patients. Simulation results are compared with a population-oriented clinical protocol as well as an individual-based control method for anemia management to investigate the efficacy of the proposed method

Numerical investigation of Differential Biological-Models via GA-Kansa Method Inclusive Genetic Strategy

In this paper, we use Kansa method for solving the system of differential equations in the area of biology. One of the challenges in Kansa method is picking out an optimum value for Shape parameter in Radial Basis Function to achieve the best result of the method because there are not any available analytical approaches for obtaining optimum Shape parameter. For this reason, we design a genetic algorithm to detect a close optimum Shape parameter. The experimental results show that this strategy is efficient in the systems of differential models in biology such as HIV and Influenza. Furthermore, we prove that using Pseudo-Combination formula for crossover in genetic strategy leads to convergence in the nearly best selection of Shape parameter.Comment: 42 figures, 23 page

Hyperparameter optimization with approximate gradient

Most models in machine learning contain at least one hyperparameter to control for model complexity. Choosing an appropriate set of hyperparameters is both crucial in terms of model accuracy and computationally challenging. In this work we propose an algorithm for the optimization of continuous hyperparameters using inexact gradient information. An advantage of this method is that hyperparameters can be updated before model parameters have fully converged. We also give sufficient conditions for the global convergence of this method, based on regularity conditions of the involved functions and summability of errors. Finally, we validate the empirical performance of this method on the estimation of regularization constants of L2-regularized logistic regression and kernel Ridge regression. Empirical benchmarks indicate that our approach is highly competitive with respect to state of the art methods.Comment: Proceedings of the International conference on Machine Learning (ICML