We investigate methods to determine appropriate choices of the hyper-parameters for kernel based methods. Support vector classification, kernel logistic regression and support vector regression are considered. Grid search, Nelder-Mead algorithm
and pattern search algorithm are used
