A novel online LS-SVM approach for regression and classification

In this paper, a novel online least squares support vector machine approach is proposed for classification and regression problems. Gaussian kernel function is used due to its strong generalization capability. The contribution of the paper is twofold. As the first novelty, all parameters of the SVM including the kernel width parameter σ are trained simultaneously when a new sample arrives. Unscented Kalman filter is adopted to train the parameters since it avoids the sub-optimal solutions caused by linearization in contrast to extended Kalman filter. The second novelty is the variable size moving window by an intelligent update strategy for the support vector set. This provides that SVM model captures the dynamics of data quickly while not letting it become clumsy due to the big amount of useless or out-of-date support vector data. Simultaneous training of the kernel parameter by unscented Kalman filter and intelligent update of support vector set provide significant performance using small amount of support vector data for both classification and system identification application results. © 201

A Unifying Framework in Vector-valued Reproducing Kernel Hilbert Spaces for Manifold Regularization and Co-Regularized Multi-view Learning

This paper presents a general vector-valued reproducing kernel Hilbert spaces (RKHS) framework for the problem of learning an unknown functional dependency between a structured input space and a structured output space. Our formulation encompasses both Vector-valued Manifold Regularization and Co-regularized Multi-view Learning, providing in particular a unifying framework linking these two important learning approaches. In the case of the least square loss function, we provide a closed form solution, which is obtained by solving a system of linear equations. In the case of Support Vector Machine (SVM) classification, our formulation generalizes in particular both the binary Laplacian SVM to the multi-class, multi-view settings and the multi-class Simplex Cone SVM to the semi-supervised, multi-view settings. The solution is obtained by solving a single quadratic optimization problem, as in standard SVM, via the Sequential Minimal Optimization (SMO) approach. Empirical results obtained on the task of object recognition, using several challenging datasets, demonstrate the competitiveness of our algorithms compared with other state-of-the-art methods.Comment: 72 page

Adaptive learning to speed-up control of prosthetic hands: A few things everybody should know

Domain adaptation methods have been proposed to reduce the training efforts needed to control an upper-limb prosthesis by adapting well performing models from previous subjects to the new subject. These studies generally reported impressive reductions in the required number of training samples to achieve a certain level of accuracy for intact subjects. We further investigate two popular methods in this field to verify whether this result also applies to amputees. Our findings show instead that this improvement can largely be attributed to a suboptimal hyperparameter configuration. When hyperparameters are appropriately tuned, the standard approach that does not exploit prior information performs on par with the more complicated transfer learning algorithms. Additionally, earlier studies erroneously assumed that the number of training samples relates proportionally to the efforts required from the subject. However, a repetition of a movement is the atomic unit for subjects and the total number of repetitions should therefore be used as reliable measure for training efforts. Also when correcting for this mistake, we do not find any performance increase due to the use of prior models

Comparative Study on modeling Efficiency Between Support Vector Machines (SVMs) model and Parallel OBF-NN model

This project is about the comparative study between model efficiency between support vector machine (SVM) and parallel OBF-NN model. To demonstrate the concept, basic support vector regression (SVR) model is developed as nonlinear model identification. Best parameter and option for SVR model is selected in order to construct optimum model performance. The study is developed using selected case study, which is using van de vusse reactor datasets. The data consist of input and output than applicable to perform simulation as training and validation data. Lastly, an OBF-SVR model is developed that use OBF model as linear part and SVR model as nonlinear part align in parallel. The performance of each developed model is tested in their performance in validation to approach real system value. The developed OBF-SVR model is compared with OBF-NN model and the deviation between each model is investigated

Machine Learning Approach to Automated Quality Identification of Human Induced Pluripotent Stem Cell Colony Images

The focus of this research is on automated identification of the quality of human induced pluripotent stem cell (iPSC) colony images. iPS cell technology is a contemporary method by which the patient’s cells are reprogrammed back to stem cells and are differentiated to any cell type wanted. iPS cell technology will be used in future to patient specific drug screening, disease modeling, and tissue repairing, for instance. However, there are technical challenges before iPS cell technology can be used in practice and one of them is quality control of growing iPSC colonies which is currently done manually but is unfeasible solution in large-scale cultures. The monitoring problem returns to image analysis and classification problem. In this paper, we tackle this problem using machine learning methods such as multiclass Support Vector Machines and several baseline methods together with Scaled Invariant Feature Transformation based features. We perform over 80 test arrangements and do a thorough parameter value search. The best accuracy (62.4%) for classification was obtained by using a k-NN classifier showing improved accuracy compared to earlier studies

Various Approaches of Support vector Machines and combined Classifiers in Face Recognition

In this paper we present the various approaches used in face recognition from 2001-2012.because in last decade face recognition is using in many fields like Security sectors, identity authentication. Today we need correct and speedy performance in face recognition. This time the face recognition technology is in matured stage because research is conducting continuously in this field. Some extensions of Support vector machine (SVM) is reviewed that gives amazing performance in face recognition.Here we also review some papers of combined classifier approaches that is also a dynamic research area in a pattern recognition

Application of the Least Square Support Vector Machine for point-to-point forecasting of the PV Power

In today's industrial world, the growing capacity of renewable energy sources is a crucial factor for sustainable power generation. The application of solar photovoltaic (PV) energy sources, as a clean and safe renewable energy resource has found great attention among the consumers in the recent decades. Accurate forecasting of the generated PV power is an important task for scheduling the generators and planning the consumption patterns of customers to save electricity costs. To this end, it is necessary to develop a global model of the generated power based on the effective factors which are mainly the solar radiation intensity and the ambient weather temperature. As a result of the wide numerical range of these parameters and various weather conditions, a large training database must be used for developing the models, which results in high-computational complexity of the algorithms used for training the models. In this paper, a novel algorithm for point to point prediction of the generated power based on the least squares support vector machine (LS-SVM) has been proposed which can handle the large training database with a very fewer deal of computation and benefits from reasonable accuracy and generalization capability.