Semi-supervised mixture of kernels via lpboost methods

We propose an algorithm to construct classification models with a mixture of kernels from labeled and unlabeled data. The derived classifier is a mixture of models, each based on one kernel choice from a library of kernels. The sparse-favoring 1-norm regularization method is employed to restrict the complexity of mixture models and to achieve the sparsity of solutions. By modifying the column generation boosting algorithm LPBoost to a more general linear programming formulation, we are able to efficiently solve mixture-of-kernel problems and automatically select kernel basis functions centered at labeled data as well as unlabeled data. The effectiveness of the proposed approach is proved by experimental results on benchmark datasets.

Semi-supervised mixture of kernels via lpboost methods

Abstract We propose an algorithm to construct classification mod-els with a mixture of kernels from labeled and unlabeled data. Unlike traditional kernel methods which select a ker-nel according to cross validation performance, we derive classifiers that are a mixture of models, each based on onekernel choice from a library of kernels. The sparse-favoring 1-norm regularization method is employed to restrict thecomplexity of mixture models and to achieve the sparsity of solutions. By modifying the column generation boost-ing algorithm LPBoost to a more general linear programming formulation, we are able to efficiently solve mixture-of-kernel problems and automatically select kernel basis functions centered at labeled data as well as unlabeled data.The effectiveness of the proposed approach is proved by experimental results on benchmark datasets and a real-worldlung nodule detection system.