Article thumbnail

Soft Rule Ensembles for Statistical Learning

By Deniz Akdemir and Nicolas Heslot

Abstract

In this article supervised learning problems are solved using soft rule ensembles. We first review the importance sampling learning ensembles (ISLE) approach that is useful for generating hard rules. The soft rules are then obtained with logistic regression from the corresponding hard rules. In order to deal with the perfect separation problem related to the logistic regression, Firth's bias corrected likelihood is used. Various examples and simulation results show that soft rule ensembles can improve predictive performance over hard rule ensembles.Comment: arXiv admin note: text overlap with arXiv:1112.369

Topics: Statistics - Machine Learning, Computer Science - Machine Learning, Statistics - Applications
Year: 2013
OAI identifier: oai:arXiv.org:1205.4476

Suggested articles


To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.