Skip to main content
Article thumbnail
Location of Repository

Technical note: Bias and the quantification of stability

By Peter D. Turney

Abstract

Research on bias in machine learning algorithms has generally been concerned with the impact of bias on predictive accuracy. We believe that there are other factors that should also play a role in the evaluation of bias. One such factor is the stability of the algorithm; in other words, the repeatability of the results. If we obtain two sets of data from the same phenomenon, with the same underlying probability distribution, then we would like our learning algorithm to induce approximately the same concepts from both sets of data. This paper introduces a method for quantifying stability, based on a measure of the agreement between concepts. We also discuss the relationships among stability, predictive accuracy, and bias

Topics: Artificial Intelligence, Machine Learning, Statistical Models
Publisher: Kluwer
Year: 1995
OAI identifier: oai:cogprints.org:1819
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://cogprints.org/1819/3/NR... (external link)
  • http://cogprints.org/1819/ (external link)
  • Suggested articles

    Citations

    1. (1986). A general framework for induction and a study of selective induction.
    2. (1992). An empirical technique for quantifying preferential bias in inductive concept learners.
    3. (1966). Binary codes capable of correcting deletions, insertions, and reversals.
    4. (1992). C4.5: Programs for machine learning.
    5. (1982). Estimation of dependencies based on empirical data. doi
    6. (1994). Exploring the decision forest: an empirical investigation of Occam’s razor in decision tree induction.
    7. (1992). Inductive learning using generalized distance measures.
    8. (1991). Intelligently helping the human planner in industrial process planning.
    9. (1947). Meaning and necessity: A study in semantics and modal logic.
    10. (1993). Overfitting avoidance as bias. doi
    11. (1976). Probability and statistics: Theory and applications.
    12. (1988). Quantifying inductive bias: AI learning systems and Valiant’s learning framework.
    13. (1986). Shift of bias for inductive concept learning. In

    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.