Article thumbnail
Location of Repository

MILCS: A mutual information learning classifier system



This paper introduces a new variety of learning classifier system (LCS), called MILCS, which utilizes mutual information as fitness feedback. Unlike most LCSs, MILCS is specifically designed for supervised learning. MILCS's design draws on an analogy to the structural learning approach of cascade correlation networks. We present preliminary results, and contrast them to results from XCS. We discuss the explanatory power of the resulting rule sets, and introduce a new technique for visualizing explanatory power. Final comments include future directions for this research, including investigations in neural networks and other systems. Copyright 2007 ACM

Publisher: UCL (University College London)
Year: 2007
OAI identifier:
Provided by: UCL Discovery

Suggested articles


  1. (2005). A decade of CASP: Progress, bottlenecks and prognosis in protein structure prediction.
  2. (1984). A heuristic for graph drawing.
  3. (2007). A Learning Classifier System with Mutual-Information-Based Fitness,
  4. (1980). A learning system based on genetic algorithms. Doctoral dissertation,
  5. (1948). A Mathematical Theory of Communication,
  6. (1989). A Rosetta Stone for Connectionism. Physica D42,
  7. (2003). A ruleset reduction algorithm for the XCS learning classifier system.
  8. (1997). A Study of the Generalization Capabilities of XCS.
  9. (1988). A tale of two classifier systems.
  10. (1996). A Tutorial on Learning with Bayesian Networks.
  11. (2003). Accuracy-Based Learning Classifier Systems: Models, Analysis and Applications to Classification Tasks.
  12. (2002). Accuracy-based Neuro and Neuro-Fuzzy Classifier Systems.
  13. (1975). Adaptation in natural and artificial systems.
  14. (2001). An Algorithmic Description of XCS.
  15. (2003). Analysis and improvement of fitness exploitation in XCS: bounding models, tournament selection, and bilateral accuracy.
  16. (2001). Analyzing the evolutionary pressures in XCS.
  17. (2000). Application of Multiple Sequence Alignments
  18. (2004). Applications of Learning Classifier Systems.
  19. (1995). Artificial intelligence, a modern approach. Englewood Cliffs,
  20. (2007). Automated Alphabet Reduction Method with Evolutionary Algorithms for Protein Structure Prediction,
  21. (2007). Backpropagation in Accuracy-based Neural Learning Classifier Systems. In
  22. (2001). Bagging-like effects for decision trees and neural nets in protein secondary structure prediction.
  23. (1997). Bayesian network classifiers.
  24. (2006). Biohel: Bioinformatics-oriented hierarchical evolutionary learning. Nottingham eprint.
  25. (1993). C4.5: Programs for machine learning.
  26. (1995). Classifier fitness based on accuracy.
  27. (1987). Classifier systems and the animat problem.
  28. (1978). Cognitive systems based on adaptive algorithms.
  29. (1949). Communication in the presence of noise,
  30. (1983). Computer-aided gas pipeline operation using genetic algorithms and rulelearning.
  31. (1994). Conservation and prediction of solvent accessibility in protein families.
  32. (2002). Data mining and knowledge discovery with evolutionary algorithms.
  33. (2000). Data Mining: practical machine learning tools and techniques with java implementations.
  34. (1999). Decision tree-based formation of consensus protein secondary structure prediction.
  35. (1991). Default Hierarchy Formation and Memory Exploitation in Learning Classifier Systems.
  36. (1999). Deletion Schemes for Classifier Systems.
  37. (1983). Dictionary of protein secondary structure: pattern recognition of hydrogen-bonded and geometrical features.
  38. (2001). Discovering Novel Fighter Combat Maneuvers in Simulation: Simulating Test Pilot Creativity. In
  39. (2003). Documentation of XCS+TS C-Code 1.2. IlliGAL report 2003023,
  40. (1995). Elements of machine learning.
  41. (2005). Empowerment: A universal agent-centric measure of control.
  42. (1986). Escaping brittleness: the possibilities of general-purpose learning algorithms applied to parallel rule-based systems.
  43. (1995). Estimating continuous distributions in Bayesian classifiers.
  44. (2002). Estimation of Distribution Algorithms, A New Tool for Evolutionnary Computation. Genetic Algorithms and Evolutionnary Computation.
  45. (1973). Evolutionsstrategie: Optimierung technischer Systeme nach Prinzipien der biologischen Evolution.
  46. (1999). Exploring Expression Data: Identification and Analysis of Coexpressed Genes,
  47. (1988). Faster-learning variations on back-propagation: An empirical study. In
  48. (1983). Flexible learning of problem solving heuristics through adaptive search.In
  49. (2006). From HP lattice models to real proteins: coordination number prediction using learning classifier systems.
  50. (2001). Function approximation with a classifier system.
  51. (2008). Function Approximation With XCS: Hyperellipsoidal Conditions, Recursive Least Squares, and Compaction.
  52. (1998). Generalization in the XCS classifier system.
  53. (1998). Generating accurate rule sets without global optimization.
  54. (1996). Genetic algorithms + data structures = evolution programs.
  55. (1989). Genetic algorithms in search, optimization and machine learning.
  56. (1992). Genetic algorithms.
  57. (1992). Genetic programming.
  58. (2001). How XCS Evolves Accurate Classifiers.
  59. (1994). Implicit Niching in a Learning Classifier System: Nature's Way.
  60. (1993). Improving classification accuracy through performance history.
  61. (2002). Information bottlenecks, causal states, and statistical relavance bases: How to represent relevant information in memoryless transduction.
  62. (1991). Instance-based learning algorithms.
  63. (2001). Introduction to Protein Architecture.
  64. (1994). Is a classifier system a type of neural network?
  65. (1991). Learning concept classification rules using genetic algorithms.
  66. (1987). Learning decision lists.
  67. (1986). Learning Internal Representations by Error Propagation in
  68. (1991). Letter recognition using Holland-style adaptive classifiers.
  69. (2001). LIBSVM: a library for support vector machines.
  70. (1989). Mapping Neural Networks into Classifier Systems.
  71. (1991). Modeling simple human category learning with a classifier system.
  72. (2008). Neural-Based Learning Classifier Systems.
  73. (2007). New approach for extracting knowledge from the XCS learning classifier system.
  74. (1990). NEWBOOLE: A fast GBML System.
  75. (1994). On Modelling Life.
  76. (1964). On the organization of intellect. Doctoral dissertation,
  77. (1969). On the quasi-minimal solution of the general covering problem.
  78. (1990). Perceptron redux: Emergence of structure.
  79. (2004). Pittsburgh Genetics-Based Machine Learning in the Data Mining era: representations, generalization, and run-time.
  80. (2005). Predicting absolute contact numbers of native protein structure from amino acid sequence.
  81. (2004). Predicting protein secondary structure by cascade-correlation neural networks;
  82. (1996). Predicting solvent accessibility: higher accuracy using Bayesian statistics and optimized residue substitution classes. Proteins 25,
  83. (2002). Predicting the disulfide bonding state of cysteines using protein descriptors. Proteins: Structure,
  84. (2004). Prediction calculation in accuracy-based neural learning classifier systems.
  85. (2001). Prediction of protein surface accessibility with information theory.
  86. (2003). Recent trends in learning classifier systems research.
  87. (1998). Reinforcement Learning: An Introduction.
  88. (2007). Robust automatic target recognition using learning classifier systems.
  89. (1995). Search-intensive concept induction.
  90. (1967). Some Methods for classification and Analysis of Multivariate Observations.
  91. (2000). Strength or Accuracy? Fitness Calculation in Learning Classifier Systems. Learning Classifier Systems: An Introduction to Contemporary Research,
  92. (1990). The Cascade-Correlation learning algorithm.
  93. (1994). The CN2 induction algorithm.
  94. (1999). The information bottleneck method.
  95. (1994). The RISE system: Conquering without separating.
  96. (2003). Tournament Selection in XCS.
  97. (2007). Towards better than human capability in diagnosing prostate cancer using infrared spectroscopic imaging.
  98. (1994). Using coverage as a model building constraint in learning classifier systems.
  99. (2001). What Makes a Problem Hard for XCS?
  100. (2001). XCS and GALE: a Comparative Study of Two Learning Classifier Systems with Six Other Learning Algorithms on Classification Tasks.
  101. (1997). XCS classifier system reliably evolves accurate, complete, and minimal representations for Boolean functions.
  102. (2005). XCS with Computed Prediction for the Learning of Boolean Functions.
  103. (2005). xcslib: source code available at
  104. (1994). ZCS: A Zeroth-Level Classifier System,

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.