An unsupervised dual-network connectionist model of rule emergence in category learning

Abstract

We develop an unsupervised dual-network connectionist model of category learning in which rules gradually emerge from a standard Kohonen network. The architecture is based on the interaction of a statistical-learning (Kohonen) network and a competitive-learning rule network. The rules that emerge in the rule network are weightings of individual features according to their importance for categorisation. Once the combined system has learned a particular rule, it de-emphasizes those features that are not sufficient for categorisation, thus allowing correct classification of novel, but atypical, stimuli, for which a standard Kohonen network fails. We explain the principles and architectural details of the model and show how it works correctly for stimuli that are misclassified by a standard Kohonen network