Recognition of Handwritten Digits by Combining Independent Learning Vector Quantizations

Classifiers derived by learning vector quantization (LVQ) have well defined decision regions that can be combined to construct a more accurate classifier. A given point may be included in a number of decision regions associated with different LVQ-classifiers. The relative densities of classes in each region can be combined to obtain a final classification. The method allows useful inferences from small training sets, which is needed for problems involving large variations within each class. In an application of this method to the recognition of handwritten digits, we show that the classifier can be improved almost monotonically without suffering from over-adaptation to the training data