The K-Winner Machine model

A K-Winner Machine (KWM) selects among a family of classifiers the specific configuration that minimizes the expected generalization error. In training, KWM uses unsupervised vector quantization and subsequent calibration to label data-space partitions. At run time, KWM seeks the largest set of best-matching prototypes agreeing on a test sample, and provides a local-level measure of confidence. The VC-dim of a KWM classifier is worked out exactly; the resulting small values set tight bounds to generalization performance. The network can be applied to high-dimensional, multi-class problems with large data sets. Experimental results in both a synthetic and a real domain (NIST handwritten numerals) validate the consistency of the theoretical framework.