Unsupervised Learning of Categorical Data With Competing Models | IEEE Journals & Magazine | IEEE Xplore

Unsupervised Learning of Categorical Data With Competing Models


Abstract:

This paper considers the unsupervised learning of high-dimensional binary feature vectors representing categorical information. A cognitively inspired framework, referred...Show More

Abstract:

This paper considers the unsupervised learning of high-dimensional binary feature vectors representing categorical information. A cognitively inspired framework, referred to as modeling fields theory (MFT), is utilized as the basic methodology. A new MFT-based algorithm, referred to as accelerated maximum a posteriori (MAP), is proposed. Accelerated MAP allows simultaneous learning and selection of the number of models. The key feature of accelerated MAP is a steady increase of the regularization penalty resulting in competition among models. The differences between this approach and other mixture learning and model selection methodologies are described. The operation of this algorithm and its parameter selection are discussed. Numerical experiments aimed at finding performance limits are conducted. The performance with real-world data is tested by applying the algorithm to a text categorization problem and to the clustering Congressional voting data.
Published in: IEEE Transactions on Neural Networks and Learning Systems ( Volume: 23, Issue: 11, November 2012)
Page(s): 1726 - 1737
Date of Publication: 10 September 2012

ISSN Information:

PubMed ID: 24808068

Contact IEEE to Subscribe

References

References is not available for this document.