Selection of generative models in classification
Bouchard, G.; Celeux, G.
Pattern Analysis and Machine Intelligence, IEEE Transactions on
Volume 28, Issue 4, April 2006 Page(s):544 - 554
Digital Object Identifier 10.1109/TPAMI.2006.82
Summary:This paper is concerned with the selection of a generative model for supervised classification. Classical criteria for model selection assess the fit of a model rather than its ability to produce a low classification error rate. A new criterion, the Bayesian entropy criterion (BEC), is proposed. This criterion takes into account the decisional purpose of a model by minimizing the integrated classification entropy. It provides an interesting alternative to the cross-validated error rate which is computationally expensive. The asymptotic behavior of the BEC criterion is presented. Numerical experiments on both simulated and real data sets show that BEC performs better than the BIC criterion to select a model minimizing the classification error rate and provides analogous performance to the cross-validated error rate.
View citation and abstract |