By Topic

On a relation between maximum likelihood classification and minimum relative-entropy classification (Corresp.)

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

1 Author(s)

Maximum likelihood (ML) and minimum relative-entropy (MRE) (minimum cross-entropy) classification of samples from an unknown probability density when the hypotheses comprise an exponential family are considered. It is shown that ML and MRE lead to the same classification nde, and the result is illustrated in terms of a method for estimating covariance matrices recently developed by Burg, Luenberger, and Wenger, MRE classification applies to the general case in which it cannot be assumed that the samples were generated by one of the hypothesis densities. The common use of ML in this case is technically incorrect, but the equivalence of MRE and ML provides a theoretical justification.

Published in:

IEEE Transactions on Information Theory  (Volume:30 ,  Issue: 6 )