No single measureM(X;y)of the amount of information that a specific valueyof a random variableYgives about another random variableXhas all of the desirable properties possessed by Shannon's measureI(X;Y) = E{M(X;y)}of the average mutual information ofXandY. It is shown that one of these properties (additivity) determines one particular form forM(X;y), while others (non-negativity or coordinate independance) determine a different form. The latter, which is the more useful and accepted information measure, is thus seen to be unique.
Published in:
Information Theory, IEEE Transactions on
(Volume:14
,
Issue:
1
)
Date of Publication:
Jan 1968
- Page(s):
-
27
-
31
- ISSN :
-
0018-9448
- Digital Object Identifier :
-
10.1109/TIT.1968.1054094
- Product Type:
-
Journals & Magazines
- Date of Current Version :
-
06 January 2003
- Issue Date :
-
Jan 1968
- Sponsored by :
-
IEEE Information Theory Society