Convergence of differential entropies
Godavarti, M.; Hero, A.
Information Theory, IEEE Transactions on
Volume 50, Issue 1, Jan. 2004 Page(s): 171 - 176
Digital Object Identifier 10.1109/TIT.2003.821979
Summary:Calculation of the differential entropy of the limiting density of a sequence of probability density functions (pdf) is an interesting mathematical problem and is important in asymptotic analysis of communication systems. In such cases, it would be of interest to know if the limit of the differential entropies Hn, corresponding to the sequence of pdf fn, is equal to the differential entropy H, of the limiting pdf f. In this correspondence, we establish sufficient conditions under which Hn → H.
View citation and abstract |