Jeffrey's divergence between autoregressive moving-average processes

Various works have been carried out about the Jeffrey's divergence (JD) which is the symmetric version of the Kullback-Leibler (KL) divergence. An expression of the JD for Gaussian processes can be deduced from the definition of the KL divergence and the expression of the Gaussian-multivariate distributions of k-dimensional random vectors. It depends on the k × k Toeplitz covariance matrices of the stationary processes. However, the resulting computational cost may be high as these matrices must be inverted and it is all the higher as k increases. To circumvent this problem, a recursive expression can be obtained for real 1^st-order autoregressive (AR) processes. When they are disturbed by additive uncorrelated white noises, we showed that when k becomes large, the derivative of the JD with respect to k tends to be constant. This constant is sufficient to compare the noisy AR processes. In this paper, we propose to extend our work to AR moving-average (MA) processes with one AR term and one MA term. Some examples illustrate the theoretical analysis.