Estimation of density ratio and its application to design a measure of dependence

In this paper we propose a new approach to estimate the ratio of two probability density functions. The proposed approach is inspired by the kernel based function approximation technique. We apply this estimator to derive an estimator of mutual information and show that this estimator can be successfully used to detect dependence between two random variables.