Abstract:Mutual information is commonly used in the measure of dependency between variables.However,in the estimation of mutual information,the estimation of joint probability density function is always a hard problem.To avoid the estimation of joint probability density function and to improve both the effectiveness and efficiency of the estimation of mutual information,we propose a novel mutual information estimation method based on the entropy of the Copula density function.The estimation of mutual information is transformed into the estimation of Copula entropy by taking advantages of their relationships.Parameter estimation method based on Kendall’s rank correlation coefficient is used for the estimation of the parameters in Copula function.The proposed method is compared with the following four methods: histogram method,kernel method,k nearest neighbor method and maximum likelihood method.Simulation results on the two dimensional Gaussian distribution data substantiate the effectiveness and efficiency of the proposed method.

Mutual Information Estimation Based on Copula Entropy