New Upper bounds for KL-divergence Based on Integral Norms

Liuquan Yao,Songhao Liu
2024-10-30
Abstract:In this paper, some new upper bounds for Kullback-Leibler divergence(KL-divergence) based on $L^1, L^2$ and $L^\infty$ norms of density functions are discussed. Our findings unveil that the convergence in KL-divergence sense sandwiches between the convergence of density functions in terms of $L^1$ and $L^2$ norms. Furthermore, we endeavor to apply our newly derived upper bounds to the analysis of the rate theorem of the entropic conditional central limit theorem.
Probability,Information Theory
What problem does this paper attempt to address?