Bernoulli sums and Rényi entropy inequalities

Mokshay Madiman,James Melbourne,Cyril Roberto
DOI: https://doi.org/10.3150/22-BEJ1511
2024-03-16
Abstract:We investigate the Rényi entropy of independent sums of integer valued random variables through Fourier theoretic means, and give sharp comparisons between the variance and the Rényi entropy, for Poisson-Bernoulli variables. As applications we prove that a discrete ``min-entropy power'' is super additive on independent variables up to a universal constant, and give new bounds on an entropic generalization of the Littlewood-Offord problem that are sharp in the ``Poisson regime''.
Probability,Information Theory,Combinatorics
What problem does this paper attempt to address?