Abstract:This paper addresses the correspondence between linear inequalities of Shannon entropy and differential entropy for sums of independent group-valued random variables. We show that any balanced (with the sum of coefficients being zero) linear inequality of Shannon entropy holds if and only if its differential entropy counterpart also holds; moreover, any linear inequality for differential entropy must be balanced. In particular, our result shows that recently proved differential entropy inequalities by Kontoyiannis and Madiman \cite{KM14} can be deduced from their discrete counterparts due to Tao \cite{Tao10} in a unified manner. Generalizations to certain abelian groups are also obtained. Our proof of extending inequalities of Shannon entropy to differential entropy relies on a result of Rényi \cite{Renyi59} which relates the Shannon entropy of a finely discretized random variable to its differential entropy and also helps in establishing the entropy of the sum of quantized random variables is asymptotically equal to that of the quantized sum; the converse uses the asymptotics of the differential entropy of convolutions with weak additive noise.

A note on Bianchi-Donà's proof to the variance formula of von Neumann entropy

A Proof of Vivo-Pato-Oshanin's Conjecture on the Fluctuation of von Neumann Entropy

On the exact variance of Tsallis entropy in a random pure state

A note on the invariance principle of the product of sums of random variables

Entropic van der Corput's Difference Theorem

On the almost sure invariance principle for dependent Bernoulli random variables

Remark On Variance Bounds

Bernoulli sums and Rényi entropy inequalities

On variational principles for metric mean dimension

Equivalence of additive-combinatorial linear inequalities for Shannon entropy and differential entropy

An Elementary Proof of the Inequality $χ\leq χ^*$ for Conditional Free Entropy

Remarks on the Bottcher-Wenzel Inequality

A remark on entropy numbers

On the Completely Monotone Conjecture for Rényi Entropy

On the von Bahr–Esseen inequality for pairwise independent random vectors in Hilbert spaces with applications to mean convergence

The generalized strong subadditivity of the von Neumann entropy for bosonic quantum systems

On a recent conjecture by Z. Van Herstraeten and N.J. Cerf for the quantum Wigner entropy

Some Remarks on Wente'S Inequality and the Lorentz-Sobolev Space

A Note on and Generalization of "Exploring Modified Kaniadakis Entropy: MOND Theory and the Bekenstein Bound Conjecture"

Continuity bounds for quantum entropies arising from a fundamental entropic inequality

Inequality for Variance of Weighted Sum of Correlated Random Variables and WLLN