Abstract:This paper addresses the correspondence between linear inequalities of Shannon entropy and differential entropy for sums of independent group-valued random variables. We show that any balanced (with the sum of coefficients being zero) linear inequality of Shannon entropy holds if and only if its differential entropy counterpart also holds; moreover, any linear inequality for differential entropy must be balanced. In particular, our result shows that recently proved differential entropy inequalities by Kontoyiannis and Madiman \cite{KM14} can be deduced from their discrete counterparts due to Tao \cite{Tao10} in a unified manner. Generalizations to certain abelian groups are also obtained. Our proof of extending inequalities of Shannon entropy to differential entropy relies on a result of Rényi \cite{Renyi59} which relates the Shannon entropy of a finely discretized random variable to its differential entropy and also helps in establishing the entropy of the sum of quantized random variables is asymptotically equal to that of the quantized sum; the converse uses the asymptotics of the differential entropy of convolutions with weak additive noise.

Some Inequalities of Linear Combinations of Independent Random Variables. I.

On Increments of Sums of Independent Non-Identically Distributed Random-Variables

On Bernstein Type Inequalities for Stochastic Integrals of Multivariate Point Processes

SOME UNIFIED RESULTS ON COMPARING LINEAR COMBINATIONS OF INDEPENDENT GAMMA RANDOM VARIABLES

Moment inequalities and application for ρ~--mixing sequence.

Rosenthal’s Inequalities for Independent and Negatively Dependent Random Variables under Sub-Linear Expectations with Applications

The Convergence of the Sums of Independent Random Variables under the Sub-Linear Expectations

A comparison inequality for sums of independent random variables

On the almost sure invariance principle for dependent Bernoulli random variables

A Note on Multivariate Stochastic Comparisons of Bernoulli Random Variables

On Orderings Between Weighted Sums of Random Variables

Rosenthal Type Inequalities for B -Valued Strong Mixing Random Fields and Their Applications

Three Series Theorem for Independent Random Variables under Sub-linear Expectations with Applications

Some inequalities of birandom variable

Equivalence of additive-combinatorial linear inequalities for Shannon entropy and differential entropy

The Sufficient and Necessary Conditions of the Strong Law of Large Numbers under Sub-Linear Expectations

Inequalities for independent random vectors under sublinear expectations

Limit Theorems for Dependent Bernoulli Variables with Statistical Inference

Some inequalities of random fuzzy variableswith application to moment convergence

Maximal inequalities and a law of the iterated logarithm for negatively associated random fields

Strong Limit Theorems for Extended Independent Random Variables and Extended Negatively Dependent Random Variables under Sub-Linear Expectations