Abstract:Many partially-successful attempts have been made to find the most natural discrete-variable version of Shannon's entropy power inequality (EPI). We develop an axiomatic framework from which we deduce the natural form of a discrete-variable EPI and an associated entropic monotonicity in a discrete-variable central limit theorem. In this discrete EPI, the geometric distribution, which has the maximum entropy among all discrete distributions with a given mean, assumes a role analogous to the Gaussian distribution in Shannon's EPI. The entropy power of $X$ is defined as the mean of a geometric random variable with entropy $H(X)$. The crux of our construction is a discrete-variable version of Lieb's scaled addition $X \boxplus_\eta Y$ of two discrete random variables $X$ and $Y$ with $\eta \in (0, 1)$. We discuss the relationship of our discrete EPI with recent work of Yu and Johnson who developed an EPI for a restricted class of random variables that have ultra-log-concave (ULC) distributions. Even though we leave open the proof of the aforesaid natural form of the discrete EPI, we show that this discrete EPI holds true for variables with arbitrary discrete distributions when the entropy power is redefined as $e^{H(X)}$ in analogy with the continuous version. Finally, we show that our conjectured discrete EPI is a special case of the yet-unproven Entropy Photon-number Inequality (EPnI), which assumes a role analogous to Shannon's EPI in capacity proofs for Gaussian bosonic (quantum) channels.

A generalization of Costa's Entropy Power Inequality

Prove Costa's Entropy Power Inequality and High Order Inequality for Differential Entropy with Semidefinite Programming

A Conditional Entropy Power Inequality for Dependent Variables

Entropy Inequalities and Gaussian Comparisons

Unifying the Brascamp-Lieb Inequality and the Entropy Power Inequality

Information Theoretic Proofs of Entropy Power Inequalities

On an entropic analogue of additive energy

A Characterization of Entropy as a Universal Monoidal Natural Transformation

Generalized Shannon-Khinchin Axioms and Uniqueness Theorem for Pseudo-additive Entropies

On the Shannon entropy power on Riemannian manifolds and Ricci flow

Equivalence of additive-combinatorial linear inequalities for Shannon entropy and differential entropy

Thinning, photonic beamsplitting, and a general discrete entropy power inequality

Concavity of some entropies

Approximate Discrete Entropy Monotonicity for Log-Concave Sums

A note on Shannon entropy

Conditional Entropy Formula with Respect to Monotonic Partitions

A two-parameter entropy and its fundamental properties

Generalization of Shannon-Khinchin Axioms to Nonextensive Systems and the Uniqueness Theorem

An Elementary Proof of the Inequality $χ\leq χ^*$ for Conditional Free Entropy

Weighted $p$-Rényi Entropy Power Inequality: Information Theory to Quantum Shannon Theory

Error Bounds on a Mixed Entropy Inequality