Abstract:Many partially-successful attempts have been made to find the most natural discrete-variable version of Shannon's entropy power inequality (EPI). We develop an axiomatic framework from which we deduce the natural form of a discrete-variable EPI and an associated entropic monotonicity in a discrete-variable central limit theorem. In this discrete EPI, the geometric distribution, which has the maximum entropy among all discrete distributions with a given mean, assumes a role analogous to the Gaussian distribution in Shannon's EPI. The entropy power of $X$ is defined as the mean of a geometric random variable with entropy $H(X)$. The crux of our construction is a discrete-variable version of Lieb's scaled addition $X \boxplus_\eta Y$ of two discrete random variables $X$ and $Y$ with $\eta \in (0, 1)$. We discuss the relationship of our discrete EPI with recent work of Yu and Johnson who developed an EPI for a restricted class of random variables that have ultra-log-concave (ULC) distributions. Even though we leave open the proof of the aforesaid natural form of the discrete EPI, we show that this discrete EPI holds true for variables with arbitrary discrete distributions when the entropy power is redefined as $e^{H(X)}$ in analogy with the continuous version. Finally, we show that our conjectured discrete EPI is a special case of the yet-unproven Entropy Photon-number Inequality (EPnI), which assumes a role analogous to Shannon's EPI in capacity proofs for Gaussian bosonic (quantum) channels.

Properties of Shannon and Rényi entropies of the Poisson distribution as the functions of intensity parameter

Entropies of the Poisson distribution as functions of intensity: "normal" and "anomalous" behavior

Properties of the Shannon, Rényi and other entropies: dependence in parameters, robustness in distributions and extremes

An Intrinsic Characterization of Shannon's and Rényi's Entropy

Bernoulli sums and Rényi entropy inequalities

Concavity of some entropies

Renyi extrapolation of Shannon entropy

On the Completely Monotone Conjecture for Rényi Entropy

Weighted $p$-Rényi Entropy Power Inequality: Information Theory to Quantum Shannon Theory

Perspective on Physical Interpretations of Rényi Entropy in Statistical Mechanics

Equivalence of additive-combinatorial linear inequalities for Shannon entropy and differential entropy

Rényi--Sobolev Inequalities and Connections to Spectral Graph Theory

Thinning, photonic beamsplitting, and a general discrete entropy power inequality

Weighted Approach to Rényi Entropy

Monotonicity of the von Neumann entropy expressed as a function of Rényi entropies

On two classes of Rényi entropy functions of a quantum channel

Generalized Rényi entropy accumulation theorem and generalized quantum probability estimation

A Formulation of Rényi Entropy on $C^*$-Algebras

Entropy numbers and Marcinkiewicz-type discretization theorem

The subadditivity of quantum entropy in Gaussian quantum systems