Abstract:We prove a variety of new and refined uniform continuity bounds for entropies of both classical random variables on an infinite state space and of quantum states of infinite-dimensional systems. We obtain the first tight continuity estimate on the Shannon entropy of random variables with a countably infinite alphabet. The proof relies on a new mean-constrained Fano-type inequality and the notion of maximal coupling of random variables. We then employ this classical result to derive the first tight energy-constrained continuity bound for the von Neumann entropy of states of infinite-dimensional quantum systems, when the Hamiltonian is the number operator, which is arguably the most relevant Hamiltonian in the study of infinite-dimensional quantum systems in the context of quantum information theory. The above scheme works only for Shannon- and von Neumann entropies. Hence, to deal with more general entropies, e.g. $\alpha$-Rényi and $\alpha$-Tsallis entropies, with $\alpha \in (0,1)$, for which continuity bounds are known only for finite-dimensional systems, we develop a novel approximation scheme which relies on recent results on operator Hölder continuous functions and the equivalence of all Schatten norms in special spectral subspaces of the Hamiltonian. This approach is, as we show, motivated by continuity bounds for $\alpha$-Rényi and $\alpha$-Tsallis entropies of random variables that follow from the Hölder continuity of the entropy functionals. Bounds for $\alpha>1$ are provided, too. Finally, we settle an open problem on related approximation questions posed in the recent works by Shirokov on the so-called Finite-dimensional Approximation (FA) property.

Three Types of Statistics and the Entropy Bounds

Infinite Statistics and Holographic Principle

The entropy bound for local quantum field theory

Relativistic Theory of Infinite Statistics Fields

Comment on "holographic Entropy Bound and Local Quantum Field Theory"

Generalizations of quantum statistics

Exact Results for Bose–Einstein and Fermi–Dirac Statistics for Finite Generic Systems

From Classical to Quantum: Uniform Continuity Bounds on Entropies in Infinite Dimensions

Bekenstein bound on black hole entropy in non-Gaussian statistics

Nonextensive Statistics and The Entropy on the Horizon

The foundations of statistical physics: entropy, irreversibility, and inference

Non-extensive Quantum Statistics with Particle–hole Symmetry

Bounds on the rates of statistical divergences and mutual information via stochastic thermodynamics

Entanglement entropy for a type of scale-invariant states in two spatial dimensions and beyond: universal finite-size scaling

How are Entanglement Entropies Related to Entropy Bounds?

Entropy Bounds in $R\times S^3$ Geometries

Decrease of Entropy, Quantum Statistics and Possible Violation of Pauli Exclusion Principle

Generalized Rényi entropy accumulation theorem and generalized quantum probability estimation

Universal entropy relations: entropy formulae and entropy bound