Abstract:We prove a variety of new and refined uniform continuity bounds for entropies of both classical random variables on an infinite state space and of quantum states of infinite-dimensional systems. We obtain the first tight continuity estimate on the Shannon entropy of random variables with a countably infinite alphabet. The proof relies on a new mean-constrained Fano-type inequality and the notion of maximal coupling of random variables. We then employ this classical result to derive the first tight energy-constrained continuity bound for the von Neumann entropy of states of infinite-dimensional quantum systems, when the Hamiltonian is the number operator, which is arguably the most relevant Hamiltonian in the study of infinite-dimensional quantum systems in the context of quantum information theory. The above scheme works only for Shannon- and von Neumann entropies. Hence, to deal with more general entropies, e.g. $\alpha$-Rényi and $\alpha$-Tsallis entropies, with $\alpha \in (0,1)$, for which continuity bounds are known only for finite-dimensional systems, we develop a novel approximation scheme which relies on recent results on operator Hölder continuous functions and the equivalence of all Schatten norms in special spectral subspaces of the Hamiltonian. This approach is, as we show, motivated by continuity bounds for $\alpha$-Rényi and $\alpha$-Tsallis entropies of random variables that follow from the Hölder continuity of the entropy functionals. Bounds for $\alpha>1$ are provided, too. Finally, we settle an open problem on related approximation questions posed in the recent works by Shirokov on the so-called Finite-dimensional Approximation (FA) property.

Entropy, Ultralimits and the Poisson boundary

Ultralimits, Amenable actions and Entropy

Entropy of group actions beyond uniform lattices

Entropies and Poisson boundaries of random walks on groups with rapid decay

Behaviour of Entropy Under Bounded and Integrable Orbit Equivalence

Secret sharing on the Poisson-Furstenberg boundary I

Entropy, virtual Abelianness and Shannon orbit equivalence

Existence and phase structure of random inverse limit measures

Ergodic measures in minimal group actions with finite topological sequence entropy

Topological entropy of sets of generic points for actions of amenable groups

The Unique stationary boundary property

Weak equivalence of stationary actions and the entropy realization problem

Finite Measures of Maximal Entropy for an Open Set of Partially Hyperbolic Diffeomorphisms

Boundaries and equivariant maps for ergodic groupoids

Quasi-similarity, entropy and disjointness of ergodic systems

Plünnecke inequalities for countable abelian groups

From Classical to Quantum: Uniform Continuity Bounds on Entropies in Infinite Dimensions

Local Entropy Theory for a Countable Discrete Amenable Group Action

On the Measure of Maximal Entropy for Finite Horizon Sinai Billiard Maps

Shannon-McMillan-Breiman theorem along almost geodesics in negatively curved groups

Hyperbolic entropy for harmonic measures on singular holomorphic foliations