Abstract:We prove a variety of new and refined uniform continuity bounds for entropies of both classical random variables on an infinite state space and of quantum states of infinite-dimensional systems. We obtain the first tight continuity estimate on the Shannon entropy of random variables with a countably infinite alphabet. The proof relies on a new mean-constrained Fano-type inequality and the notion of maximal coupling of random variables. We then employ this classical result to derive the first tight energy-constrained continuity bound for the von Neumann entropy of states of infinite-dimensional quantum systems, when the Hamiltonian is the number operator, which is arguably the most relevant Hamiltonian in the study of infinite-dimensional quantum systems in the context of quantum information theory. The above scheme works only for Shannon- and von Neumann entropies. Hence, to deal with more general entropies, e.g. $\alpha$-Rényi and $\alpha$-Tsallis entropies, with $\alpha \in (0,1)$, for which continuity bounds are known only for finite-dimensional systems, we develop a novel approximation scheme which relies on recent results on operator Hölder continuous functions and the equivalence of all Schatten norms in special spectral subspaces of the Hamiltonian. This approach is, as we show, motivated by continuity bounds for $\alpha$-Rényi and $\alpha$-Tsallis entropies of random variables that follow from the Hölder continuity of the entropy functionals. Bounds for $\alpha>1$ are provided, too. Finally, we settle an open problem on related approximation questions posed in the recent works by Shirokov on the so-called Finite-dimensional Approximation (FA) property.

Entropy numbers of finite-dimensional Lorentz space embeddings

Entropy for compact operators and results on entropy and specification

Entropy numbers and box dimension of polynomials and holomorphic functions

Rényi's entropy on Lorentzian spaces. Timelike curvature-dimension conditions

Entropy numbers and Marcinkiewicz-type discretization theorem

Entropy numbers and Marcinkiewicz-type discretization

Entropy of Compact Operators with Applications to Landau-Pollak-Slepian Theory and Sobolev Spaces

Entropy Formula for Endomorphisms: Relations Between Entropy, Exponents and Dimension

From Classical to Quantum: Uniform Continuity Bounds on Entropies in Infinite Dimensions

Entropy numbers of embedding operators of weighted Sobolev spaces with weights that are functions of distance from some h-set

Finite entropy vs finite energy

A probabilistic approach to Lorentz balls

Entropy number and non-linear approximations on multivariate Besov space by manifolds of finite pseudo-dimension

Linear operators with infinite entropy

Generalised Brègman relative entropies: a brief introduction

Estimates for entropy numbers of multiplier operators of multiple series

Operator-valued Schatten spaces and quantum entropies

Entropy of a unitary operator on $l^2(\mathbb{N}_0)$

Postquantum Brègman relative entropies

Notions of entropy for unitary representations

Entropy of Isometries Semi-groups of Hyperbolic space