Abstract:We prove a variety of new and refined uniform continuity bounds for entropies of both classical random variables on an infinite state space and of quantum states of infinite-dimensional systems. We obtain the first tight continuity estimate on the Shannon entropy of random variables with a countably infinite alphabet. The proof relies on a new mean-constrained Fano-type inequality and the notion of maximal coupling of random variables. We then employ this classical result to derive the first tight energy-constrained continuity bound for the von Neumann entropy of states of infinite-dimensional quantum systems, when the Hamiltonian is the number operator, which is arguably the most relevant Hamiltonian in the study of infinite-dimensional quantum systems in the context of quantum information theory. The above scheme works only for Shannon- and von Neumann entropies. Hence, to deal with more general entropies, e.g. $\alpha$-Rényi and $\alpha$-Tsallis entropies, with $\alpha \in (0,1)$, for which continuity bounds are known only for finite-dimensional systems, we develop a novel approximation scheme which relies on recent results on operator Hölder continuous functions and the equivalence of all Schatten norms in special spectral subspaces of the Hamiltonian. This approach is, as we show, motivated by continuity bounds for $\alpha$-Rényi and $\alpha$-Tsallis entropies of random variables that follow from the Hölder continuity of the entropy functionals. Bounds for $\alpha>1$ are provided, too. Finally, we settle an open problem on related approximation questions posed in the recent works by Shirokov on the so-called Finite-dimensional Approximation (FA) property.

A Note on the Estimation of Von Neumann and Relative Entropy via Quantum State Observers

Quantum Neural Estimation of Entropies

Quantifying the non-Gaussian character of a quantum state by quantum relative entropy

Quantifying Information Extraction using Generalized Quantum Measurements

Continuity bounds on observational entropy and measured relative entropies

Observational entropy with general quantum priors

Measurement-induced Nonlocality Based on the Relative Entropy

Continuity bounds for quantum entropies arising from a fundamental entropic inequality

Relative Entropy via Distribution of Observables

Sublinear quantum algorithms for estimating von Neumann entropy

Quantum channels and some absolute properties of quantum states

Attainability and lower semi-continuity of the relative entropy of entanglement, and variations on the theme

A strengthened monotonicity inequality of quantum relative entropy: A unifying approach via Rényi relative entropy

Asymmetry and tighter uncertainty relations for Rényi entropies via quantum-classical decompositions of resource measures

Gravitational entropy is observer-dependent

Relative Entropy for Quantum Channels

From Classical to Quantum: Uniform Continuity Bounds on Entropies in Infinite Dimensions

On dynamical measures of quantum information

A new entropy measure of quantum system uncertainty

Entropy of Quantum Measurements

Deriving the Landauer Principle From the Quantum Shannon Entropy