Abstract:We prove a variety of new and refined uniform continuity bounds for entropies of both classical random variables on an infinite state space and of quantum states of infinite-dimensional systems. We obtain the first tight continuity estimate on the Shannon entropy of random variables with a countably infinite alphabet. The proof relies on a new mean-constrained Fano-type inequality and the notion of maximal coupling of random variables. We then employ this classical result to derive the first tight energy-constrained continuity bound for the von Neumann entropy of states of infinite-dimensional quantum systems, when the Hamiltonian is the number operator, which is arguably the most relevant Hamiltonian in the study of infinite-dimensional quantum systems in the context of quantum information theory. The above scheme works only for Shannon- and von Neumann entropies. Hence, to deal with more general entropies, e.g. $\alpha$-Rényi and $\alpha$-Tsallis entropies, with $\alpha \in (0,1)$, for which continuity bounds are known only for finite-dimensional systems, we develop a novel approximation scheme which relies on recent results on operator Hölder continuous functions and the equivalence of all Schatten norms in special spectral subspaces of the Hamiltonian. This approach is, as we show, motivated by continuity bounds for $\alpha$-Rényi and $\alpha$-Tsallis entropies of random variables that follow from the Hölder continuity of the entropy functionals. Bounds for $\alpha>1$ are provided, too. Finally, we settle an open problem on related approximation questions posed in the recent works by Shirokov on the so-called Finite-dimensional Approximation (FA) property.

Uniform Additivity in Classical and Quantum Information

Additivity violation of the regularized Minimum Output Entropy

The subadditivity of quantum entropy in Gaussian quantum systems

Optimal uniform continuity bound for conditional entropy of classical--quantum states

Gaussian optimizers and the additivity problem in quantum information theory

Generic nonadditivity of quantum capacity in simple channels

New Additivity Properties of the Relative Entropy of Entanglement and Its Generalizations

Isotropic quantum spin channels and additivity questions

Superadditivity with Mixed States Ensemble

Additivity and Non-Additivity of Multipartite Entanglement Measures

Additivity of quantum capacities in simple non-degradable quantum channels

The Saturation of Several Universal Inequalities in Information-Processing

The Exact Entropy Formula of the Ideal Gas and its Information-Theoretic Interpretation

Uniform Quantification of Correlations for Bipartite Systems

Quantum superadditivity in linear optics networks: sending bits via multiple access Gaussian channels

Alternative New Notation for Quantum Information Theory

Principle of Information Increase: An Operational Perspective of Information Gain in the Foundations of Quantum Theory

From Classical to Quantum: Uniform Continuity Bounds on Entropies in Infinite Dimensions

Generalized smooth mutual max-information of quantum channel

Quantum weighted entropy and its properties