Abstract:We prove a variety of new and refined uniform continuity bounds for entropies of both classical random variables on an infinite state space and of quantum states of infinite-dimensional systems. We obtain the first tight continuity estimate on the Shannon entropy of random variables with a countably infinite alphabet. The proof relies on a new mean-constrained Fano-type inequality and the notion of maximal coupling of random variables. We then employ this classical result to derive the first tight energy-constrained continuity bound for the von Neumann entropy of states of infinite-dimensional quantum systems, when the Hamiltonian is the number operator, which is arguably the most relevant Hamiltonian in the study of infinite-dimensional quantum systems in the context of quantum information theory. The above scheme works only for Shannon- and von Neumann entropies. Hence, to deal with more general entropies, e.g. $\alpha$-Rényi and $\alpha$-Tsallis entropies, with $\alpha \in (0,1)$, for which continuity bounds are known only for finite-dimensional systems, we develop a novel approximation scheme which relies on recent results on operator Hölder continuous functions and the equivalence of all Schatten norms in special spectral subspaces of the Hamiltonian. This approach is, as we show, motivated by continuity bounds for $\alpha$-Rényi and $\alpha$-Tsallis entropies of random variables that follow from the Hölder continuity of the entropy functionals. Bounds for $\alpha>1$ are provided, too. Finally, we settle an open problem on related approximation questions posed in the recent works by Shirokov on the so-called Finite-dimensional Approximation (FA) property.

Bounds of some divergence measures on time scales via Abel–Gontscharoff interpolation

The Logarithmic Super Divergence and its use in Statistical Inference

Divergence measures based on the Shannon entropy

Divergence Inequalities with Applications in Ergodic Theory

Some new generalizations of reversed Minkowski's inequality for several functions via time scales

Fractional divergence-measure fields, Leibniz rule and Gauss-Green formula

N-dimension for dynamic generalized inequalities of Hölder and Minkowski type on diamond alpha time scales

Generalized divergences for statistical evaluation of uncertainty in long-memory processes

Generalizations of Levinson-type inequalities via new Green functions and Hermite interpolating polynomial

Divergence Measure of Belief Function and Its Application in Data Fusion

Bounds on f-Divergences between Distributions within Generalized Quasi-$\varepsilon$-Neighborhood

A Unifying Framework for Some Directed Distances in Statistics

From Classical to Quantum: Uniform Continuity Bounds on Entropies in Infinite Dimensions

Borel-Cantelli, zero-one laws and inhomogeneous Duffin-Schaeffer

Statistical and Topological Properties of Sliced Probability Divergences

Generalized Dynamic Inequalities of Copson Type on Time Scales

Sum-of-Squares Relaxations for Information Theory and Variational Inference

Some dynamic Hardy-type inequalities with negative parameters on time scales nabla calculus

Some integral inequalities on time scales

Estimates of some applicable inequalities on time scales

Belief Re ́nyi Divergence of Divergence and Its Application in Time Series Classification