Abstract:Real-world complex systems often comprise many distinct types of elements as well as many more types of networked interactions between elements. When the relative abundances of types can be measured well, we further observe heavy-tailed categorical distributions for type frequencies. For the comparison of type frequency distributions of two systems or a system with itself at different time points in time -- a facet of allotaxonometry -- a great range of probability divergences are available. Here, we introduce and explore `probability-turbulence divergence', a tunable, straightforward, and interpretable instrument for comparing normalizable categorical frequency distributions. We model probability-turbulence divergence (PTD) after rank-turbulence divergence (RTD). While probability-turbulence divergence is more limited in application than rank-turbulence divergence, it is more sensitive to changes in type frequency. We build allotaxonographs to display probability turbulence, incorporating a way to visually accommodate zero probabilities for `exclusive types' which are types that appear in only one system. We explore comparisons of example distributions taken from literature, social media, and ecology. We show how probability-turbulence divergence either explicitly or functionally generalizes many existing kinds of distances and measures, including, as special cases, $L^{(p)}$ norms, the Sørensen-Dice coefficient (the $F_1$ statistic), and the Hellinger distance. We discuss similarities with the generalized entropies of R{é}nyi and Tsallis, and the diversity indices (or Hill numbers) from ecology. We close with thoughts on open problems concerning the optimization of the tuning of rank- and probability-turbulence divergence.

Statistical and Topological Properties of Sliced Probability Divergences

Gaussian-Smoothed Sliced Probability Divergences

The Logarithmic Super Divergence and its use in Statistical Inference

A Unifying Framework for Some Directed Distances in Statistics

New divergence measures between persistence diagrams and stability of vectorizations

Computing Marginal and Conditional Divergences between Decomposable Models with Applications

Sliced Wasserstein Distance between Probability Measures on Hilbert Spaces

Differentially Private Sliced Wasserstein Distance

Introducing Divergence for Infinite Probabilistic Models

Geometry and analytic properties of the sliced Wasserstein space

Properties of Discrete Sliced Wasserstein Losses

Divergence Inequalities with Applications in Ergodic Theory

Analyzing Divergence for Nondeterministic Probabilistic Models

Bayesian estimation of the Kullback-Leibler divergence for categorical systems using mixtures of Dirichlet priors

Semi-Nonparametric Estimation of Distribution Divergence in Non-Euclidean Spaces

Limit Distribution for Smooth Total Variation and $χ^2$-Divergence in High Dimensions

Approximation properties of slice-matching operators

Sample Complexity of Probability Divergences under Group Symmetry

Central limit theorem for the Sliced 1-Wasserstein distance and the max-Sliced 1-Wasserstein distance

Probability-turbulence divergence: A tunable allotaxonometric instrument for comparing heavy-tailed categorical distributions

Statistical Inference of Normal Distribution Based on Several Divergence Measures: A Comparative Study