Abstract:We study various information-theoretic measures and the information geometry of the Poincaré distributions and the related hyperboloid distributions, and prove that their statistical mixture models are universal density estimators of smooth densities in hyperbolic spaces. The Poincaré and the hyperboloid distributions are two types of hyperbolic probability distributions defined using different models of hyperbolic geometry. Namely, the Poincaré distributions form a triparametric bivariate exponential family whose sample space is the hyperbolic Poincaré upper-half plane and natural parameter space is the open 3D convex cone of two-by-two positive-definite matrices. The family of hyperboloid distributions form another exponential family which has sample space the forward sheet of the two-sheeted unit hyperboloid modeling hyperbolic geometry. In the first part, we prove that all $f$-divergences between Poincaré distributions can be expressed using three canonical terms using Eaton's framework of maximal group invariance. We also show that the $f$-divergences between any two Poincaré distributions are asymmetric except when those distributions belong to a same leaf of a particular foliation of the parameter space. We report closed-form formula for the Fisher information matrix, the Shannon's differential entropy and the Kullback-Leibler divergence. and Bhattacharyya distances between such distributions using the framework of exponential families. In the second part, we state the corresponding results for the exponential family of hyperboloid distributions by highlighting a parameter correspondence between the Poincaré and the hyperboloid distributions. Finally, we describe a random generator to draw variates and present two Monte Carlo methods to stochastically estimate numerically $f$-divergences between hyperbolic distributions.

On the Kullback-Leibler divergence between discrete normal distributions

Detecting abnormal situations using the Kullback-Leibler divergence.

Divergences induced by dual subtractive and divisive normalizations of exponential families and their convex deformations

Divergences Induced by the Cumulant and Partition Functions of Exponential Families and Their Deformations Induced by Comparative Convexity

On mean and/or variance mixtures of normal distributions

The duo Fenchel-Young divergence

The Logarithmic Super Divergence and its use in Statistical Inference

Exact Expressions for Kullback–Leibler Divergence for Univariate Distributions

Information measures and geometry of the hyperbolic exponential families of Poincaré and hyperboloid distributions

Exact Expressions for Kullback-Leibler Divergence for Multivariate and Matrix-Variate Distributions

Asymptotic Distribution Theory for Nonparametric Entropy Measures of Serial Dependence

A Unifying Framework for Some Directed Distances in Statistics

Log-Determinant Divergences Revisited: Alpha-Beta and Gamma Log-Det Divergences

Limit Distribution for Smooth Total Variation and $χ^2$-Divergence in High Dimensions

Divergence measures based on the Shannon entropy

Generalizing Jensen and Bregman divergences with comparative convexity and the statistical Bhattacharyya distances with comparable means

Statistical Inference of Normal Distribution Based on Several Divergence Measures: A Comparative Study

Bayesian estimation of the Kullback-Leibler divergence for categorical systems using mixtures of Dirichlet priors

Statistical and Geometrical properties of regularized Kernel Kullback-Leibler divergence

Non-asymptotic approximations for Pearson's chi-square statistic and its application to confidence intervals for strictly convex functions of the probability weights of discrete distributions

The $q$-generalised multinomial/KL-divergence correspondence