Abstract:We study various information-theoretic measures and the information geometry of the Poincaré distributions and the related hyperboloid distributions, and prove that their statistical mixture models are universal density estimators of smooth densities in hyperbolic spaces. The Poincaré and the hyperboloid distributions are two types of hyperbolic probability distributions defined using different models of hyperbolic geometry. Namely, the Poincaré distributions form a triparametric bivariate exponential family whose sample space is the hyperbolic Poincaré upper-half plane and natural parameter space is the open 3D convex cone of two-by-two positive-definite matrices. The family of hyperboloid distributions form another exponential family which has sample space the forward sheet of the two-sheeted unit hyperboloid modeling hyperbolic geometry. In the first part, we prove that all $f$-divergences between Poincaré distributions can be expressed using three canonical terms using Eaton's framework of maximal group invariance. We also show that the $f$-divergences between any two Poincaré distributions are asymmetric except when those distributions belong to a same leaf of a particular foliation of the parameter space. We report closed-form formula for the Fisher information matrix, the Shannon's differential entropy and the Kullback-Leibler divergence. and Bhattacharyya distances between such distributions using the framework of exponential families. In the second part, we state the corresponding results for the exponential family of hyperboloid distributions by highlighting a parameter correspondence between the Poincaré and the hyperboloid distributions. Finally, we describe a random generator to draw variates and present two Monte Carlo methods to stochastically estimate numerically $f$-divergences between hyperbolic distributions.

The basics of information geometry

Information Geometry for the Working Information Theorist

Information Geometry of the Probability Simplex: A Short Course

Geometric Measures of Information for Quantum State Characterization

Geometric Modeling in Probability and Statistics

Understanding Higher-Order Interactions in Information Space

GAIT: A Geometric Approach to Information Theory

Progress in Theory and Applications of Information Geometry

Information Distances Versus Entropy Metric

Geometry of Information Integration

Information geometric methods for complexity

Reference duality and representation duality in information geometry

From Classical to Quantum Information Geometry: A Guide for Physicists

The Information Geometry of UMAP

Pseudo-Riemannian geometry embeds information geometry in optimal transport

Information geometry for types in the large-$n$ limit of random matrices

Quantum Information Dimension and Geometric Entropy

Information geometry of diffeomorphism groups

Geometric Insights into the Multivariate Gaussian Distribution and Its Entropy and Mutual Information

Nonparametric Information Geometry: From Divergence Function to Referential-Representational Biduality on Statistical Manifolds

Information measures and geometry of the hyperbolic exponential families of Poincaré and hyperboloid distributions