Abstract:We study various information-theoretic measures and the information geometry of the Poincaré distributions and the related hyperboloid distributions, and prove that their statistical mixture models are universal density estimators of smooth densities in hyperbolic spaces. The Poincaré and the hyperboloid distributions are two types of hyperbolic probability distributions defined using different models of hyperbolic geometry. Namely, the Poincaré distributions form a triparametric bivariate exponential family whose sample space is the hyperbolic Poincaré upper-half plane and natural parameter space is the open 3D convex cone of two-by-two positive-definite matrices. The family of hyperboloid distributions form another exponential family which has sample space the forward sheet of the two-sheeted unit hyperboloid modeling hyperbolic geometry. In the first part, we prove that all $f$-divergences between Poincaré distributions can be expressed using three canonical terms using Eaton's framework of maximal group invariance. We also show that the $f$-divergences between any two Poincaré distributions are asymmetric except when those distributions belong to a same leaf of a particular foliation of the parameter space. We report closed-form formula for the Fisher information matrix, the Shannon's differential entropy and the Kullback-Leibler divergence. and Bhattacharyya distances between such distributions using the framework of exponential families. In the second part, we state the corresponding results for the exponential family of hyperboloid distributions by highlighting a parameter correspondence between the Poincaré and the hyperboloid distributions. Finally, we describe a random generator to draw variates and present two Monte Carlo methods to stochastically estimate numerically $f$-divergences between hyperbolic distributions.

On the f-divergences between densities of a multivariate location or scale family

A note on the $f$-divergences between multivariate location-scale families with either prescribed scale matrices or location parameters

Divergences Induced by the Cumulant and Partition Functions of Exponential Families and Their Deformations Induced by Comparative Convexity

On the Increments of A D-Dimensional Gaussian Process

The Logarithmic Super Divergence and its use in Statistical Inference

Divergences induced by dual subtractive and divisive normalizations of exponential families and their convex deformations

The duo Fenchel-Young divergence

Information measures and geometry of the hyperbolic exponential families of Poincaré and hyperboloid distributions

Distances and Riemannian Metrics for Multivariate Spectral Densities

Bounds on f-Divergences between Distributions within Generalized Quasi-$\varepsilon$-Neighborhood

Bounds on f-Divergences between Distributions within Generalized Quasi-ε-Neighborhood

Quantum $f$-divergences via Nussbaum-Szkoła Distributions and Applications to $f$-divergence Inequalities

Quantum Rényi and $f$-divergences from integral representations

On Semi-supervised Estimation of Discrete Distributions under f-divergences

f-divergence estimation and two-sample homogeneity test under semiparametric density-ratio models

Non-central limit of densities of some functionals of Gaussian processes

Limit Distribution for Smooth Total Variation and $χ^2$-Divergence in High Dimensions

A Unifying Framework for Some Directed Distances in Statistics

Scale dependence of distributions of hotspots

Monte Carlo Information Geometry: The dually flat case

On the Kullback-Leibler divergence between discrete normal distributions