Abstract:Research on the use of information geometry (IG) in modern physics has witnessed significant advances recently. In this review article, we report on the utilization of IG methods to define measures of complexity in both classical and, whenever available, quantum physical settings. A paradigmatic example of a dramatic change in complexity is given by phase transitions (PTs). Hence we review both global and local aspects of PTs described in terms of the scalar curvature of the parameter manifold and the components of the metric tensor, respectively. We also report on the behavior of geodesic paths on the parameter manifold used to gain insight into the dynamics of PTs. Going further, we survey measures of complexity arising in the geometric framework. In particular, we quantify complexity of networks in terms of the Riemannian volume of the parameter space of a statistical manifold associated with a given network. We are also concerned with complexity measures that account for the interactions of a given number of parts of a system that cannot be described in terms of a smaller number of parts of the system. Finally, we investigate complexity measures of entropic motion on curved statistical manifolds that arise from a probabilistic description of physical systems in the presence of limited information. The Kullback-Leibler divergence, the distance to an exponential family and volumes of curved parameter manifolds, are examples of essential IG notions exploited in our discussion of complexity. We conclude by discussing strengths, limits, and possible future applications of IG methods to the physics of complexity.

Information Geometry of the Probability Simplex: A Short Course

Geometric Modeling in Probability and Statistics

The basics of information geometry

Information Geometry for the Working Information Theorist

Information Geometry of the Gaussian Space

Optimization via Information Geometry

Transport information geometry I: Riemannian calculus on probability simplex

Dually affine Information Geometry modeled on a Banach space

Information-Geometric Set Embeddings (IGSE): From Sets to Probability Distributions

A Lecture About the Use of Orlicz Spaces in Information Geometry

Probability and information theory

Examples of Application of Nonparametric Information Geometry to Statistical Physics

Generalized Probability Theory: notes for a short course

Monte Carlo Information Geometry: The dually flat case

Information Geometry and Statistical Manifold

Progress in Theory and Applications of Information Geometry

Information geometric methods for complexity

Information Geometry of Dynamics on Graphs and Hypergraphs

Information geometry for types in the large-$n$ limit of random matrices

Extended Information Geometry: Large Deviation Theory, Statistical Thermodynamics, and Empirical Counting Frequencies

Lectures on Probability, Entropy, and Statistical Physics