Abstract:Entropy is useful in statistical problems as a measure of irreversibility, randomness, mixing, dispersion, and number of microstates. However, there remains ambiguity over the precise mathematical formulation of entropy, generalized beyond the additive definition pioneered by Boltzmann, Gibbs, and Shannon (applicable to thermodynamic equilibria). For generalized entropies to be applied rigorously to nonequilibrium statistical mechanics, we suggest that there is a need for a physically interpretable (dimensional) framework that can be connected to dynamical processes operating in phase space. In this work, we introduce dimensional measures of entropy that admit arbitrary invertible weight functions (subject to curvature and convergence requirements). These "dimensional entropies" have physical dimensions of phase-space volume and represent the extent of level sets of the distribution function. Dimensional entropies with power-law weight functions (related to Rényi and Tsallis entropies) are particularly robust, as they do not require any internal dimensional parameters due to their scale invariance. We also point out the existence of composite entropy measures that can be constructed from functionals of dimensional entropies. We calculate the response of the dimensional entropies to perturbations, showing that for a structured distribution, perturbations have the largest impact on entropies weighted at a similar phase-space scale. This elucidates the link between dynamics (perturbations) and statistics (entropies). Finally, we derive corresponding generalized maximum-entropy distributions. Dimensional entropies may be useful as a diagnostic (for irreversibility) and for theoretical modeling (if the underlying irreversible processes in phase space are understood) in chaotic and complex systems, such as collisionless systems of particles with long-range interactions.

Entropy computing via integration over fractal measures

On new fractal phenomena connected with infinite linear IFS

On the Higuchi fractal dimension of invariant measures for countable idempotent iterated function systems

Fractal Measure Theory for Knowledge Representation

Fourier transforms and iterated function systems

Dynamical Properties of Iterated Function Systems

Multifractal formalism for inverse measures of random weak Gibbs measures

The discrete charm of iterated function systems. A computer scientist's perspective on approximation of IFS invariant sets and measures

Dimensional measures of generalized entropy

Quantum Chaos, Randomness and Universal Scaling of Entanglement in Various Krylov Spaces

Reexamination of an Information Geometric Construction of Entropic Indicators of Complexity

Continuity of entropies via integral representations

Entropic Fluctuations in Statistical Mechanics II. Quantum Dynamical Systems

Multifractality for intermediate quantum systems

A novel cross-entropy and entropy measures of IFSs and their applications

The Metric Entropy of Random Dynamical Systems in A Hilbert Space: Characterization of Invariant Measures Satisfying Pesin'S Entropy Formula

The Infinite-Dimensional Quantum Entropy: the Unified Entropy Case

Entanglement Fractalization

Rényi Entropy and Rényi Divergence in the Intuitionistic Fuzzy Case

Quantifying quantum chaos through microcanonical distributions of entanglement

New fractal dimensions of measures and decompositions of singularly continuous measures