Abstract:Entropy is useful in statistical problems as a measure of irreversibility, randomness, mixing, dispersion, and number of microstates. However, there remains ambiguity over the precise mathematical formulation of entropy, generalized beyond the additive definition pioneered by Boltzmann, Gibbs, and Shannon (applicable to thermodynamic equilibria). For generalized entropies to be applied rigorously to nonequilibrium statistical mechanics, we suggest that there is a need for a physically interpretable (dimensional) framework that can be connected to dynamical processes operating in phase space. In this work, we introduce dimensional measures of entropy that admit arbitrary invertible weight functions (subject to curvature and convergence requirements). These "dimensional entropies" have physical dimensions of phase-space volume and represent the extent of level sets of the distribution function. Dimensional entropies with power-law weight functions (related to Rényi and Tsallis entropies) are particularly robust, as they do not require any internal dimensional parameters due to their scale invariance. We also point out the existence of composite entropy measures that can be constructed from functionals of dimensional entropies. We calculate the response of the dimensional entropies to perturbations, showing that for a structured distribution, perturbations have the largest impact on entropies weighted at a similar phase-space scale. This elucidates the link between dynamics (perturbations) and statistics (entropies). Finally, we derive corresponding generalized maximum-entropy distributions. Dimensional entropies may be useful as a diagnostic (for irreversibility) and for theoretical modeling (if the underlying irreversible processes in phase space are understood) in chaotic and complex systems, such as collisionless systems of particles with long-range interactions.

Entropies of Mixing and the Lorenz Order

Geometric Entropies of Mixing (EOM)

Mixing via sequence entropy

Generalized Entropy from Mixing: Thermodynamics, Mutual Information and Symmetry Breaking

Entropy and the uniform mean ergodic theorem for a family of sets

On Local Aspects of Topological Weak Mixing, Sequence Entropy and Chaos

Local Escape Rates for -Mixing Dynamical Systems

Monotonically equivalent entropies and solution of additivity equation

Mixed-Up-Ness or Entropy?

Positive Topological Entropy and Δ-weakly Mixing Sets

The Central Limit Theorem for uniformly strong mixing measures

Rates of mixing for the measure of maximal entropy of dispersing billiard maps

How multiplicity determines entropy and the derivation of the maximum entropy principle for complex systems

A Characterization of Entropy as a Universal Monoidal Natural Transformation

Properties of the Shannon, Rényi and other entropies: dependence in parameters, robustness in distributions and extremes

Generalized Entanglement Entropies of Quantum Designs.

On an entropic analogue of additive energy

Dimensional measures of generalized entropy

On the role of composition entropies in the statistical mechanics of polydisperse systems

On entropy for mixtures of discrete and continuous variables

Entropies of the Poisson distribution as functions of intensity: "normal" and "anomalous" behavior