Abstract:Entropy is useful in statistical problems as a measure of irreversibility, randomness, mixing, dispersion, and number of microstates. However, there remains ambiguity over the precise mathematical formulation of entropy, generalized beyond the additive definition pioneered by Boltzmann, Gibbs, and Shannon (applicable to thermodynamic equilibria). For generalized entropies to be applied rigorously to nonequilibrium statistical mechanics, we suggest that there is a need for a physically interpretable (dimensional) framework that can be connected to dynamical processes operating in phase space. In this work, we introduce dimensional measures of entropy that admit arbitrary invertible weight functions (subject to curvature and convergence requirements). These "dimensional entropies" have physical dimensions of phase-space volume and represent the extent of level sets of the distribution function. Dimensional entropies with power-law weight functions (related to Rényi and Tsallis entropies) are particularly robust, as they do not require any internal dimensional parameters due to their scale invariance. We also point out the existence of composite entropy measures that can be constructed from functionals of dimensional entropies. We calculate the response of the dimensional entropies to perturbations, showing that for a structured distribution, perturbations have the largest impact on entropies weighted at a similar phase-space scale. This elucidates the link between dynamics (perturbations) and statistics (entropies). Finally, we derive corresponding generalized maximum-entropy distributions. Dimensional entropies may be useful as a diagnostic (for irreversibility) and for theoretical modeling (if the underlying irreversible processes in phase space are understood) in chaotic and complex systems, such as collisionless systems of particles with long-range interactions.

Generalized Entropies, Variance and Applications

A Generalized Measure of Cumulative Residual Entropy

On the generalized cumulative residual entropy with applications in actuarial science

Weighted cumulative residual Entropy Generating Function and its properties

On Weighted Residual and Past Entropies

Insights into Entropy As a Measure of Multivariate Variability.

On generalized conditional cumulative residual inaccuracy measure

Asymptotic Distribution Theory for Nonparametric Entropy Measures of Serial Dependence

Non parametric estimation of residual-past entropy, mean residual-past lifetime, residual-past inaccuracy measure and asymptotic limits

Entropy generating function for past lifetime and its properties

Stochastic properties of varentropy based on residual lifetime

Extended weighted generalized cumulative residual entropy for risk measurement

Results on Varextropy Measure of Random Variables

Residual Inaccuracy Extropy and its properties

Generalized Relative Entropy: New Look at Rényi Entropy and Its Exploration from Complexity Measures to Sparsity Measures with Applications in Machine Condition Monitoring

Extropy: Characterizations and dynamic versions

Two Parameter Generalized Entropy of Uncertain Random Variables and Its Application

On a Family of Coherent Measures of Variability

Varentropy of past lifetimes

Dimensional measures of generalized entropy

Cumulative Information Generating Function and Generalized Gini Functions