Abstract:We show that the essential properties of entropy (monotonicity, additivity and subadditivity) are consequences of entropy being a monoidal natural transformation from the under category functor $-/\mathsf{LProb}_{\rho}$ (where $\mathsf{LProb}_{\rho}$ is category of $\rho$-th-power-summable probability distributions, $0<\rho<1$) to $\Delta_{\mathbb{R}}$. Moreover, the Shannon entropy can be characterized as the universal monoidal natural transformation from $-/\mathsf{LProb}_{\rho}$ to the category of integrally closed partially ordered abelian groups (a reflective subcategory of the lax-slice 2-category over $\mathsf{MonCat}_{\ell}$ in the 2-category of monoidal categories), providing a succinct characterization of Shannon entropy as a reflection arrow. We can likewise define entropy for every monoidal category with a monoidal structure on its under categories (e.g. the category of finite abelian groups, the category of finite inhabited sets, the category of finite dimensional vector spaces, and the augmented simplex category) via the reflection arrow. This implies that all these entropies over different categories are components of a single natural transformation (the unit of the idempotent monad), allowing us to connect these entropies in a natural manner. We also provide a universal characterization of the conditional Shannon entropy based on the chain rule which, unlike the characterization of information loss by Baez, Fritz and Leinster, does not require any continuity assumption.

Monotonically equivalent entropies and solution of additivity equation

On an entropic analogue of additive energy

Comment on "Stronger subadditivity of entropy" by Lieb and Seiringer <a class="link-https" data-arxiv-id="math-ph/0412009" href="https://arxiv.org/abs/math-ph/0412009">math-ph/0412009</a>

Generalized Entropies under Different Probability Normalization Conditions

New Additivity Properties of the Relative Entropy of Entanglement and Its Generalizations

Diminishing functionals for nonclassical entropy solutions selected by kinetic relations

Universal Gorban's Entropies: Geometric Case Study

N ov 2 01 5 Novel dissipative properties for the master equation

Three classes of nonextensive entropies characterized by Shannon additivity and pseudoadditivity

Conditional Entropy Formula with Respect to Monotonic Partitions

Tsallis entropy and generalized Shannon additivity

A Characterization of Entropy as a Universal Monoidal Natural Transformation

Entropies for complex systems: generalized-generalized entropies

Novel Dissipative Properties of the Master Equation

Approximate Discrete Entropy Monotonicity for Log-Concave Sums

Monotonicity of the von Neumann entropy expressed as a function of Rényi entropies

A family of monotone quantum relative entropies

Yet another additivity conjecture

Equivalence of nonadditive entropies and nonadditive energies in long range interacting systems under macroscopic equilibrium

Generalized Shannon-Khinchin Axioms and Uniqueness Theorem for Pseudo-additive Entropies