Abstract:We show that the essential properties of entropy (monotonicity, additivity and subadditivity) are consequences of entropy being a monoidal natural transformation from the under category functor $-/\mathsf{LProb}_{\rho}$ (where $\mathsf{LProb}_{\rho}$ is category of $\rho$-th-power-summable probability distributions, $0<\rho<1$) to $\Delta_{\mathbb{R}}$. Moreover, the Shannon entropy can be characterized as the universal monoidal natural transformation from $-/\mathsf{LProb}_{\rho}$ to the category of integrally closed partially ordered abelian groups (a reflective subcategory of the lax-slice 2-category over $\mathsf{MonCat}_{\ell}$ in the 2-category of monoidal categories), providing a succinct characterization of Shannon entropy as a reflection arrow. We can likewise define entropy for every monoidal category with a monoidal structure on its under categories (e.g. the category of finite abelian groups, the category of finite inhabited sets, the category of finite dimensional vector spaces, and the augmented simplex category) via the reflection arrow. This implies that all these entropies over different categories are components of a single natural transformation (the unit of the idempotent monad), allowing us to connect these entropies in a natural manner. We also provide a universal characterization of the conditional Shannon entropy based on the chain rule which, unlike the characterization of information loss by Baez, Fritz and Leinster, does not require any continuity assumption.

Matroidal Entropy Functions: Constructions, Characterizations and Representations

Characteristic of partition-circuit matroid through approximation number

On entropic and almost multilinear representability of matroids

h-Vectors of matroids and logarithmic concavity

A Novel Distance Matric: Generalized Relative Entropy

Enumerating Matroids and Linear Spaces

Title On uniform matroidal networks

On uniform matroidal networks

Entanglement Monogamy via Multivariate Trace Inequalities

A Characterization of Entropy as a Universal Monoidal Natural Transformation

Matroids and Quantum Secret Sharing Schemes

Uniform density in matroids, matrices and graphs

Entropy Functions on Two-Dimensional Faces of Polymatroidal Region of Degree Four

Pseudo-entropy for descendant operators in two-dimensional conformal field theories

A Note on Mathai's Entropy Measure

Rigidity matroids and linear algebraic matroids with applications to matrix completion and tensor codes

Holographic entropy inequalities and multipartite entanglement

On the Correlation Gap of Matroids

Entropy Formula for Endomorphisms: Relations Between Entropy, Exponents and Dimension

Conditional Entropy Formula with Respect to Monotonic Partitions