Abstract:We show that the essential properties of entropy (monotonicity, additivity and subadditivity) are consequences of entropy being a monoidal natural transformation from the under category functor $-/\mathsf{LProb}_{\rho}$ (where $\mathsf{LProb}_{\rho}$ is category of $\rho$-th-power-summable probability distributions, $0<\rho<1$) to $\Delta_{\mathbb{R}}$. Moreover, the Shannon entropy can be characterized as the universal monoidal natural transformation from $-/\mathsf{LProb}_{\rho}$ to the category of integrally closed partially ordered abelian groups (a reflective subcategory of the lax-slice 2-category over $\mathsf{MonCat}_{\ell}$ in the 2-category of monoidal categories), providing a succinct characterization of Shannon entropy as a reflection arrow. We can likewise define entropy for every monoidal category with a monoidal structure on its under categories (e.g. the category of finite abelian groups, the category of finite inhabited sets, the category of finite dimensional vector spaces, and the augmented simplex category) via the reflection arrow. This implies that all these entropies over different categories are components of a single natural transformation (the unit of the idempotent monad), allowing us to connect these entropies in a natural manner. We also provide a universal characterization of the conditional Shannon entropy based on the chain rule which, unlike the characterization of information loss by Baez, Fritz and Leinster, does not require any continuity assumption.

Hereditary subshifts whose measure of maximal entropy has no Gibbs property

Invariant measures for $\mathscr{B}$-free systems revisited

Measures of maximal entropy of bounded density shifts

Invariant measures for -free systems revisited

Basic thermodynamical formalism for sandwich subshifts

Minimal zero entropy subshifts can be unrestricted along any sparse set

Subgraphs of random graphs in hereditary families

Strictly ergodic Toeplitz $\mathbb{Z}^d$-subshifts with arbitrary entropy

Phase transition in one-dimensional subshifts

A Characterization of Entropy as a Universal Monoidal Natural Transformation

Finding lower bounds on the growth and entropy of subshifts over countable groups

Strong ergodicity phenomena for Bernoulli shifts of bounded algebraic dimension

On the independence of shifts defined on $\mathbb{N}^d$ and trees

A note on maximal conditional entropy on Lebesgue spaces

Entropy, Ultralimits and the Poisson boundary

Maximal Entropy Measures for Non-Accessible Topological Skew Products

Transcendental properties of entropy-constrained sets: Part II

Generic extensions of ergodic actions

Quasi-similarity, entropy and disjointness of ergodic systems

Typical sofic entropy and local limits for free group shift systems