Abstract:We show that the essential properties of entropy (monotonicity, additivity and subadditivity) are consequences of entropy being a monoidal natural transformation from the under category functor $-/\mathsf{LProb}_{\rho}$ (where $\mathsf{LProb}_{\rho}$ is category of $\rho$-th-power-summable probability distributions, $0<\rho<1$) to $\Delta_{\mathbb{R}}$. Moreover, the Shannon entropy can be characterized as the universal monoidal natural transformation from $-/\mathsf{LProb}_{\rho}$ to the category of integrally closed partially ordered abelian groups (a reflective subcategory of the lax-slice 2-category over $\mathsf{MonCat}_{\ell}$ in the 2-category of monoidal categories), providing a succinct characterization of Shannon entropy as a reflection arrow. We can likewise define entropy for every monoidal category with a monoidal structure on its under categories (e.g. the category of finite abelian groups, the category of finite inhabited sets, the category of finite dimensional vector spaces, and the augmented simplex category) via the reflection arrow. This implies that all these entropies over different categories are components of a single natural transformation (the unit of the idempotent monad), allowing us to connect these entropies in a natural manner. We also provide a universal characterization of the conditional Shannon entropy based on the chain rule which, unlike the characterization of information loss by Baez, Fritz and Leinster, does not require any continuity assumption.

Generalization of Shannon-Khinchin Axioms to Nonextensive Systems and the Uniqueness Theorem

Axioms and uniqueness theorem for Tsallis entropy

Generalized Shannon-Khinchin Axioms and Uniqueness Theorem for Pseudo-additive Entropies

Tsallis entropy and generalized Shannon additivity

Three classes of nonextensive entropies characterized by Shannon additivity and pseudoadditivity

Qualms concerning Tsallis's condition of pseudo-additivity as a definition of non-extensivity

A Characterization of Entropy as a Universal Monoidal Natural Transformation

Entropy Maximization with Linear Constraints: The Uniqueness of the Shannon Entropy

Yet another additivity conjecture

Multi-Additivity in Kaniadakis Entropy

A generalization of Costa's Entropy Power Inequality

Nonsymmetric entropy I: basic concepts and results

A note on Shannon entropy

Comment on "Stronger subadditivity of entropy" by Lieb and Seiringer <a class="link-https" data-arxiv-id="math-ph/0412009" href="https://arxiv.org/abs/math-ph/0412009">math-ph/0412009</a>

A two-parameter entropy and its fundamental properties

An Intrinsic Characterization of Shannon's and Rényi's Entropy

Signed Rényi Entropy and Quantum Second Laws

Entropy, virtual Abelianness and Shannon orbit equivalence

Equivalence of additive-combinatorial linear inequalities for Shannon entropy and differential entropy

Monotonically equivalent entropies and solution of additivity equation

On an entropic analogue of additive energy