Understanding Shannon's Entropy metric for Information

Sriram Vajapeyam
DOI: https://doi.org/10.48550/arXiv.1405.2061
2014-03-24
Information Theory
Abstract:Shannon's metric of "Entropy" of information is a foundational concept of information theory. This article is a primer for novices that presents an intuitive way of understanding, remembering, and/or reconstructing Shannon's Entropy metric for information.
What problem does this paper attempt to address?