Answers are grounded in this paper and cite their sources.
Shannon's metric of "Entropy" of information is a foundational concept of information theory. This article is a primer for novices that presents an intuitive way of understanding, remembering, and/or reconstructing Shannon's Entropy metric for information.
No takes yet. Share an insight, caveat, or question.
Sriram Vajapeyam (2014) studied this question.