The Intuition Behind Shannon’s Entropy - towardsdatascience.com  ## Metadata - Author: **towardsdatascience.com** - Full Title: The Intuition Behind Shannon’s Entropy - Category: #articles - Tags: #information - URL: https://towardsdatascience.com/the-intuition-behind-shannons-entropy-e74820fe9800 ## Highlights - Shannon thought that the information content of anything can be measured in bits. To write a number N in bits, we need to take a log base 2 of N. - Note that thermodynamic “entropy” and the “entropy” in information theory both capture increasing randomness.