# Metadata Source URL:: https://towardsdatascience.com/the-intuition-behind-shannons-entropy-e74820fe9800 Topics:: #information --- # The intuition behind Shannon’s Entropy [WARNING: TOO EASY!] ## Highlights > [!quote]+ Updated on 311022_101313 > > Shannon thought that the information content of anything can be measured in bits. To write a number N in bits, we need to take a log base 2 of N. > [!quote]+ Updated on 311022_101335 > > Note that thermodynamic “entropy” and the “entropy” in information theory both capture increasing randomness.