Cross Entropy - Wikipedia - p. 82 ![rw-book-cover](https://readwise-assets.s3.amazonaws.com/static/images/article2.74d541386bbf.png) ## Metadata - Author: [[p. 82]] - Full Title: Cross Entropy - Wikipedia - Category: #articles - URL: https://en.wikipedia.org/wiki/Cross_entropy ## Highlights - In information theory, the cross-entropy between two probability distributions {\displaystyle p} and {\displaystyle q} over the same underlying set of events measures the average number of bits needed to identify an event drawn from the set if a coding scheme used for the set is optimized for an estimated probability distribution {\displaystyle q}, rather than the true distribution {\displaystyle p}.