Topic summary
Shannon entropy
Extracted from the Wikipedia article Entropy (information theory).
Differential entropy
which is, as said before, referred to as the differential entropy. This means that the differential entropy is not a limit of the Shannon entropy for n → ∞. Rather, it differs from the limit of the Shannon entropy by an infinite offset (see also the article on information dimension).