1 article
Shannon entropy counts the yes/no questions you need to pin down an unknown. That count turns out to be the exact limit of lossless compression, and the reason error correction has a price.