Quantify uncertainty and communication with entropy, mutual information, channel capacity, compression, and divergence measures.
