Connect entropy, cross-entropy, Kullback–Leibler divergence, and mutual information to classification, representation learning, and generative models.
