Explores the concept of entropy expressed in bits and its relation to probability distributions, focusing on information gain and loss in various scenarios.
Explores maximal correlation in information theory, mutual information properties, Renyi's measures, and mathematical foundations of information theory.
