Conditional Entropy: Review and Definitions

This lecture by the instructor covers the concept of conditional entropy, focusing on the relationship between weather conditions in Lausanne and Zurich. The slides present examples of conditional entropy calculations and discuss the main definitions and results related to this topic. The lecture also delves into the conditional entropy of a function of a random variable, providing proofs and explanations for better understanding. Additionally, the chain rule for entropy is explained, demonstrating how to calculate joint entropy based on the entropy of individual variables. Throughout the lecture, various examples and references by the instructor, Michael Gastpar, are provided to illustrate the concepts discussed.