Are you an EPFL student looking for a semester project?
Work with us on data science and visualisation projects, and deploy your project as an app on top of Graph Search.
This lecture covers the concept of entropy in information theory, starting with examples of guessing letters in sequences and calculating entropy. It explores the origins of entropy in physics, the interpretation of entropy in messages, and properties such as concavity and total order. The lecture concludes with inequalities related to entropy calculations.