Are you an EPFL student looking for a semester project?
Work with us on data science and visualisation projects, and deploy your project as an app on top of Graph Search.
This lecture covers the concept of entropy in information theory, explaining how it measures surprise and uncertainty in random variables. It delves into discrete entropy, relative entropy, and Jensen's inequality, showcasing their applications in coding theory and data compression.