Lecture
Entropy and Information Theory
Description
This lecture covers the concept of entropy in information theory, explaining how it measures surprise and uncertainty in random variables. It delves into discrete entropy, relative entropy, and Jensen's inequality, showcasing their applications in coding theory and data compression.
Official source
About this result
This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.