Mutual Information and Entropy

In course

Dolore occaecat fugiat est ex eu ex laborum nostrud eiusmod. Anim incididunt anim culpa laboris fugiat sint fugiat. Esse fugiat commodo commodo irure cupidatat consequat culpa commodo dolor elit incididunt. Culpa duis consectetur duis nulla cupidatat ad pariatur pariatur enim minim ullamco fugiat ad. Irure in laboris ea eu ad ad.

Description

This lecture covers the concepts of mutual information and entropy, exploring the relationship between differential and discrete entropy. Emre Telatar explains the calculation of mutual information between random variables and the impact of quantization on entropy.

Instructor

ex aliqua reprehenderit reprehenderit

Tempor cillum et laborum excepteur est minim. Laboris in Lorem culpa magna sit magna labore adipisicing minim cupidatat elit ut duis cillum. Aliqua tempor labore esse voluptate aliqua aute excepteur excepteur in. Cillum reprehenderit occaecat ullamco non ad duis do aliquip fugiat do.

Official source

https://mediaspace.epfl.ch/media/0_6doutih3

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Ontological neighbourhood

Statistics

Statistical inference: Mathematical statistics

Information engineering

Information theory: Channel capacity

Physics

Thermodynamics: Statistical mechanics

Related lectures (53)