Lecture

Entropy and Mutual Information

Description

This lecture, given by the instructor on September 27, 2020, focuses on entropy and mutual information. It covers topics such as the maximum entropy distribution, conditional entropy, joint entropy, and the concept of mutual information. The lecture delves into the relationship between uncertainty, information, and probability distributions, providing insights into how to quantify and measure information in data science.

Instructors (2)

cillum fugiat voluptate fugiat

Magna excepteur sint exercitation labore ut exercitation fugiat aliqua dolor aliqua ullamco. Cillum occaecat anim ipsum consectetur cillum voluptate fugiat laboris anim magna reprehenderit sint. Enim labore adipisicing aute id fugiat ex et ullamco irure ea et pariatur ut dolore. Laborum adipisicing sit dolore mollit do et aute.

laboris dolor adipisicing

Ullamco non enim veniam labore ullamco. Mollit sit officia adipisicing eiusmod aliqua amet sint esse pariatur enim velit tempor eiusmod exercitation. Quis dolor dolor labore nostrud velit dolor mollit commodo incididunt. Ut ea proident ullamco minim qui. Aliquip non exercitation ad fugiat sint ipsum exercitation cillum laborum laborum duis minim. Sint nostrud quis amet in voluptate officia aliquip ex sunt exercitation enim sint do Lorem.

Official source

https://mediaspace.epfl.ch/media/0_0xr0pcs1

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Ontological neighbourhood

Statistics

Statistical inference: Mathematical statistics

Information engineering

Information theory: Channel capacity

Related lectures (36)

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.