Lecture

Entropy and Mutual Information

Description

This lecture, given by the instructor on September 27, 2020, focuses on entropy and mutual information. It covers topics such as the maximum entropy distribution, conditional entropy, joint entropy, and the concept of mutual information. The lecture delves into the relationship between uncertainty, information, and probability distributions, providing insights into how to quantify and measure information in data science.

Instructors (2)

reprehenderit cupidatat officia occaecat

Enim laboris irure voluptate duis nisi cupidatat labore anim deserunt. Lorem sunt Lorem labore culpa labore pariatur velit. Ut veniam pariatur nisi aute ea.

anim irure

Sit ex cupidatat consequat reprehenderit elit eiusmod occaecat cillum consequat exercitation adipisicing eu velit. Velit commodo cupidatat pariatur non id voluptate eiusmod sit eiusmod irure fugiat. Adipisicing ad eiusmod duis laboris voluptate duis est et non exercitation officia. Fugiat incididunt Lorem et minim nisi nulla laboris adipisicing cupidatat mollit velit elit cupidatat ullamco.

Official source

https://mediaspace.epfl.ch/media/0_0xr0pcs1

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Ontological neighbourhood

Statistics

Statistical inference: Mathematical statistics

Information engineering

Information theory: Channel capacity

Related lectures (36)

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.