Lecture

Properties of Entropy

Description

This lecture discusses the properties of entropy, highlighting that it is not always an integer when probabilities are not whole numbers. It explains that entropy is positive, becomes null only when all probabilities except one are zero, and is less than or equal to the logarithm of the number of possible values, reaching equality with equiprobability.

Instructor

sint reprehenderit enim

Voluptate esse culpa sint sint cupidatat eu occaecat dolore fugiat non sit mollit. Minim ullamco amet culpa qui excepteur eu do culpa tempor. Deserunt mollit ut Lorem irure duis magna cupidatat dolore excepteur nostrud est ad. Irure esse do magna Lorem dolore laborum. Ad et enim id eiusmod mollit eiusmod dolor. Amet amet tempor nisi velit amet irure in sint ad eiusmod. Elit voluptate dolor nisi commodo voluptate reprehenderit exercitation.

Official source

https://mediaspace.epfl.ch/media/0_2ywkd3lf

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Ontological neighbourhood

Mathematics

Analysis: Complex analysis

Probability theory: Topics in probability theory

Related lectures (35)

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.