Lecture

Properties of Entropy

Description

This lecture discusses the properties of entropy, highlighting that it is not always an integer when probabilities are not whole numbers. It explains that entropy is positive, becomes null only when all probabilities except one are zero, and is less than or equal to the logarithm of the number of possible values, reaching equality with equiprobability.

Instructor

est adipisicing aliquip pariatur

Et nostrud laborum adipisicing nulla laborum labore. Cillum consectetur Lorem exercitation duis minim irure. Adipisicing magna fugiat reprehenderit ea minim veniam proident nostrud. Aute mollit est laborum magna eu sint duis exercitation enim veniam adipisicing. Enim exercitation aute labore sint fugiat. Occaecat ut exercitation exercitation incididunt sunt consectetur do proident reprehenderit ipsum do ea aliqua proident. Commodo eu laboris consectetur do voluptate consequat ipsum.

Official source

https://mediaspace.epfl.ch/media/0_2ywkd3lf

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Ontological neighbourhood

Mathematics

Analysis: Complex analysis

Probability theory: Topics in probability theory

Related lectures (35)

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.