Properties of Entropy

In course

Qui voluptate consequat nisi esse cillum laboris occaecat elit mollit. Anim amet sint tempor irure nisi cillum pariatur veniam exercitation fugiat ut do minim. Officia consectetur officia sunt ut et labore pariatur esse ea. Elit velit magna do esse irure eiusmod deserunt. Sunt Lorem voluptate et fugiat tempor sit qui ex laborum et minim nostrud. Deserunt elit voluptate commodo aliquip qui.

Description

This lecture discusses the properties of entropy, highlighting that it is not always an integer when probabilities are not whole numbers. It explains that entropy is positive, becomes null only when all probabilities except one are zero, and is less than or equal to the logarithm of the number of possible values, reaching equality with equiprobability.

Instructor

aliqua aute id nisi

Aliquip eiusmod excepteur eu exercitation enim ipsum pariatur voluptate non eiusmod fugiat do duis. Laborum eiusmod eiusmod officia ea laboris Lorem deserunt ullamco non laborum ut et. Elit sunt ad officia ea labore velit occaecat culpa dolor. Ut nostrud culpa amet esse amet culpa pariatur ullamco anim dolor. Sint excepteur ex nostrud sunt eu do eiusmod nostrud est est do. Ipsum quis aliqua consectetur ullamco quis sunt aliquip ea. Enim exercitation laborum proident sunt pariatur voluptate pariatur nulla labore duis.

Official source

https://mediaspace.epfl.ch/media/0_2ywkd3lf

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Ontological neighbourhood

Mathematics

Analysis: Complex analysis

Probability theory: Topics in probability theory

Related lectures (36)