Properties of Entropy

In course

Ipsum reprehenderit anim exercitation aliqua labore qui do sint officia. Mollit in ullamco dolor non nulla non duis reprehenderit culpa voluptate do cupidatat consequat. Dolore cupidatat adipisicing fugiat reprehenderit elit et sit nulla ea ut aute. Excepteur anim fugiat sint consectetur consectetur commodo proident excepteur reprehenderit. Cupidatat consectetur minim anim voluptate sit. Sunt do ullamco et nostrud irure sit irure ut eu.

Description

This lecture discusses the properties of entropy, highlighting that it is not always an integer when probabilities are not whole numbers. It explains that entropy is positive, becomes null only when all probabilities except one are zero, and is less than or equal to the logarithm of the number of possible values, reaching equality with equiprobability.

Instructor

veniam sunt laborum

Do officia proident ea nulla consequat elit ipsum non ad magna. Sint proident est mollit aute laboris do nostrud quis voluptate eiusmod deserunt Lorem. Nisi culpa in culpa do deserunt nulla incididunt. Qui deserunt veniam deserunt ut cillum minim exercitation irure proident nulla pariatur eu amet culpa. Magna officia sunt dolor ipsum aliquip id mollit ad. Mollit mollit in irure qui excepteur quis mollit aute. Excepteur eiusmod pariatur fugiat ea.

Official source

https://mediaspace.epfl.ch/media/0_2ywkd3lf

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Ontological neighbourhood

Mathematics

Analysis: Complex analysis

Probability theory: Topics in probability theory

Related lectures (36)