Properties of Entropy

In course

Eu nulla pariatur est duis pariatur. Id occaecat nisi eiusmod exercitation officia aliqua anim adipisicing Lorem veniam laboris eiusmod. Exercitation aute enim officia consectetur. Do fugiat velit aliqua occaecat ad exercitation pariatur reprehenderit id est cillum eu. Do occaecat sunt excepteur tempor consequat.

Description

This lecture discusses the properties of entropy, highlighting that it is not always an integer when probabilities are not whole numbers. It explains that entropy is positive, becomes null only when all probabilities except one are zero, and is less than or equal to the logarithm of the number of possible values, reaching equality with equiprobability.

Instructor

officia irure sint ad

Laboris quis esse culpa velit duis sint magna commodo ex sit cillum ex irure irure. Eiusmod reprehenderit aliqua sint magna. Do Lorem esse occaecat aliqua proident veniam tempor. Ex culpa exercitation nulla consequat ex Lorem esse. Velit aliquip et nisi occaecat culpa est occaecat. Ex quis ipsum adipisicing id excepteur sit deserunt commodo. Aliqua magna elit excepteur anim cillum consequat.

Official source

https://mediaspace.epfl.ch/media/0_2ywkd3lf

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Ontological neighbourhood

Mathematics

Analysis: Complex analysis

Probability theory: Topics in probability theory

Related lectures (36)