Lectures related to Source Coding: Compression

Covers the basics of information theory, focusing on Shannon's setting and channel transmission.

Covers Shannon-Fano codes, a method for uniquely decodable and prefix-free coding, and discusses their optimality compared to the entropy.

Explores the Shannon-Fano algorithm for efficient data compression and its applications in lossless and lossy compression techniques.

Explores entropy's role in coding strategies and search algorithms, showcasing its impact on information compression and data efficiency.

Explores variational formulation for measuring information content and divergence between probability distributions.

Explores entropy theory, compression without loss, and the efficiency of the Shannon-Fano algorithm in data compression.