Formal Languages: ConceptsCovers the basics of formal languages, including alphabets, words, and languages, as well as operations like concatenation and reversal.
Source Coding TheoremExplores the Source Coding Theorem, entropy, Huffman coding, and conditioning's impact on entropy reduction.
Formal Languages: ConceptsCovers the fundamental concepts of formal languages, including alphabets, words, languages, and word equality.
Writing SystemsExplores the evolution of writing systems, the impact of new technologies, and the existence of various scripts.
Data Compression: Entropy DefinitionExplores data compression through entropy definition, types, and practical examples, illustrating its role in efficient information storage and transmission.
Information Measures: Part 1Covers information measures, tail bounds, subgaussions, subpossion, independence proof, and conditional expectation.