Lecture
This lecture covers the basics of Markov chains, including the main concepts like state distribution, ergodic chains, and importance sampling. It also delves into algorithmic applications and sampling methods such as Monte Carlo and rejection sampling.