Markov Chains: Homogeneous Processes and Stationary Distributions

Limiting Distribution and Ergodic Theorem

Explores limiting distribution in Markov chains and the implications of ergodicity and aperiodicity on stationary distributions.

Probability & Stochastic Processes

Covers applied probability, stochastic processes, Markov chains, rejection sampling, and Bayesian inference methods.

Coupling of Markov Chains: Ergodic Theorem

Explores the coupling of Markov chains and the proof of the ergodic theorem, emphasizing distribution convergence and chain properties.

Markov Chains: Transition Probabilities

Explores Markov chains, transition matrices, distribution, and random walks.

Theory of MCMC

Covers the theory of Markov Chain Monte Carlo (MCMC) sampling and discusses convergence conditions, transition matrix choice, and target distribution evolution.