Covers Markov processes, transition densities, and distribution conditional on information, discussing classification of states and stationary distributions.
Explores convergence results for periodic case reversibility in Markov chains, covering irreducible chains, positive recurrence, reversible processes, and random walks on finite graphs.
Covers the theory of Markov Chain Monte Carlo (MCMC) sampling and discusses convergence conditions, transition matrix choice, and target distribution evolution.
Delves into Markov chains by analyzing a scenario with two fleas moving in opposite directions, exploring transition matrices and probabilities over time.
