Explores Markov chains, Metropolis-Hastings, and simulation for optimization purposes, highlighting the significance of ergodicity in efficient variable simulation.
Covers Markov processes, transition densities, and distribution conditional on information, discussing classification of states and stationary distributions.