Covers Markov processes, transition densities, and distribution conditional on information, discussing classification of states and stationary distributions.
Explores Markov chains, Metropolis-Hastings, and simulation for optimization purposes, highlighting the significance of ergodicity in efficient variable simulation.
