Markov Chains: Properties and Approximations

This lecture covers the properties of Markov chains, including irreducibility, aperiodicity, and recurrence. It also discusses the approximation of Stirling's formula and the concept of hitting time. The lecture delves into the transition probabilities, recurrent states, and absorbing states in Markov chains.