Explores communicating classes in Markov chains, distinguishing between transient and recurrent classes, and delves into the properties of these classes.
Explores the concept of stationary distribution in Markov chains, discussing its properties and implications, as well as the conditions for positive-recurrence.