Are you an EPFL student looking for a semester project?
Work with us on data science and visualisation projects, and deploy your project as an app on top of Graph Search.
This lecture covers Markov chains with absorbing classes, focusing on exercises related to applied probability and stochastic processes. The slides present exercises on finding open and closed classes in a transition probability matrix, calculating expected values, and analyzing the behavior of a frog hopping on lily pads. The instructor discusses the graphical representation of Markov chains, cubing transition matrices, and solving the gambler's ruin problem. Through practical examples, students learn to determine probabilities of staying in a state, reaching a specific state, and the average time to reach a destination.