Are you an EPFL student looking for a semester project?
Work with us on data science and visualisation projects, and deploy your project as an app on top of Graph Search.
This lecture covers the concepts of first passage times, strong Markov property, and recurrence/transience in Markov chains. It explains the hitting time of states, the behavior of chains conditional on certain events, and the classification of states as recurrent or transient based on return probabilities.