Lecture
This lecture covers infinite-horizon problems in Applied Probability and Stochastic Processes, focusing on the formulation and algorithm complexity. It discusses a two-state discounted Markov decision process and explores the policy iteration algorithm to find an optimal policy.