Markov Chains: Introduction and Properties

This lecture introduces Markov chains, discussing elementary properties such as the transition matrix, communicating classes, and stochastic processes. It covers the definition of a stochastic process, probability vectors, and transition matrices. The lecture also explores the Markov property, equivalence theorems, and consequences of Markov chains.