Lectures related to Markov Chains: State Classification

Covers the definitions and state probabilities of discrete-time Markov chains.

Covers Markov chains, Metropolis algorithm, Glauber dynamics, and heat bath dynamics.

Continuous-Time Markov Chains: Definitions and State Probabilities

Covers the definitions and state probabilities of continuous-time Markov chains.

Covers the classification of states in Markov chains.

Covers atomic theory, Schrödinger equation, quantum numbers, electron configurations, and periodic properties of elements.

Irreducible periodic case

Explores convergence results for periodic case reversibility in Markov chains, covering irreducible chains, positive recurrence, reversible processes, and random walks on finite graphs.

Stochastic Models: Absorbing Markov Chains Examples

Covers examples of absorbing Markov chains in discrete time.

Markov Chains: Theory and Applications

Covers the theory and applications of Markov chains in modeling random phenomena and decision-making under uncertainty.