Markov Chain GamesExplores Markov chain games, hitting probabilities, and expected hitting times in a target set.
Probability and StatisticsIntroduces probability, statistics, distributions, inference, likelihood, and combinatorics for studying random events and network modeling.
Sunny Rainy Source: Markov ModelExplores a first-order Markov model using a sunny-rainy source example, demonstrating how past events influence future outcomes.
Probability InequalitiesExplores probability inequalities, convergence types, and moment generating functions for distribution approximation.
