Controlled Stochastic ProcessesExplores controlled stochastic processes, focusing on analysis, behavior, and optimization, using dynamic programming to solve real-world problems.
The Marriage ProblemExplores the marriage problem, modeling the process as a controlled stochastic process with dynamic programming algorithms to find the optimal policy for accepting bachelors.
Approximation AlgorithmsCovers approximation algorithms for optimization problems, LP relaxation, and randomized rounding techniques.
Optimisation in Energy SystemsExplores optimization in energy system modeling, covering decision variables, objective functions, and different strategies with their pros and cons.
Multi-arm BanditsDiscusses algorithms for balancing exploration and exploitation in decision-making processes.
Coin Rendering: Part 1Covers coin rendering and the limitations of the greedy algorithm in finding optimal solutions.
Detection & EstimationCovers binary classification, hypothesis testing, likelihood ratio tests, and decision rules.