Concept
Bellman equation
Related lectures (88)
Optimal Detection in Spinodal Systems
Explores optimal detection in spinodal systems, discussing stability analysis and phase transitions.
Asset Selling Problem
Explores the Asset Selling Problem to maximize long-term reward without a deadline.
Dynamic Programming: Portfolio Optimization
Explores dynamic programming for optimizing portfolio choices and asset pricing theory.
Newton's method on Riemannian manifolds
Covers Newton's method on Riemannian manifolds, focusing on second-order optimality conditions and quadratic convergence.
Riemannian gradient descent
Explores Riemannian gradient descent, covering Taylor expansions, optimality conditions, algorithm templates, line search, and critical points.
Optimal Transport: Theory and Applications
Covers the theory and applications of optimal transport, focusing on infimal convolution and Kantorovich potentials.
Controlled Stochastic Processes
Explores controlled stochastic processes, focusing on analysis, behavior, and optimization, using dynamic programming to solve real-world problems.
Reinforcement Learning: Q-Learning
Introduces Q-Learning, Deep Q-Learning, REINFORCE algorithm, and Monte-Carlo Tree Search in reinforcement learning, culminating in AlphaGo Zero.
Linear Quadratic (LQ) Optimal Control: Proof of Theorem
Covers the proof of the recursive formula for the optimal gains in LQ control over a finite horizon.
Optimal Control: Convergence and Conditions
Covers the convergence and conditions for optimal control.