Lecture
Optimality of Convergence Rates: Accelerated/Stochastic Gradient Descent
Related lectures (88)
Neural Networks: Training and Optimization
Explores the training and optimization of neural networks, addressing challenges like non-convex loss functions and local minima.
Adversarial Machine Learning: Fundamentals and Techniques
Explores adversarial machine learning, covering the generation of adversarial examples, robustness challenges, and techniques like Fast Gradient Sign Method.
SGD and Mean Field Analysis
Explores Stochastic Gradient Descent and Mean Field Analysis in two-layer neural networks, emphasizing their iterative processes and mathematical foundations.
Primal-dual Optimization: Fundamentals
Explores primal-dual optimization, minimax problems, and gradient descent-ascent methods for optimization algorithms.
Structures in Non-Convex Optimization
Covers non-convex optimization, deep learning training problems, stochastic gradient descent, adaptive methods, and neural network architectures.
Multilayer Neural Networks: Deep Learning
Covers the fundamentals of multilayer neural networks and deep learning.
From Stochastic Gradient Descent to Non-Smooth Optimization
Covers stochastic optimization, sparsity, and non-smooth minimization via subgradient descent.
Logistic Regression: Vegetation Prediction
Explores logistic regression for predicting vegetation proportions in the Amazon region through remote sensing data analysis.
Primal-dual Optimization III: Lagrangian Gradient Methods
Explores primal-dual optimization methods, emphasizing Lagrangian gradient techniques and their applications in data optimization.
Optimization Methods: Theory Discussion
Explores optimization methods, including unconstrained problems, linear programming, and heuristic approaches.