Lectures related to Optimizing Adaptive Gradient Methods

Coordinate Descent: Optimization Strategies

Explores coordinate descent optimization strategies, emphasizing simplicity in optimization through one-coordinate updates and discussing the implications of different approaches.

Gradient Descent: Optimization Techniques

Explores gradient descent, loss functions, and optimization techniques in neural network training.

Faster and Projected Gradient Descent: Optimization Techniques

Discusses advanced optimization techniques, focusing on faster and projected gradient descent methods in machine learning.

Optimization in Machine Learning: Gradient Descent

Covers optimization in machine learning, focusing on gradient descent for linear and logistic regression, stochastic gradient descent, and practical considerations.