Person

Hristo Georgiev Papazov

Official source

https://people.epfl.ch/hristo.papazov

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks

Nicolas Henri Bernard Flammarion, Hristo Georgiev Papazov, Scott William Pesme

In this work, we investigate the effect of momentum on the optimisation trajectory of gradient descent. We leverage a continuous-time approach in the analysis of momentum gradient descent with step size

\gamma

and momentum parameter

\beta

that allows u ...

2024

Hristo Georgiev Papazov

Graph Chatbot

Learning Algorithms in the Limit

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks

Learning Algorithms in the Limit

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks