Publications associées à A Continuized View on Nesterov Acceleration

Chattez avec Graph Search

Posez n’importe quelle question sur les cours, conférences, exercices, recherches, actualités, etc. de l’EPFL ou essayez les exemples de questions ci-dessous.

AVERTISSEMENT : Le chatbot Graph n'est pas programmé pour fournir des réponses explicites ou catégoriques à vos questions. Il transforme plutôt vos questions en demandes API qui sont distribuées aux différents services informatiques officiellement administrés par l'EPFL. Son but est uniquement de collecter et de recommander des références pertinentes à des contenus que vous pouvez explorer pour vous aider à répondre à vos questions.

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks

Nicolas Henri Bernard Flammarion, Hristo Georgiev Papazov, Scott William Pesme

In this work, we investigate the effect of momentum on the optimisation trajectory of gradient descent. We leverage a continuous-time approach in the analysis of momentum gradient descent with step size

\gamma

and momentum parameter

\beta

that allows u ...

2024

A Continuized View on Nesterov Acceleration

Graph Chatbot

Chattez avec Graph Search

From low-rank retractions to dynamical low-rank approximation and back

Learning the intrinsic dynamics of spatio-temporal processes through Latent Dynamics Networks

SPACE-TIME REDUCED BASIS METHODS FOR PARAMETRIZED UNSTEADY STOKES EQUATIONS

Generalization of Scaled Deep ResNets in the Mean-Field Regime

Anomalous dissipation and other non-smooth phenomena in fluids

Shape Holomorphy of Boundary Integral Operators on Multiple Open Arcs

High-order geometric integrators for the variational Gaussian wavepacket dynamics and application to vibronic spectra at finite temperature

FENNECS: a novel particle-in-cell code for simulating the formation of magnetized non-neutral plasmas trapped by electrodes of complex geometries

Model reduction of coupled systems based on non-intrusive approximations of the boundary response maps

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks

From low-rank retractions to dynamical low-rank approximation and back

Learning the intrinsic dynamics of spatio-temporal processes through Latent Dynamics Networks

SPACE-TIME REDUCED BASIS METHODS FOR PARAMETRIZED UNSTEADY STOKES EQUATIONS

Generalization of Scaled Deep ResNets in the Mean-Field Regime

Anomalous dissipation and other non-smooth phenomena in fluids

High-order geometric integrators for the variational Gaussian wavepacket dynamics and application to vibronic spectra at finite temperature

Shape Holomorphy of Boundary Integral Operators on Multiple Open Arcs

FENNECS: a novel particle-in-cell code for simulating the formation of magnetized non-neutral plasmas trapped by electrodes of complex geometries

Model reduction of coupled systems based on non-intrusive approximations of the boundary response maps

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks