Publications associées à NUQSGD: Provably Communication-efficient Data-parallel SGD via Nonuniform Quantization

Chattez avec Graph Search

Posez n’importe quelle question sur les cours, conférences, exercices, recherches, actualités, etc. de l’EPFL ou essayez les exemples de questions ci-dessous.

AVERTISSEMENT : Le chatbot Graph n'est pas programmé pour fournir des réponses explicites ou catégoriques à vos questions. Il transforme plutôt vos questions en demandes API qui sont distribuées aux différents services informatiques officiellement administrés par l'EPFL. Son but est uniquement de collecter et de recommander des références pertinentes à des contenus que vous pouvez explorer pour vous aider à répondre à vos questions.

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks

Nicolas Henri Bernard Flammarion, Hristo Georgiev Papazov, Scott William Pesme

In this work, we investigate the effect of momentum on the optimisation trajectory of gradient descent. We leverage a continuous-time approach in the analysis of momentum gradient descent with step size

\gamma

and momentum parameter

\beta

that allows u ...

2024

NUQSGD: Provably Communication-efficient Data-parallel SGD via Nonuniform Quantization

Graph Chatbot

Chattez avec Graph Search

Towards improving full-length ribosome density prediction by bridging sequence and graph-based representations

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks

On the Generalization of Stochastic Gradient Descent with Momentum

Task-driven neural network models predict neural dynamics of proprioception: Neural network model weights

Partial discharge localization in power transformer tanks using machine learning methods

A graph convolutional autoencoder approach to model order reduction for parametrized PDEs

Deep learning approach for identification of H II regions during reionization in 21-cm observations - II. Foreground contamination

Intraday solar irradiance forecasting using public cameras

Understanding generalization and robustness in modern deep learning

33.3 MiBMI: A 192/512-Channel 2.46mm² Miniaturized Brain-Machine Interface Chipset Enabling 31-Class Brain-to-Text Conversion Through Distinctive Neural Codes

Deep learning approach for identification of H II regions during reionization in 21-cm observations - II. Foreground contamination

Understanding generalization and robustness in modern deep learning

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks

Towards improving full-length ribosome density prediction by bridging sequence and graph-based representations

Task-driven neural network models predict neural dynamics of proprioception: Neural network model weights

On the Generalization of Stochastic Gradient Descent with Momentum

Partial discharge localization in power transformer tanks using machine learning methods

A graph convolutional autoencoder approach to model order reduction for parametrized PDEs

Intraday solar irradiance forecasting using public cameras

33.3 MiBMI: A 192/512-Channel 2.46mm² Miniaturized Brain-Machine Interface Chipset Enabling 31-Class Brain-to-Text Conversion Through Distinctive Neural Codes