Publications associées à Masked Training of Neural Networks with Partial Gradients

Chattez avec Graph Search

Posez n’importe quelle question sur les cours, conférences, exercices, recherches, actualités, etc. de l’EPFL ou essayez les exemples de questions ci-dessous.

AVERTISSEMENT : Le chatbot Graph n'est pas programmé pour fournir des réponses explicites ou catégoriques à vos questions. Il transforme plutôt vos questions en demandes API qui sont distribuées aux différents services informatiques officiellement administrés par l'EPFL. Son but est uniquement de collecter et de recommander des références pertinentes à des contenus que vous pouvez explorer pour vous aider à répondre à vos questions.

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks

Nicolas Henri Bernard Flammarion, Hristo Georgiev Papazov, Scott William Pesme

In this work, we investigate the effect of momentum on the optimisation trajectory of gradient descent. We leverage a continuous-time approach in the analysis of momentum gradient descent with step size

\gamma

and momentum parameter

\beta

that allows u ...

2024

Masked Training of Neural Networks with Partial Gradients

Graph Chatbot

Chattez avec Graph Search

Random matrix methods for high-dimensional machine learning models

Reduced Training Data for Laser Ultrasound Signal Interpretation by Neural Networks

Statistical Inference for Inverse Problems: From Sparsity-Based Methods to Neural Networks

Few-shot Learning for Efficient and Effective Machine Learning Model Adaptation

Driving and suppressing the human language network using large language models

Coupling a recurrent neural network to SPAD TCSPC systems for real-time fluorescence lifetime imaging

Generalization of Scaled Deep ResNets in the Mean-Field Regime

Residual-based attention in physics-informed neural networks

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks

Optimization Algorithms for Decentralized, Distributed and Collaborative Machine Learning

Random matrix methods for high-dimensional machine learning models

Reduced Training Data for Laser Ultrasound Signal Interpretation by Neural Networks

Statistical Inference for Inverse Problems: From Sparsity-Based Methods to Neural Networks

Few-shot Learning for Efficient and Effective Machine Learning Model Adaptation

Driving and suppressing the human language network using large language models

Coupling a recurrent neural network to SPAD TCSPC systems for real-time fluorescence lifetime imaging

Generalization of Scaled Deep ResNets in the Mean-Field Regime

Residual-based attention in physics-informed neural networks

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks

Optimization Algorithms for Decentralized, Distributed and Collaborative Machine Learning