Concept

Quadri-moment

Publications associées (94)

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks

Nicolas Henri Bernard Flammarion, Hristo Georgiev Papazov, Scott William Pesme

In this work, we investigate the effect of momentum on the optimisation trajectory of gradient descent. We leverage a continuous-time approach in the analysis of momentum gradient descent with step size

\gamma

and momentum parameter

\beta

that allows u ...

2024

On the Generalization of Stochastic Gradient Descent with Momentum

Volkan Cevher, Kimon Antonakopoulos

While momentum-based accelerated variants of stochastic gradient descent (SGD) are widely used when training machine learning models, there is little theoretical understanding on the generalization error of such methods. In this work, we first show that th ...

Brookline2024

Robust Collaborative Learning with Linear Gradient Overhead

Rachid Guerraoui, Nirupam Gupta, John Stephan, Sadegh Farhadkhani, Le Nguyen Hoang, Rafaël Benjamin Pinot

Collaborative learning algorithms, such as distributed SGD (or D-SGD), are prone to faulty machines that may deviate from their prescribed algorithm because of software or hardware bugs, poisoned data or malicious behaviors. While many solutions have been ...

PLMR2023

On A Special Symmetry In The Dynamics Of Complex Systems In A Holographic-Type Perspective

Maria-Alexandra Paun

By operating with the Scale Relativity Theory in the dynamics of complex systems, we can achieve a description of these complex systems through a holographic-type perspective. Then, gauge invariances of a Riccati-type become functional in complex system dy ...

UNIV POLITEHNICA BUCHAREST, SCI BULL2023

Electromagnetic forces in the time domain

Olivier Martin, Karim Achouri, Andrei Kiselev

We look beyond the standard time-average approach and investigate optical forces in the time domain. The formalism is developed for both the Abraham and Minkowski momenta, which appear to converge in the time domain. We unveil an extremely rich - and by fa ...

Optica Publishing Group2022

Tomographic reconstruction of the runaway distribution function in TCV using multispectral synchrotron images

Basil Duval, Joan Decker, Umar Sheikh, Artur Perek, Gergely Papp

Synchrotron radiation observed in a quiescent Tokamak a Configuration Variable (TCV) runaway discharge is studied using filtered camera images targeting three distinct wavelength intervals. Through the tomographic simultaneous algebraic reconstruction tech ...

IOP PUBLISHING LTD2021

Evidence of a coupled electron-phonon liquid in NbGe2

Mathieu François Padlewski, Philip Johannes Walter Moll, Matthias Carsten Putzke, Hao Yang

Whereas electron-phonon scattering relaxes the electron's momentum in metals, a perpetual exchange of momentum between phonons and electrons may conserve total momentum and lead to a coupled electron-phonon liquid. Such a phase of matter could be a platfor ...

NATURE PORTFOLIO2021

Development of a novel two-phase flow solver for nuclear reactor analysis: algorithms, verification and implementation in OpenFOAM

Andreas Pautz, Carlo Fiorina, Stefan Radman

A porous medium-based representation of nuclear reactors and complex engineering systems more in general can significantly reduce simulation and modelling costs, while preserving a reasonable degree of accuracy via regime map-based correlations for modelli ...

2021

A mixture model for a dilute dispersion of gas in a liquid flow: Mathematical analysis and application to aluminium electrolysis

Jacques Rappaz, Marco Picasso, Emile Tryphon Pierre Soutter

A mixture model to take into account the flow of small carbon dioxide bubbles dissolved in a liquid is presented. The model describes the evolution of the velocity fields (mixture and gas), the pressure and the volume fraction of gas. The system of equatio ...

2021

Measurement of the inner structure of turbidity currents by ultrasound velocity profiling

Shun Nomura, Jumpei Hitomi

The inner velocity structure and particle concentration profile of opaque turbidity currents were mea- sured simultaneously by ultrasound velocity profilers. Currents consisting of a quartz particle suspension were generated by using the lock-exchange meth ...

2021

Graph Chatbot

Chattez avec Graph Search

Posez n’importe quelle question sur les cours, conférences, exercices, recherches, actualités, etc. de l’EPFL ou essayez les exemples de questions ci-dessous.

AVERTISSEMENT : Le chatbot Graph n'est pas programmé pour fournir des réponses explicites ou catégoriques à vos questions. Il transforme plutôt vos questions en demandes API qui sont distribuées aux différents services informatiques officiellement administrés par l'EPFL. Son but est uniquement de collecter et de recommander des références pertinentes à des contenus que vous pouvez explorer pour vous aider à répondre à vos questions.

Connectez-vous pour utiliser Chat avec Graph Search

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks

Nicolas Henri Bernard Flammarion, Hristo Georgiev Papazov, Scott William Pesme

\gamma

and momentum parameter

\beta

that allows u ...

2024