Are you an EPFL student looking for a semester project?
Work with us on data science and visualisation projects, and deploy your project as an app on top of Graph Search.
Person
Sebastian Urban Stich
Official source
About this result
This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.
Ontological neighbourhood
Related units (1)
Related publications (28)
Please note that this is not a complete list of this person’s publications. It includes only semantically relevant works. For a full list, please refer to Infoscience.
Stochastic distributed learning with gradient quantization and double-variance reduction
Sebastian Urban Stich, Konstantin Mishchenko
We consider distributed optimization over several devices, each sending incremental model updates to a central server. This setting is considered, for instance, in federated learning. Various schemes have been designed to compress the model updates in orde ...
TAYLOR & FRANCIS LTD2022Masked Training of Neural Networks with Partial Gradients
Martin Jaggi, Sebastian Urban Stich, Amirkeivan Mohtashami
State-of-the-art training algorithms for deep learning models are based on stochastic gradient descent (SGD). Recently, many variations have been explored: perturbing parameters for better accuracy (such as in Extra-gradient), limiting SGD updates to a sub ...
JMLR-JOURNAL MACHINE LEARNING RESEARCH2022LENA: Communication-Efficient Distributed Learning with Self-Triggered Gradient Uploads
Martin Jaggi, Sebastian Urban Stich, Hossein Shokri Ghadikolaei
In distributed optimization, parameter updates from the gradient computing node devices have to be aggregated in every iteration on the orchestrating server. When these updates are sent over an arbitrary commodity network, bandwidth and latency can be limi ...
MICROTOME PUBLISHING2021People doing similar research (35)