Concept
Greek fire
Related publications (4)
Fixing by Mixing: A Recipe for Optimal Byzantine ML under Heterogeneity
Rachid Guerraoui, Nirupam Gupta, John Stephan, Sadegh Farhadkhani, Youssef Allouah, Rafaël Benjamin Pinot
Byzantine machine learning (ML) aims to ensure the resilience of distributed learning algorithms to misbehaving (or Byzantine) machines. Although this problem received significant attention, prior works often assume the data held by the machines to be homo ...
PMLR2023AKSEL: Fast Byzantine SGD
Rachid Guerraoui, El Mahdi El Mhamdi, Alexandre David Olivier Maurer, Sébastien Louis Alexandre Rouault
Modern machine learning architectures distinguish servers and workers. Typically, a d-dimensional model is hosted by a server and trained by n workers, using a distributed stochastic gradient descent (SGD) optimization scheme. At each SGD step, the goal is ...
Schloss Dagstuhl--Leibniz-Zentrum f{\"u}r Informatik2021Genuinely Distributed Byzantine Machine Learning
Rachid Guerraoui, El Mahdi El Mhamdi, Le Nguyen Hoang, Sébastien Louis Alexandre Rouault, Arsany Hany Abdelmessih Guirguis
Machine Learning (ML) solutions are nowadays distributed, according to the so-called server/worker architecture. One server holds the model parameters while several workers train the model. Clearly, such architecture is prone to various types of component ...
Association for Computing Machinery2020Asynchronous Byzantine Machine Learning (the case of SGD)
Rachid Guerraoui, Mahsa Taziki, El Mahdi El Mhamdi, Rhicheek Patra, Georgios Damaskinos
Asynchronous distributed machine learning solutions have proven very effective so far, but always assuming perfectly functioning workers. In practice, some of the workers can however exhibit Byzantine behavior, caused by hardware failures, software bugs, c ...
2018