Publications de Nirupam Gupta | EPFL Graph Search

Robust Machine Learning - Distributed Methods for Safe AI

Rachid Guerraoui, Nirupam Gupta, Rafaël Benjamin Pinot

Today, machine learning algorithms are often distributed across multiple machines to leverage more computing power and more data. However, the use of a distributed framework entails a variety of security threats. In particular, some of the machines may mis ...

Springer2024

Robust and Private Federated Learning on LLMs

Rachid Guerraoui, Nirupam Gupta

Large Language Models (LLMs) have gained significant attention in recent years due to their potential to revolutionize various industries and sectors. However, scaling LLMs further requires access to substantial linguistic resources that are being rapidly ...

Springer Nature2024

Revisiting Ensembling in One-Shot Federated Learning

Rachid Guerraoui, Anne-Marie Kermarrec, Rafael Pereira Pires, Youssef Allouah, Akash Balasaheb Dhasade, Rishi Sharma, Nirupam Gupta, Rafaël Benjamin Pinot

Federated learning (FL) is an appealing approach to training machine learning models without sharing raw data. However, standard FL algorithms are iterative and thus induce a significant communication cost. One-shot federated learning (OFL) trades the iter ...

Curran Associates, Inc.2024

Brief Announcement: A Case for Byzantine Machine Learning

Rachid Guerraoui, Sadegh Farhadkhani, Nirupam Gupta, Rafaël Benjamin Pinot

The success of machine learning (ML) has been intimately linked with the availability of large amounts of data, typically collected from heterogeneous sources and processed on vast networks of computing devices (also called workers). Beyond accuracy, the u ...

ACM2024

Fine-Tuning Personalization in Federated Learning to Mitigate Adversarial Clients

Rachid Guerraoui, Youssef Allouah, Nirupam Gupta, Rafaël Benjamin Pinot

Federated learning (FL) is an appealing paradigm that allows a group of machines (a.k.a. clients) to learn collectively while keeping their data local. However, due to the heterogeneity between the clients' data distributions, the model obtained through th ...

Neural information processing systems foundation2024

Impact of Redundancy on Resilience in Distributed Optimization and Learning

Nirupam Gupta, Shuo Liu

This paper considers the problem of resilient distributed optimization and stochastic learning in a server-based architecture. The system comprises a server and multiple agents, where each agent has its own local cost function. The agents collaborate with ...

Assoc Computing Machinery2023

Byzantine Machine Learning: A Primer

Rachid Guerraoui, Nirupam Gupta, Rafaël Benjamin Pinot

The problem of Byzantine resilience in distributed machine learning, a.k.a., Byzantine machine learning, consists in designing distributed algorithms that can train an accurate model despite the presence of Byzantine nodes, i.e., nodes with corrupt data or ...

2023

Byzantine Fault-Tolerance in Federated Local SGD Under 2f-Redundancy

Nirupam Gupta

In this article, we study the problem of Byzantine fault-tolerance in a federated optimization setting, where there is a group of agents communicating with a centralized coordinator. We allow up to

f

Byzantine-faulty agents, which may not follow a prescr ...

Ieee-Inst Electrical Electronics Engineers Inc2023

On the Privacy-Robustness-Utility Trilemma in Distributed Learning

Rachid Guerraoui, John Stephan, Youssef Allouah, Nirupam Gupta, Rafaël Benjamin Pinot

The ubiquity of distributed machine learning (ML) in sensitive public domain applications calls for algorithms that protect data privacy, while being robust to faults and adversarial behaviors. Although privacy and robustness have been extensively studied ...

2023

Robust Distributed Learning: Tight Error Bounds and Breakdown Point under Data Heterogeneity

Rachid Guerraoui, Youssef Allouah, Geovani Rizk, Nirupam Gupta, Rafaël Benjamin Pinot

The theory underlying robust distributed learning algorithms, designed to resist adversarial machines, matches empirical observations when data is homogeneous. Under data heterogeneity however, which is the norm in practical scenarios, established lower bo ...

2023