Publications related to Metrizing Fairness

Topics in statistical physics of high-dimensional machine learning

In the past few years, Machine Learning (ML) techniques have ushered in a paradigm shift, allowing the harnessing of ever more abundant sources of data to automate complex tasks. The technical workhorse behind these important breakthroughs arguably lies in ...

EPFL2024

Understanding generalization and robustness in modern deep learning

Maksym Andriushchenko

In this thesis, we study two closely related directions: robustness and generalization in modern deep learning. Deep learning models based on empirical risk minimization are known to be often non-robust to small, worst-case perturbations known as adversari ...

EPFL2024

Communication-efficient distributed training of machine learning models

Thijs Vogels

In this thesis, we explore techniques for addressing the communication bottleneck in data-parallel distributed training of deep learning models. We investigate algorithms that either reduce the size of the messages that are exchanged between workers, or th ...

EPFL2023

Computationally Efficient Reinforcement Learning: Targeted Exploration leveraging Simple Rules

Colin Neil Jones, Bratislav Svetozarevic, Loris Di Natale

Model-free Reinforcement Learning (RL) generally suffers from poor sample complexity, mostly due to the need to exhaustively explore the state-action space to find well-performing policies. On the other hand, we postulate that expert knowledge of the syste ...

2023

End-to-End Learning for Stochastic Optimization: A Bayesian Perspective

Daniel Kuhn, Yves Rychener, Tobias Sutter

We develop a principled approach to end-to-end learning in stochastic optimization. First, we show that the standard end-to-end learning algorithm admits a Bayesian interpretation and trains a posterior Bayes action map. Building on the insights of this an ...

2023

Stochastic Second-Order Methods Improve Best-Known Sample Complexity of SGD for Gradient-Dominated Function

Patrick Thiran, Negar Kiyavash, Saber Salehkaleybar

We study the performance of Stochastic Cubic Regularized Newton (SCRN) on a class of functions satisfying gradient dominance property with

1\le\alpha\le2

which holds in a wide range of applications in machine learning and signal processing. This conditio ...

NeurIPS2022

Faster One-Sample Stochastic Conditional Gradient Method for Composite Convex Minimization

Volkan Cevher, Alp Yurtsever, Maria-Luiza Vladarean

We propose a stochastic conditional gradient method (CGM) for minimizing convex finitesum objectives formed as a sum of smooth and non-smooth terms. Existing CGM variants for this template either suffer from slow convergence rates, or require carefully inc ...

2022

Masked Training of Neural Networks with Partial Gradients

Martin Jaggi, Sebastian Urban Stich, Amirkeivan Mohtashami

State-of-the-art training algorithms for deep learning models are based on stochastic gradient descent (SGD). Recently, many variations have been explored: perturbing parameters for better accuracy (such as in Extra-gradient), limiting SGD updates to a sub ...

JMLR-JOURNAL MACHINE LEARNING RESEARCH2022

Momentum-Based Policy Gradient with Second-Order Information

Patrick Thiran, Negar Kiyavash, Mohammadsadegh Khorasani, Saber Salehkaleybar

Variance-reduced gradient estimators for policy gradient methods have been one of the main focus of research in the reinforcement learning in recent years as they allow acceleration of the estimation process. We propose a variance-reduced policy-gradient m ...

2022

The role of convolutional neural networks in scanning probe microscopy: a review

Georg Fantner

Progress in computing capabilities has enhanced science in many ways. In recent years, various branches of machine learning have been the key facilitators in forging new paths, ranging from categorizing big data to instrumental control, from materials desi ...

BEILSTEIN-INSTITUT2021

Metrizing Fairness

Graph Chatbot

Chat with Graph Search

Topics in statistical physics of high-dimensional machine learning

Understanding generalization and robustness in modern deep learning

Communication-efficient distributed training of machine learning models

Computationally Efficient Reinforcement Learning: Targeted Exploration leveraging Simple Rules

End-to-End Learning for Stochastic Optimization: A Bayesian Perspective

Stochastic Second-Order Methods Improve Best-Known Sample Complexity of SGD for Gradient-Dominated Function

Faster One-Sample Stochastic Conditional Gradient Method for Composite Convex Minimization

Masked Training of Neural Networks with Partial Gradients

Momentum-Based Policy Gradient with Second-Order Information

The role of convolutional neural networks in scanning probe microscopy: a review

Computationally Efficient Reinforcement Learning: Targeted Exploration leveraging Simple Rules

Understanding generalization and robustness in modern deep learning

Stochastic Second-Order Methods Improve Best-Known Sample Complexity of SGD for Gradient-Dominated Function

Topics in statistical physics of high-dimensional machine learning

End-to-End Learning for Stochastic Optimization: A Bayesian Perspective

Faster One-Sample Stochastic Conditional Gradient Method for Composite Convex Minimization

Communication-efficient distributed training of machine learning models

Momentum-Based Policy Gradient with Second-Order Information

Masked Training of Neural Networks with Partial Gradients

The role of convolutional neural networks in scanning probe microscopy: a review