Empirical risk minimization

Applied sciences
Information engineering
Apprentissage automatique
Apprentissage automatique

Publications associées (29)

À propos
Confidentialité
Mentions légales

Graph Chatbot

On The Choice of Graph Neural Network Architectures

Pascal Frossard, Guillermo Ortiz Jimenez, Clément Arthur Yvon Vignac

Seminal works on graph neural networks have primarily targeted semi-supervised node classification problems with few observed labels and high-dimensional signals. With the development of graph networks, this setup has become a de facto benchmark for a sign ...

IEEE2020

Approaching Ontology Alignment through Representation Learning to Bridge the Semantic Gap in Engineering Applications

Prodromos Kolyvakis

The current information landscape is characterised by a vast amount of relatively semantically homogeneous, when observed in isolation, data silos that are, however, drastically semantically fragmented when considered as a whole. Within each data silo, inf ...

EPFL2020

Dynamic Federated Learning

Ali H. Sayed, Stefan Vlaski, Elsa Rizk

Federated learning has emerged as an umbrella term for centralized coordination strategies in multi-agent environments. While many federated learning architectures process data in an online manner, and are hence adaptive by nature, most performance analyse ...

IEEE2020

Stochastic Learning Under Random Reshuffling With Constant Step-Sizes

Ali H. Sayed, Stefan Vlaski, Bicheng Ying, Kun Yuan

In empirical risk optimization, it has been observed that stochastic gradient implementations that rely on random reshuffling of the data achieve better performance than implementations that rely on sampling the data uniformly. Recent works have pursued ju ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2019

Conditional Gradient Methods via Stochastic Path-Integrated Differential Estimator

Volkan Cevher, Alp Yurtsever

We propose a class of novel variance-reduced stochastic conditional gradient methods. By adopting the recent stochastic path-integrated differential estimator technique (SPIDER) of Fang et al. (2018) for the classical Frank-Wolfe (FW) method, we introduce ...

2019

An accelerated communication-efficient primal-dual optimization framework for structured machine learning

Martin Jaggi, Chenxin Ma

Distributed optimization algorithms are essential for training machine learning models on very large-scale datasets. However, they often suffer from communication bottlenecks. Confronting this issue, a communication-efficient primal-dual coordinate ascent ...

2021

Regularization via Mass Transportation

Daniel Kuhn, Soroosh Shafieezadeh Abadeh, Peyman Mohajerin Esfahani

The goal of regression and classification methods in supervised learning is to minimize the empirical risk, that is, the expectation of some loss function quantifying the prediction error under the empirical distribution. When facing scarce training data, ...

2019

Supervised Learning Under Distributed Features

Ali H. Sayed, Bicheng Ying, Kun Yuan

This paper studies the problem of learning under both large datasets and large-dimensional feature space scenarios. The feature information is assumed to be spread across agents in a network, where each agent observes some of the features. Through local co ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2019

Calculating Optimistic Likelihoods Using (Geodesically) Convex Optimization

Daniel Kuhn, Viet Anh Nguyen, Soroosh Shafieezadeh Abadeh, Wolfram Wiesemann

A fundamental problem arising in many areas of machine learning is the evaluation of the likelihood of a given observation under different nominal distributions. Frequently, these nominal distributions are themselves estimated from data, which makes them s ...

2019

Page 3 sur 3