Publications related to A global existence result for the semigeostrophic equations in three dimensional convex domains

Stochastic distributed learning with gradient quantization and double-variance reduction

Sebastian Urban Stich, Konstantin Mishchenko

We consider distributed optimization over several devices, each sending incremental model updates to a central server. This setting is considered, for instance, in federated learning. Various schemes have been designed to compress the model updates in orde ...

TAYLOR & FRANCIS LTD2022

A first-order primal-dual method with adaptivity to local smoothness

Volkan Cevher, Maria-Luiza Vladarean

We consider the problem of finding a saddle point for the convex-concave objective

\min_x \max_y f(x) + \langle Ax, y\rangle - g^*(y)

, where

f

is a convex function with locally Lipschitz gradient and

g

is convex and possibly non-smooth. We propose an ...

2021

Critical Parameters for Scalable Distributed Learning with Large Batches and Asynchronous Updates

Martin Jaggi, Sebastian Urban Stich, Amirkeivan Mohtashami

It has been experimentally observed that the efficiency of distributed training with stochastic gradient (SGD) depends decisively on the batch size and—in asynchronous implementations—on the gradient staleness. Especially, it has been observed that the spe ...

2021

Federated Learning Over Wireless Networks: Convergence Analysis and Resource Allocation

Vincent Gramoli

There is an increasing interest in a fast-growing machine learning technique called Federated Learning (FL), in which the model training is distributed over mobile user equipment (UEs), exploiting UEs' local computation and training data. Despite its advan ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021

Mathematical Foundations of Robust and Distributionally Robust Optimization

Daniel Kuhn, Jianzhe Zhen, Wolfram Wiesemann

Robust and distributionally robust optimization are modeling paradigms for decision-making under uncertainty where the uncertain parameters are only known to reside in an uncertainty set or are governed by any probability distribution from within an ambigu ...

2021

A Multi-Agent Primal-Dual Strategy for Composite Optimization over Distributed Features

Ali H. Sayed, Sulaiman A S A E Alghunaim, Ming Yan

This work studies multi-agent sharing optimization problems with the objective function being the sum of smooth local functions plus a convex (possibly non-smooth) function coupling all agents. This scenario arises in many machine learning and engineering ...

IEEE2020

Convex Combination of Diffusion Strategies Over Networks

Ali H. Sayed, Jie Chen

Combining diffusion strategies with complementary properties enables enhanced performance when they can be run simultaneously. In this article, we first propose two schemes for the convex combination of two diffusion strategies, namely, the power-normalize ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2020

On the convergence of stochastic primal-dual hybrid gradient

Volkan Cevher, Ahmet Alacaoglu

In this paper, we analyze the recently proposed stochastic primal-dual hybrid gradient (SPDHG) algorithm and provide new theoretical results. In particular, we prove almost sure convergence of the iterates to a solution and linear convergence with standard ...

2019

Discrete-time regional pole-placement using convex approximations: Theory and application to a boost converter

Emilio Maddalena

The problem of allocating the closed-loop poles of linear systems in specific regions of the complex plane defined by discrete time-domain requirements is addressed. The resulting non-convex set is inner-approximated by a convex region described with linea ...

2019

Proximity Operators of Discrete Information Divergences

Mireille El Gheche, Giovanni Chierchia

While phi-divergences have been extensively studied in convex analysis, their use in optimization problems often remains challenging. In this regard, one of the main shortcomings of existing methods is that the minimization of phi-divergences is usually pe ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2018

A global existence result for the semigeostrophic equations in three dimensional convex domains

Graph Chatbot

Chat with Graph Search

Stochastic distributed learning with gradient quantization and double-variance reduction

A first-order primal-dual method with adaptivity to local smoothness

Critical Parameters for Scalable Distributed Learning with Large Batches and Asynchronous Updates

Federated Learning Over Wireless Networks: Convergence Analysis and Resource Allocation

Mathematical Foundations of Robust and Distributionally Robust Optimization

A Multi-Agent Primal-Dual Strategy for Composite Optimization over Distributed Features

Convex Combination of Diffusion Strategies Over Networks

On the convergence of stochastic primal-dual hybrid gradient

Discrete-time regional pole-placement using convex approximations: Theory and application to a boost converter

Proximity Operators of Discrete Information Divergences

Stochastic distributed learning with gradient quantization and double-variance reduction

Critical Parameters for Scalable Distributed Learning with Large Batches and Asynchronous Updates

A Multi-Agent Primal-Dual Strategy for Composite Optimization over Distributed Features

A first-order primal-dual method with adaptivity to local smoothness

On the convergence of stochastic primal-dual hybrid gradient

Convex Combination of Diffusion Strategies Over Networks

Discrete-time regional pole-placement using convex approximations: Theory and application to a boost converter

Federated Learning Over Wireless Networks: Convergence Analysis and Resource Allocation

Mathematical Foundations of Robust and Distributionally Robust Optimization

Proximity Operators of Discrete Information Divergences