Concept
Locally convex topological vector space
Related publications (150)
Stochastic distributed learning with gradient quantization and double-variance reduction
Sebastian Urban Stich, Konstantin Mishchenko
We consider distributed optimization over several devices, each sending incremental model updates to a central server. This setting is considered, for instance, in federated learning. Various schemes have been designed to compress the model updates in orde ...
TAYLOR & FRANCIS LTD2022On The Convergence Of Stochastic Primal-Dual Hybrid Gradient
Volkan Cevher, Ahmet Alacaoglu
In this paper, we analyze the recently proposed stochastic primal-dual hybrid gradient (SPDHG) algorithm and provide new theoretical results. In particular, we prove almost sure convergence of the iterates to a solution with convexity and linear convergenc ...
SIAM PUBLICATIONS2022Proximal Point Imitation Learning
Volkan Cevher, Luca Viano, Igor Krawczuk, Angeliki Kamoutsi
This work develops new algorithms with rigorous efficiency guarantees for infinite horizon imitation learning (IL) with linear function approximation without restrictive coherence assumptions. We begin with the minimax formulation of the problem and then o ...
2022Topology, Oxidation States, and Charge Transport in Ionic Conductors
Recent theoretical advances, based on a combination of concepts from Thouless' topological theory of adiabatic charge transport and a newly introduced gauge-invariance principle for transport coefficients, have permitted to connect (and reconcile) Faraday' ...
WILEY-V C H VERLAG GMBH2022Extra Newton: A First Approach to Noise-Adaptive Accelerated Second-Order Methods
Volkan Cevher, Kimon Antonakopoulos, Ali Kavis
This work proposes a universal and adaptive second-order method for minimizing second-order smooth, convex functions. Our algorithm achieves O(σ/T‾‾√) convergence when the oracle feedback is stochastic with variance σ2, and improves its convergence to O(1/ ...
2022Accelerated SGD for Non-Strongly-Convex Least Squares
Nicolas Henri Bernard Flammarion, Aditya Vardhan Varre
We consider stochastic approximation for the least squares regression problem in the non-strongly convex setting. We present the first practical algorithm that achieves the optimal prediction error rates in terms of dependence on the noise of the problem, ...
2022A first-order primal-dual method with adaptivity to local smoothness
Volkan Cevher, Maria-Luiza Vladarean
We consider the problem of finding a saddle point for the convex-concave objective , where is a convex function with locally Lipschitz gradient and is convex and possibly non-smooth. We propose an ...
2021Invariant Integrals on Topological Groups and Applications
We study a fixed point property for linear actions of discrete groups on weakly complete convex proper cones in locally convex topological vector spaces. We search to understand the class of discrete groups which enjoys this property and we try to generali ...
EPFL2021Critical Parameters for Scalable Distributed Learning with Large Batches and Asynchronous Updates
Martin Jaggi, Sebastian Urban Stich, Amirkeivan Mohtashami
It has been experimentally observed that the efficiency of distributed training with stochastic gradient (SGD) depends decisively on the batch size and—in asynchronous implementations—on the gradient staleness. Especially, it has been observed that the spe ...
2021Federated Learning Over Wireless Networks: Convergence Analysis and Resource Allocation
There is an increasing interest in a fast-growing machine learning technique called Federated Learning (FL), in which the model training is distributed over mobile user equipment (UEs), exploiting UEs' local computation and training data. Despite its advan ...
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021