Publications de Bicheng Ying | EPFL Graph Search

Belief Control Strategies for Interactions Over Weakly-Connected Graphs

In diffusion social learning over weakly-connected graphs, it has been shown recently that influential agents shape the beliefs of non-influential agents. This paper analyzes this mechanism more closely and addresses two main questions. First, the article ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021

On the Influence of Bias-Correction on Distributed Stochastic Optimization

Ali H. Sayed, Bicheng Ying, Kun Yuan, Sulaiman A S A E Alghunaim

Various bias-correction methods such as EXTRA, gradient tracking methods, and exact diffusion have been proposed recently to solve distributed deterministic optimization problems. These methods employ constant step-sizes and converge linearly to the exact ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2020

Variance-Reduced Stochastic Learning Under Random Reshuffling

Ali H. Sayed, Bicheng Ying, Kun Yuan

Several useful variance-reduced stochastic gradient algorithms, such as SVRG, SAGA, Finito, and SAG, have been proposed to minimize empirical risks with linear convergence properties to the exact minimizer. The existing convergence results assume uniform d ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2020

On the Performance of Exact Diffusion over Adaptive Networks

Ali H. Sayed, Sulaiman A S A E Alghunaim, Bicheng Ying, Kun Yuan

Various bias-correction methods such as EXTRA, DIGing, and exact diffusion have been proposed recently to solve distributed deterministic optimization problems. These methods employ constant step-sizes and converge linearly to the exact solution under prop ...

IEEE2019

Stochastic Learning Under Random Reshuffling With Constant Step-Sizes

Ali H. Sayed, Stefan Vlaski, Bicheng Ying, Kun Yuan

In empirical risk optimization, it has been observed that stochastic gradient implementations that rely on random reshuffling of the data achieve better performance than implementations that rely on sampling the data uniformly. Recent works have pursued ju ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2019

Variance-Reduced Stochastic Learning by Networked Agents Under Random Reshuffling

Ali H. Sayed, Bicheng Ying, Kun Yuan

This paper develops a distributed variance-reduced strategy for a collection of interacting agents that are connected by a graph topology. The resulting diffusion-AVRG (where AVRG stands for "amortized variance-reduced gradient") algorithm is shown to have ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2019

Exact Diffusion for Distributed Optimization and Learning-Part I: Algorithm Development

Ali H. Sayed, Bicheng Ying, Kun Yuan

This paper develops a distributed optimization strategy with guaranteed exact convergence for a broad class of left-stochastic combination policies. The resulting exact diffusion strategy is shown in Part II of this paper to have a wider stability range an ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2019

Exact Diffusion for Distributed Optimization and Learning-Part II: Convergence Analysis

Ali H. Sayed, Bicheng Ying, Kun Yuan

Part I of this paper developed the exact diffusion algorithm to remove the bias that is characteristic of distributed solutions for deterministic optimization problems. The algorithm was shown to be applicable to the larger set of locally balanced left-sto ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2019

Cover: A Cluster-Based Variance Reduced Method For Online Learning

Ali H. Sayed, Bicheng Ying, Kun Yuan

In this paper, we develop a stochastic-gradient learning algorithm for situations involving streaming data that arise from an underlying clustered structure. In such settings, the variance of gradient noise can be decomposed into the in-cluster variance si ...

IEEE2019

Supervised Learning Under Distributed Features

Ali H. Sayed, Bicheng Ying, Kun Yuan

This paper studies the problem of learning under both large datasets and large-dimensional feature space scenarios. The feature information is assumed to be spread across agents in a network, where each agent observes some of the features. Through local co ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2019