Ali H. Sayed, Bicheng Ying, Kun Yuan
This paper examines the convergence rate and mean-square-error performance of momentum stochastic gradient methods in the constant step-size and slow adaptation regime. The results establish that momentum methods are equivalent to the standard stochastic g ...
IEEE2016