On the Almost Sure Convergence of Stochastic Gradient Descent in Non-Convex Problems
Publications associées (66)
Graph Chatbot
Chattez avec Graph Search
Posez n’importe quelle question sur les cours, conférences, exercices, recherches, actualités, etc. de l’EPFL ou essayez les exemples de questions ci-dessous.
AVERTISSEMENT : Le chatbot Graph n'est pas programmé pour fournir des réponses explicites ou catégoriques à vos questions. Il transforme plutôt vos questions en demandes API qui sont distribuées aux différents services informatiques officiellement administrés par l'EPFL. Son but est uniquement de collecter et de recommander des références pertinentes à des contenus que vous pouvez explorer pour vous aider à répondre à vos questions.
In this paper we study the speed of infection spread and the survival of the contact process in the random geometric graph G = G (n, r(n), f) of n nodes independently distributed in S = -1/2, 1/2 according to a certain density f(.). In the first part ...
Revenue management (RM) can be considered an application of operations research in the transportation industry. For these service companies, it is a difficult task to adjust supply and demand. In order to maximize revenue, RM systems display demand behavio ...
Systems and methods for tracking interacting objects may acquire, with a sensor, and two or more images associated with two or more time instances. A processor may generate image data from the two or more images. The processor may apply an extended Probabi ...
Inspired by the BBM formula and by work of G. Leoni and D. Spector, we analyze the asymptotic behavior of two sequences of convex nonlocal functionals (Psi(n)(u)) and (Phi(n)(u)) which converge formally to the BV-norm of u. We show that pointwise convergen ...
There are many important applications that are multitask-oriented in the sense that there are multiple optimum parameter vectors to be inferred simultaneously by networked agents. In this paper, we formulate an online multitask learning problem where node ...
Several useful variance-reduced stochastic gradient algorithms, such as SVRG, SAGA, Finito, and SAG, have been proposed to minimize empirical risks with linear convergence properties to the exact minimizers. The existing convergence results assume uniform ...
A proof for the point-wise convergence of the factors in the higher-order power method for tensors towards a critical point is given. It is obtained by applying established results from the theory of Lojasiewicz inequalities to the equivalent, unconstraine ...
Part I of this work developed the exact diffusion algorithm to remove the bias that is characteristic of distributed solutions for deterministic optimization problems. The algorithm was shown to be applicable to a larger set of combination policies than ea ...
We discuss the design of sampled-data economic nonlinear model predictive control schemes for continuous-time systems based on turnpike properties. In a recent paper we have shown that an exact turnpike property allows establishing finite-time convergence ...
Accelerating the convergence of some hypergeometric series with Gosper's method leads, in a most elementary way, to some series discovered by Ramanujan, Bauer and Dougall. In particular, it is shown that one of them can be traced back to the well-known for ...