Publications associées à Complex Dynamics in Simple Neural Networks: Understanding Gradient Flow in Phase Retrieval

Chattez avec Graph Search

Posez n’importe quelle question sur les cours, conférences, exercices, recherches, actualités, etc. de l’EPFL ou essayez les exemples de questions ci-dessous.

AVERTISSEMENT : Le chatbot Graph n'est pas programmé pour fournir des réponses explicites ou catégoriques à vos questions. Il transforme plutôt vos questions en demandes API qui sont distribuées aux différents services informatiques officiellement administrés par l'EPFL. Son but est uniquement de collecter et de recommander des références pertinentes à des contenus que vous pouvez explorer pour vous aider à répondre à vos questions.

Stochastic Second-Order Methods Improve Best-Known Sample Complexity of SGD for Gradient-Dominated Function

Patrick Thiran, Negar Kiyavash, Saber Salehkaleybar

We study the performance of Stochastic Cubic Regularized Newton (SCRN) on a class of functions satisfying gradient dominance property with

1\le\alpha\le2

which holds in a wide range of applications in machine learning and signal processing. This conditio ...

NeurIPS2022

Complex Dynamics in Simple Neural Networks: Understanding Gradient Flow in Phase Retrieval

Graph Chatbot

Chattez avec Graph Search

Universal and adaptive methods for robust stochastic optimization

Stochastic Second-Order Methods Improve Best-Known Sample Complexity of SGD for Gradient-Dominated Function

Momentum-Based Policy Gradient with Second-Order Information

Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networks

Large Steps in Inverse Rendering of Geometry

Adaptation in Stochastic Algorithms: From Nonsmooth Optimization to Min-Max Problems and Beyond

Regret Minimization in Stochastic Non-Convex Learning via a Proximal-Gradient Approach

The role of PDE-based parameterization techniques in gradient-based IGA shape optimization applications

Second-order guarantees in centralized, federated and decentralized nonconvex optimization

Adaptive Gradient Descent without Descent

Universal and adaptive methods for robust stochastic optimization

Stochastic Second-Order Methods Improve Best-Known Sample Complexity of SGD for Gradient-Dominated Function

Momentum-Based Policy Gradient with Second-Order Information

Adaptation in Stochastic Algorithms: From Nonsmooth Optimization to Min-Max Problems and Beyond

Large Steps in Inverse Rendering of Geometry

Adaptive Gradient Descent without Descent

The role of PDE-based parameterization techniques in gradient-based IGA shape optimization applications

Second-order guarantees in centralized, federated and decentralized nonconvex optimization

Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networks

Regret Minimization in Stochastic Non-Convex Learning via a Proximal-Gradient Approach