Publication

Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networks

Related publications (78)

About
Privacy
Disclaimer

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networks

Graph Chatbot

Chat with Graph Search

Complex Dynamics in Simple Neural Networks: Understanding Gradient Flow in Phase Retrieval

A jamming transition from under- to over-parametrization affects generalization in deep learning

Jamming transition as a paradigm to understand the loss landscape of deep neural networks

Diffusion Learning In Non-Convex Environments

Local SGD Converges Fast and Communicates Little

Shape optimisation of technical devices via gradient descent using convolutional neural network proxies

Polynomial Escape-Time From Saddle Points In Distributed Non-Convex Optimization

The committee machine: Computational to statistical gaps in learning a two-layers neural network

Neural Tanget Kernel: Convergence and Generalization in Neural Networks

SLANG: Fast Structured Covariance Approximations for Bayesian Deep Learning with Natural Gradient