Saddle-to-Saddle Dynamics in Diagonal Linear Networks

Related publications (28)

About
Privacy
Disclaimer

Graph Chatbot

Optimal Rates for Spectral Algorithms with Least-Squares Regression over Hilbert Spaces

In this paper, we study regression problems over a separable Hilbert space with the square loss, covering non-parametric regression over a reproducing kernel Hilbert space. We investigate a class of spectral/regularized algorithms, including ridge regressi ...

2020

CoCoA: A General Framework for Communication-Efficient Distributed Optimization

Martin Jaggi, Chenxin Ma

The scale of modern datasets necessitates the development of efficient distributed optimization methods for machine learning. We present a general-purpose framework for distributed computing environments, CoCoA, that has an efficient communication scheme a ...

2018

A Least-Squares/Relaxation Method for the Numerical Solution of the Three-Dimensional Elliptic Monge-Ampere Equation

Alexandre Caboussat, Dimitrios Gourzoulidis

In this article, we address the numerical solution of the Dirichlet problem for the three-dimensional elliptic Monge-Ampere equation using a least-squares/relaxation approach. The relaxation algorithm allows the decoupling of the differential operators fro ...

SPRINGER/PLENUM PUBLISHERS2018

A Distributed Second-Order Algorithm You Can Trust

Martin Jaggi, Aurélien Lucchi, Thomas Hofmann, Matilde Gargiani

Due to the rapid growth of data and computational resources, distributed optimization has become an active research area in recent years. While first-order methods seem to dominate the field, second-order methods are nevertheless attractive as they potenti ...

2018

Learning Proximal Operators with Gaussian Processes

Colin Neil Jones, Georgios Stathopoulos, Xuan Truong Nghiem

Several distributed-optimization setups involve a group of agents coordinated by a central entity (coordinator), altogether operating in a collaborative framework. In such environments, it is often common that the agents solve proximal minimization problem ...

IEEE2018

A coordinator-driven communication reduction scheme for distributed optimization using the projected gradient method

Colin Neil Jones, Georgios Stathopoulos

We propose a way to estimate the value function of a convex proximal minimization problem. The scheme constructs a convex set within which the optimizer resides and iteratively refines the set every time that the value function is sampled, namely every tim ...

2018

3D Reconstruction of Optical Diffraction Tomography Based on a Neural Network Model

Morteza Hasani Shoreh

Optical tomography has been widely investigated for biomedical imaging applications. In recent years, it has been combined with digital holography and has been employed to produce high quality images of phase objects such as cells. In this Thesis, we look ...

EPFL2018

Chemical machine learning with kernels: The key impact of loss functions

Volkan Cevher, Sandip De, Junhong Lin, Van Quang Nguyen

Machine learning promises to accelerate materials discovery by allowing computational efficient property predictions from a small number of reference calculations. As a result, the literature spent a considerable effort in designing representations that ca ...

2018

Page 3 of 3