Francesco Spadaro | EPFL Graph Search

Complex Analysis meets Statistical Mechanics: Applications to Kernel Methods and Conformal Field Theory

This thesis is centered on questions coming from Machine Learning (ML) and Statistical Field Theory (SFT).In Machine Learning, we consider the subfield of Supervised Learning (SL), and in particular regression tasks where one tries to find a regressor that ...

EPFL2021

Geometry of the Loss Landscape in Overparameterized Neural Networks: Symmetries and Invariances

Wulfram Gerstner, Clément Hongler, Johanni Michael Brea, Francesco Spadaro, Berfin Simsek, Arthur Jacot

We study how permutation symmetries in overparameterized multi-layer neural networks generate `symmetry-induced' critical points. Assuming a network with

L

layers of minimal widths

r_1^*, \ldots, r_{L-1}^*

reaches a zero-loss minimum at $ r_1^*! \c ...

2021

We consider several aspects of conjugating symmetry methods, including the method of invariants, with an asymptotic approach. In particular we consider how to extend to the stochastic setting several ideas which are well established in the deterministic on ...

AMER INST MATHEMATICAL SCIENCES-AIMS2021