Publication
Comparing Dynamics: Deep Neural Networks versus Glassy Systems
Publications associées (37)
Random matrix methods for high-dimensional machine learning models
In the rapidly evolving landscape of machine learning research, neural networks stand out with their ever-expanding number of parameters and reliance on increasingly large datasets. The financial cost and computational resources required for the training p ...
EPFL2024Deep Learning Generalization with Limited and Noisy Labels
Deep neural networks have become ubiquitous in today's technological landscape, finding their way in a vast array of applications. Deep supervised learning, which relies on large labeled datasets, has been particularly successful in areas such as image cla ...
EPFL2023Bed Topography Inference from Velocity Field Using Deep Learning.
Christophe Ancey, Mehrdad Kiani Oshtorjani
Measuring bathymetry has always been a major scientific and technological challenge. In this work, we used a deep learning technique for inferring bathymetry from the depth-averaged velocity field. The training of the neural network is based on 5742 labora ...
2023Fundamental Limits in Statistical Learning Problems: Block Models and Neural Networks
This thesis focuses on two selected learning problems: 1) statistical inference on graphs models, and, 2) gradient descent on neural networks, with the common objective of defining and analysing the measures that characterize the fundamental limits.In the ...
EPFL2023DeepBND: A machine learning approach to enhance multiscale solid mechanics
Annalisa Buffa, Simone Deparis, Pablo Antolin Sanchez, Felipe Figueredo Rocha
Effective properties of materials with random heterogeneous structures are typically determined by homogenising the mechanical quantity of interest in a window of observation. The entire problem setting encompasses the solution of a local PDE and some aver ...
2023Leveraging Unlabeled Data to Track Memorization
Patrick Thiran, Mahsa Forouzesh, Hanie Sedghi
Deep neural networks may easily memorize noisy labels present in real-world data, which degrades their ability to generalize. It is therefore important to track and evaluate the robustness of models against noisy label memorization. We propose a metric, ca ...
2023Comparing transferability in neural network approaches and linear models for machine-learning interaction potentials
Atomic simulations using machine learning interatomic potential (MLIP) have gained a lot of popularity owing to their accuracy in comparison to conventional empirical potentials. However, the transferability of MLIP to systems outside the training set pose ...
AMER PHYSICAL SOC2023On the robustness of randomized classifiers to adversarial examples
This paper investigates the theory of robustness against adversarial attacks. We focus on randomized classifiers (i.e. classifiers that output random variables) and provide a thorough analysis of their behavior through the lens of statistical learning theo ...
SPRINGER2022Stop Wasting my FLOPS: Improving the Efficiency of Deep Learning Models
Deep neural networks have completely revolutionized the field of machinelearning by achieving state-of-the-art results on various tasks ranging fromcomputer vision to protein folding. However, their application is hindered bytheir large computational and m ...
EPFL2022Loss landscape and symmetries in Neural Networks
Neural networks (NNs) have been very successful in a variety of tasks ranging from machine translation to image classification. Despite their success, the reasons for their performance are still not well-understood. This thesis explores two main themes: lo ...
EPFL2021