Publications related to Optimization framework for calibration of constitutive models enhanced by neural networks

Deep Learning Theory Through the Lens of Diagonal Linear Networks

In this PhD manuscript, we explore optimisation phenomena which occur in complex neural networks through the lens of

2

-layer diagonal linear networks. This rudimentary architecture, which consists of a two layer feedforward linear network with a diagonal ...

EPFL2024

Task-driven neural network models predict neural dynamics of proprioception: Experimental data, activations and predictions of neural network models

Alexander Mathis, Alberto Silvio Chiappa, Alessandro Marin Vargas, Axel Bisi

Here we provide the neural data, activation and predictions for the best models and result dataframes of our article "Task-driven neural network models predict neural dynamics of proprioception". It contains the behavioral and neural experimental data (cu ...

EPFL Infoscience2024

Privacy-preserving federated neural network training and inference

Sinem Sav

Training accurate and robust machine learning models requires a large amount of data that is usually scattered across data silos. Sharing, transferring, and centralizing the data from silos, however, is difficult due to current privacy regulations (e.g., H ...

EPFL2023

Autoencoders reloaded

Hervé Bourlard, Selen Hande Kabil

In Bourlard and Kamp (Biol Cybern 59(4):291-294, 1998), it was theoretically proven that autoencoders (AE) with single hidden layer (previously called "auto-associative multilayer perceptrons") were, in the best case, implementing singular value decomposit ...

SPRINGER2022

Financial Risk Management with Machine Learning

Marc-Aurèle Antoine Divernois

This thesis consists of three applications of machine learning techniques to risk management. The first chapter proposes a deep learning approach to estimate physical forward default intensities of companies. Default probabilities are computed using artifi ...

EPFL2022

Extrapolation and Spectral Bias of Neural Nets with Hadamard Product: a Polynomial Net Study

Volkan Cevher, Grigorios Chrysos, Fanghui Liu, Zhenyu Zhu, Yongtao Wu

Neural tangent kernel (NTK) is a powerful tool to analyze training dynamics of neural networks and their generalization bounds. The study on NTK has been devoted to typical neural network architectures, but it is incomplete for neural networks with Hadamar ...

2022

Predicting in Uncertain Environments: Methods for Robust Machine Learning

Paul Thierry Yves Rolland

One of the main goal of Artificial Intelligence is to develop models capable of providing valuable predictions in real-world environments. In particular, Machine Learning (ML) seeks to design such models by learning from examples coming from this same envi ...

EPFL2022

The spectral bias of polynomial neural networks

Volkan Cevher, Grigorios Chrysos, Leello Tadesse Dadi, Moulik Choraria

Polynomial neural networks (PNNs) have been recently shown to be particularly effective at image generation and face recognition, where high-frequency information is critical. Previous studies have revealed that neural networks demonstrate a spectral bias ...

2022

Discovery of slow variables in a class of multiscale stochastic systems via neural networks

Jan Sickmann Hesthaven, Przemyslaw Zielinski

Finding a reduction of complex, high-dimensional dynamics to its essential, low-dimensional "heart" remains a challenging yet necessary prerequisite for designing efficient numerical approaches. Machine learning methods have the potential to provide a gene ...

2021

Neural Tangent Kernel: Convergence and Generalization in Neural Networks (Invited Paper)

Clément Hongler, Franck Raymond Gabriel, Arthur Jacot

The Neural Tangent Kernel is a new way to understand the gradient descent in deep neural networks, connecting them with kernel methods. In this talk, I'll introduce this formalism and give a number of results on the Neural Tangent Kernel and explain how th ...

ASSOC COMPUTING MACHINERY2021

Optimization framework for calibration of constitutive models enhanced by neural networks

Graph Chatbot

Chat with Graph Search

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Task-driven neural network models predict neural dynamics of proprioception: Experimental data, activations and predictions of neural network models

Privacy-preserving federated neural network training and inference

Autoencoders reloaded

Financial Risk Management with Machine Learning

Extrapolation and Spectral Bias of Neural Nets with Hadamard Product: a Polynomial Net Study

Predicting in Uncertain Environments: Methods for Robust Machine Learning

The spectral bias of polynomial neural networks

Discovery of slow variables in a class of multiscale stochastic systems via neural networks

Neural Tangent Kernel: Convergence and Generalization in Neural Networks (Invited Paper)

Privacy-preserving federated neural network training and inference

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Financial Risk Management with Machine Learning

Predicting in Uncertain Environments: Methods for Robust Machine Learning

Neural Tangent Kernel: Convergence and Generalization in Neural Networks (Invited Paper)

Autoencoders reloaded

Extrapolation and Spectral Bias of Neural Nets with Hadamard Product: a Polynomial Net Study

The spectral bias of polynomial neural networks

Discovery of slow variables in a class of multiscale stochastic systems via neural networks

Task-driven neural network models predict neural dynamics of proprioception: Experimental data, activations and predictions of neural network models