Publications related to Been There, Done That: What Your Mobility Traces Reveal about Your Behavior

Generalization of Scaled Deep ResNets in the Mean-Field Regime

Volkan Cevher, Grigorios Chrysos, Fanghui Liu

Despite the widespread empirical success of ResNet, the generalization properties of deep ResNet are rarely explored beyond the lazy training regime. In this work, we investigate scaled ResNet in the limit of infinitely deep and wide neural networks, of wh ...

2024

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Scott William Pesme

In this PhD manuscript, we explore optimisation phenomena which occur in complex neural networks through the lens of

2

-layer diagonal linear networks. This rudimentary architecture, which consists of a two layer feedforward linear network with a diagonal ...

EPFL2024

Mitigating Object Dependencies: Improving Point Cloud Self-Supervised Learning through Object Exchange

Sabine Süsstrunk, Mathieu Salzmann, Tong Zhang, Yi Wu

In the realm of point cloud scene understanding, particularly in indoor scenes, objects are arranged following human habits, resulting in objects of certain semantics being closely positioned and displaying notable inter-object correlations. This can creat ...

2024

Sparse autoregressive neural networks for classical spin systems

Giuseppe Carleo, Dian Wu, Indaco Biazzo

Efficient sampling and approximation of Boltzmann distributions involving large sets of binary variables, or spins, are pivotal in diverse scientific fields even beyond physics. Recent advances in generative neural networks have significantly impacted this ...

Iop Publishing Ltd2024

Fast adaptation to rule switching using neuronal surprise

Wulfram Gerstner

In humans and animals, surprise is a physiological reaction to an unexpected event, but how surprise can be linked to plausible models of neuronal activity is an open problem. We propose a self-supervised spiking neural network model where a surprise signa ...

2024

Topics in statistical physics of high-dimensional machine learning

Hugo Chao Cui

In the past few years, Machine Learning (ML) techniques have ushered in a paradigm shift, allowing the harnessing of ever more abundant sources of data to automate complex tasks. The technical workhorse behind these important breakthroughs arguably lies in ...

EPFL2024

Driving and suppressing the human language network using large language models

Martin Schrimpf

Transformer models such as GPT generate human-like language and are predictive of human brain responses to language. Here, using functional-MRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict t ...

Berlin2024

Optimizing Dynamic Aperture Studies with Active Learning

Tatiana Pieloni, Ekaterina Krymova, Davide Di Croce, Massimo Giovannozzi

Dynamic aperture is an important concept for the study of non-linear beam dynamics in circular accelerators. It describes the extent of the phase-space region where a particle's motion remains bounded over a given number of turns. Understanding the feature ...

2024

Incorporating Projective Geometry into Deep Learning

Michal Jan Tyszkiewicz

In this thesis we explore the applications of projective geometry, a mathematical theory of the relation between 3D scenes and their 2D images, in modern learning-based computer vision systems. This is an interesting research question which contradicts the ...

EPFL2024

The neural correlates of topographical disorientation-a lesion analysis study

Olaf Blanke, Lukas Heydrich, Eva Blondiaux

Topographical disorientation refers to the selective inability to orient oneself in familiar surroundings. However, to date its neural correlates remain poorly understood. Here we use quantitative lesion analysis and a lesion network mapping approach in or ...

Hoboken2024

Been There, Done That: What Your Mobility Traces Reveal about Your Behavior

Graph Chatbot

Chat with Graph Search

Generalization of Scaled Deep ResNets in the Mean-Field Regime

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Mitigating Object Dependencies: Improving Point Cloud Self-Supervised Learning through Object Exchange

Sparse autoregressive neural networks for classical spin systems

Fast adaptation to rule switching using neuronal surprise

Topics in statistical physics of high-dimensional machine learning

Driving and suppressing the human language network using large language models

Optimizing Dynamic Aperture Studies with Active Learning

Incorporating Projective Geometry into Deep Learning

The neural correlates of topographical disorientation-a lesion analysis study

Generalization of Scaled Deep ResNets in the Mean-Field Regime

Mitigating Object Dependencies: Improving Point Cloud Self-Supervised Learning through Object Exchange

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Driving and suppressing the human language network using large language models

Topics in statistical physics of high-dimensional machine learning

Sparse autoregressive neural networks for classical spin systems

Fast adaptation to rule switching using neuronal surprise

Incorporating Projective Geometry into Deep Learning

Optimizing Dynamic Aperture Studies with Active Learning

The neural correlates of topographical disorientation-a lesion analysis study