On the Double Descent of Random Features Models Trained with SGD

Related publications (30)

About
Privacy
Disclaimer

Graph Chatbot

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Scott William Pesme

In this PhD manuscript, we explore optimisation phenomena which occur in complex neural networks through the lens of

2

-layer diagonal linear networks. This rudimentary architecture, which consists of a two layer feedforward linear network with a diagonal ...

EPFL2024

Quantifying the Unknown: Data-Driven Approaches and Applications in Energy Systems

Paul Scharnhorst

In light of the challenges posed by climate change and the goals of the Paris Agreement, electricity generation is shifting to a more renewable and decentralized pattern, while the operation of systems like buildings is increasingly electrified. This calls ...

EPFL2024

Topics in statistical physics of high-dimensional machine learning

Hugo Chao Cui

In the past few years, Machine Learning (ML) techniques have ushered in a paradigm shift, allowing the harnessing of ever more abundant sources of data to automate complex tasks. The technical workhorse behind these important breakthroughs arguably lies in ...

EPFL2024

An immersive virtual reality tool for assessing left and right unilateral spatial neglect

Olaf Blanke, Andrea Serino, Roberta Ronchi

The reported rate of the occurrence of unilateral spatial neglect (USN) is highly variable likely due to the lack of validity and low sensitivity of classical tools used to assess it. Virtual reality (VR) assessments try to overcome these limitations by pr ...

Wiley2024

Social Opinion Formation and Decision Making Under Communication Trends

Ali H. Sayed, Virginia Bordignon, Mert Kayaalp

This work studies the learning process over social networks under partial and random information sharing. In traditional social learning models, agents exchange full belief information with each other while trying to infer the true state of nature. We stud ...

Ieee-Inst Electrical Electronics Engineers Inc2024

A state-of-the-art, systematic review of indoor environmental quality studies in work-from-home settings

Giorgia Chinazzo

The COVID-19 pandemic has led to a significant increase in working from home worldwide, making the workfrom-home (WFH) setting a crucial context for studying the influence of indoor environmental quality (IEQ) on workers' well-being and productivity. A nar ...

Pergamon-Elsevier Science Ltd2024

Extensions of Peer Prediction Incentive Mechanisms

Adam Julian Richardson

As large, data-driven artificial intelligence models become ubiquitous, guaranteeing high data quality is imperative for constructing models. Crowdsourcing, community sensing, and data filtering have long been the standard approaches to guaranteeing or imp ...

EPFL2024

Comparison of two methods for bioaerosol sampling and characterization in a low-biomass chamber environment

Dusan Licina, Shen Yang, Marouane Merizak, Akila Muthalagu

Bioaerosols are emitted from various sources into the indoor environment and can positively and negatively impact human health. Humans are the major source of bioaerosol emissions indoors, specifically for bacteria. However, efficient sampling to guarantee ...

PERGAMON-ELSEVIER SCIENCE LTD2023

Identification of typical district configurations: A two-step global sensitivity analysis framework

François Maréchal, Jonas Schnidrig, Cédric Terrier

The recent geopolitical conflicts in Europe highlighted the sensibility of the current energy system to the volatility of energy carrier prices. In the prospect of defining robust energy system configurations to ensure energy supply stability, it is necess ...

2023

Higher Order Asymptotics: Applications to Satellite Conjunction and Boundary Problems

Soumaya Elkantassi

Higher-order asymptotics provide accurate approximations for use in parametric statistical modelling. In this thesis, we investigate using higher-order approximations in two-specific settings, with a particular emphasis on the tangent exponential model. ...

EPFL2023

Page 2 of 3

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Scott William Pesme

In this PhD manuscript, we explore optimisation phenomena which occur in complex neural networks through the lens of

2

-layer diagonal linear networks. This rudimentary architecture, which consists of a two layer feedforward linear network with a diagonal ...

EPFL2024