Publications related to Residual-based attention in physics-informed neural networks

Deep Learning Theory Through the Lens of Diagonal Linear Networks

In this PhD manuscript, we explore optimisation phenomena which occur in complex neural networks through the lens of

2

-layer diagonal linear networks. This rudimentary architecture, which consists of a two layer feedforward linear network with a diagonal ...

EPFL2024

Few-shot Learning for Efficient and Effective Machine Learning Model Adaptation

Arnout Jan J Devos

Machine learning (ML) enables artificial intelligent (AI) agents to learn autonomously from data obtained from their environment to perform tasks. Modern ML systems have proven to be extremely effective, reaching or even exceeding human intelligence.Althou ...

EPFL2024

Intraday solar irradiance forecasting using public cameras

Demetri Psaltis, Mario Paolone, Christophe Moser, Luisa Lambertini

With the significant increase in photovoltaic (PV) electricity generation, more attention has been given to PV power forecasting. Indeed, accurate forecasting allows power grid operators to better schedule and dispatch their assets, such as energy storage ...

Pergamon-Elsevier Science Ltd2024

Deep learning approach for identification of H II regions during reionization in 21-cm observations - II. Foreground contamination

Jean-Paul Richard Kneib, Emma Elizabeth Tolley, Tianyue Chen, Michele Bianco

The upcoming Square Kilometre Array Observatory will produce images of neutral hydrogen distribution during the epoch of reionization by observing the corresponding 21-cm signal. However, the 21-cm signal will be subject to instrumental limitations such as ...

Oxford Univ Press2024

Statistical Inference for Inverse Problems: From Sparsity-Based Methods to Neural Networks

Pakshal Narendra Bohra

In inverse problems, the task is to reconstruct an unknown signal from its possibly noise-corrupted measurements. Penalized-likelihood-based estimation and Bayesian estimation are two powerful statistical paradigms for the resolution of such problems. They ...

EPFL2024

Performing and Detecting Backdoor Attacks on Face Recognition Algorithms

Alexander Carl Unnervik

The field of biometrics, and especially face recognition, has seen a wide-spread adoption the last few years, from access control on personal devices such as phones and laptops, to automated border controls such as in airports. The stakes are increasingly ...

EPFL2024

MaskCLR: Attention-Guided Contrastive Learning for Robust Action Representation Learning

Alexandre Massoud Alahi, Mohamed Ossama Ahmed Abdelfattah, Mariam Ahmed Mahmoud Hegazy Hassan

Current transformer-based skeletal action recognition models tend to focus on a limited set of joints and low-level motion patterns to predict action classes. This results in significant performance degradation under small skeleton perturbations or changin ...

2024

Advancing Self-Supervised Deep Learning for 3D Scene Understanding

Seyed Mohammad Mahdi Johari

Recent advancements in deep learning have revolutionized 3D computer vision, enabling the extraction of intricate 3D information from 2D images and video sequences. This thesis explores the application of deep learning in three crucial challenges of 3D com ...

EPFL2024

Efficient Continual Finite-Sum Minimization

Volkan Cevher, Efstratios Panteleimon Skoulakis, Leello Tadesse Dadi

Given a sequence of functions

f_1,\ldots,f_n

with

f_i:\mathcal{D}\mapsto \mathbb{R}

, finite-sum minimization seeks a point

{x}^\star \in \mathcal{D}

minimizing

\sum_{j=1}^nf_j(x)/n

. In this work, we propose a key twist into the finite-sum minimizat ...

2024

Digital Twins of Stone Masonry Buildings for Damage Assessment

Katrin Beyer, Radhakrishna Achanta, Bryan German Pantoja Rosero

Digital twins are virtual models of physical objects or systems that enable real-time monitoring and analysis. In the ﬁeld of stone masonry buildings, digital twins can be used to assess damage, predict maintenance needs, and opti- mize building performanc ...

Springer2024

Residual-based attention in physics-informed neural networks

Graph Chatbot

Chat with Graph Search

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Few-shot Learning for Efficient and Effective Machine Learning Model Adaptation

Intraday solar irradiance forecasting using public cameras

Deep learning approach for identification of H II regions during reionization in 21-cm observations - II. Foreground contamination

Statistical Inference for Inverse Problems: From Sparsity-Based Methods to Neural Networks

Performing and Detecting Backdoor Attacks on Face Recognition Algorithms

MaskCLR: Attention-Guided Contrastive Learning for Robust Action Representation Learning

Advancing Self-Supervised Deep Learning for 3D Scene Understanding

Efficient Continual Finite-Sum Minimization

Digital Twins of Stone Masonry Buildings for Damage Assessment

Few-shot Learning for Efficient and Effective Machine Learning Model Adaptation

Intraday solar irradiance forecasting using public cameras

Deep learning approach for identification of H II regions during reionization in 21-cm observations - II. Foreground contamination

Statistical Inference for Inverse Problems: From Sparsity-Based Methods to Neural Networks

Performing and Detecting Backdoor Attacks on Face Recognition Algorithms

Digital Twins of Stone Masonry Buildings for Damage Assessment

MaskCLR: Attention-Guided Contrastive Learning for Robust Action Representation Learning

Advancing Self-Supervised Deep Learning for 3D Scene Understanding

Efficient Continual Finite-Sum Minimization

Deep Learning Theory Through the Lens of Diagonal Linear Networks