Publications related to Artificial neural networks

Aggregating Spatial and Photometric Context for Photometric Stereo

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Robust machine learning for neuroscientific inference

Steffen Schneider

Modern neuroscience research is generating increasingly large datasets, from recording thousands of neurons over long timescales to behavioral recordings of animals spanning weeks, months, or even years. Despite a great variety in recording setups and expe ...

EPFL2024

Robust NAS under adversarial training: benchmark, theory, and beyond

Volkan Cevher, Grigorios Chrysos, Fanghui Liu, Yongtao Wu

Recent developments in neural architecture search (NAS) emphasize the significance of considering robust architectures against malicious data. However, there is a notable absence of benchmark evaluations and theoretical guarantees for searching these robus ...

2024

MaskCLR: Attention-Guided Contrastive Learning for Robust Action Representation Learning

Alexandre Massoud Alahi, Mohamed Ossama Ahmed Abdelfattah, Mariam Ahmed Mahmoud Hegazy Hassan

Current transformer-based skeletal action recognition models tend to focus on a limited set of joints and low-level motion patterns to predict action classes. This results in significant performance degradation under small skeleton perturbations or changin ...

2024

Explainable Fault Diagnosis of Oil-Immersed Transformers: A Glass-Box Model

Yi Zhang, Wenlong Liao, Zhe Yang

Recently, remarkable progress has been made in the application of machine learning (ML) techniques (e.g., neural networks) to transformer fault diagnosis. However, the diagnostic processes employed by these techniques often suffer from a lack of interpreta ...

Piscataway2024

Task-driven neural network models predict neural dynamics of proprioception: Neural network model weights

Alexander Mathis, Alberto Silvio Chiappa, Alessandro Marin Vargas, Axel Bisi

Proprioception tells the brain the state of the body based on distributed sensors in the body. However, the principles that govern proprioceptive processing from those distributed sensors are poorly understood. Here, we employ a task-driven neural network ...

EPFL Infoscience2024

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks

Nicolas Henri Bernard Flammarion, Hristo Georgiev Papazov, Scott William Pesme

In this work, we investigate the effect of momentum on the optimisation trajectory of gradient descent. We leverage a continuous-time approach in the analysis of momentum gradient descent with step size

\gamma

and momentum parameter

\beta

that allows u ...

2024

Residual-based attention in physics-informed neural networks

Nikolaos Stergiopoulos, Sokratis Anagnostopoulos

Driven by the need for more efficient and seamless integration of physical models and data, physics -informed neural networks (PINNs) have seen a surge of interest in recent years. However, ensuring the reliability of their convergence and accuracy remains ...

Lausanne2024

Reduced Training Data for Laser Ultrasound Signal Interpretation by Neural Networks

Romain Christophe Rémy Fleury, Janez Rus

The performance of machine learning algorithms is conditioned by the availability of training datasets, which is especially true for the field of nondestructive evaluation. Here we propose one reconfigurable specimen instead of numerous reference specimens ...

2024

Few-shot Learning for Efficient and Effective Machine Learning Model Adaptation

Arnout Jan J Devos

Machine learning (ML) enables artificial intelligent (AI) agents to learn autonomously from data obtained from their environment to perform tasks. Modern ML systems have proven to be extremely effective, reaching or even exceeding human intelligence.Althou ...

EPFL2024

Artificial neural networks

Graph Chatbot

Chat with Graph Search

Aggregating Spatial and Photometric Context for Photometric Stereo

Robust machine learning for neuroscientific inference

Robust NAS under adversarial training: benchmark, theory, and beyond

MaskCLR: Attention-Guided Contrastive Learning for Robust Action Representation Learning

Explainable Fault Diagnosis of Oil-Immersed Transformers: A Glass-Box Model

Task-driven neural network models predict neural dynamics of proprioception: Neural network model weights

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks

Residual-based attention in physics-informed neural networks

Reduced Training Data for Laser Ultrasound Signal Interpretation by Neural Networks

Few-shot Learning for Efficient and Effective Machine Learning Model Adaptation

Aggregating Spatial and Photometric Context for Photometric Stereo

Robust machine learning for neuroscientific inference

Task-driven neural network models predict neural dynamics of proprioception: Neural network model weights

Robust NAS under adversarial training: benchmark, theory, and beyond

MaskCLR: Attention-Guided Contrastive Learning for Robust Action Representation Learning

Explainable Fault Diagnosis of Oil-Immersed Transformers: A Glass-Box Model

Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks

Residual-based attention in physics-informed neural networks

Few-shot Learning for Efficient and Effective Machine Learning Model Adaptation

Reduced Training Data for Laser Ultrasound Signal Interpretation by Neural Networks