Highway network

Publications associées (28)

À propos
Confidentialité
Mentions légales

Graph Chatbot

On the Loss Landscape of Adversarial Training: Identifying Challenges and How to Overcome Them

Sabine Süsstrunk, Mathieu Salzmann, Tao Lin, Chen Liu

We analyze the influence of adversarial training on the loss landscape of machine learning models. To this end, we first provide analytical studies of the properties of adversarial loss functions under different adversarial budgets. We then demonstrate tha ...

2021

Pretraining boosts out-of-domain robustness for pose estimation

Alexander Mathis, Mackenzie Mathis, Steffen Schneider, Matthias Bethge, Thomas Ray Biasi, Mert Yüksekgönül

Neural networks are highly effective tools for pose estimation. However, as in other computer vision tasks, robustness to out-of-domain data remains a challenge, especially for small training sets that are common for real-world applications. Here, we probe ...

IEEE COMPUTER SOC2021

Masksembles for Uncertainty Estimation

Pascal Fua, Pierre Bruno Baqué, Nikita Durasov, Timur Bagautdinov

Deep neural networks have amply demonstrated their prowess but estimating the reliability of their predictions remains challenging. Deep Ensembles are widely considered as being one of the best methods for generating uncertainty estimates but are very expe ...

2021

Automated Essay Scoring in Foreign Language Students Based on Deep Contextualised Word Representations

Martin Jaggi, Bojana Rankovic

We introduce a method for automated grading of handwritten essays written by foreign language learners of French. The handwriting recognition system allows digitising the essays for further processing and functions at a low character error rate. The transc ...

2020

Deep learning-based BCI for gait decoding from EEG with LSTM recurrent neural network

Silvestro Micera, Fiorenzo Artoni, Stefano Tortora

Objective.Mobile Brain/Body Imaging (MoBI) frameworks allowed the research community to find evidence of cortical involvement at walking initiation and during locomotion. However, the decoding of gait patterns from brain signals remains an open challenge. ...

IOP PUBLISHING LTD2020

Towards Real-World Super-Resolution using Deep Neural Networks

Ruofan Zhou

Image super-resolution reconstructs a higher-resolution image from the observed low-resolution image. In recent years, machine learning models have been widely employed and deep learning networks have achieved state-of-the-art super-resolution performance. ...

EPFL2020

Model Fusion via Optimal Transport

Martin Jaggi, Sidak Pal Singh

Combining different models is a widely used paradigm in machine learning applications. While the most common approach is to form an ensemble of models and average their individual predictions, this approach is often rendered infeasible by given resource co ...

2020

Crowding and the Architecture of the Visual System

Adrien Christophe Doerig

Classically, vision is seen as a cascade of local, feedforward computations. This framework has been tremendously successful, inspiring a wide range of ground-breaking findings in neuroscience and computer vision. Recently, feedforward Convolutional Neural ...

EPFL2020

Spiking Neural Networks Trained With Backpropagation For Low Power Neuromorphic Implementation Of Voice Activity Detection

Milos Cernak, Giorgia Dellaferrera

Recent advances in Voice Activity Detection (VAD) are driven by artificial and Recurrent Neural Networks (RNNs), however, using a VAD system in battery-operated devices requires further power efficiency. This can be achieved by neuromorphic hardware, which ...

IEEE2020

Short-term energy use prediction of solar-assisted water heating system: Application case of combined attention-based LSTM and time-series decomposition

Dolaana Khovalyg, Amirreza Heidari

With improved insulation of building envelopes and the use of low-temperature space heating systems, the share of energy use for domestic hot water (DHW) production in buildings has increased significantly, and nearly become the most energy-expensive servi ...

2020

Page 2 sur 3

Spiking Neural Networks Trained With Backpropagation For Low Power Neuromorphic Implementation Of Voice Activity Detection

Milos Cernak, Giorgia Dellaferrera

IEEE2020

Short-term energy use prediction of solar-assisted water heating system: Application case of combined attention-based LSTM and time-series decomposition

Dolaana Khovalyg, Amirreza Heidari

2020