Concept

Reservoir computing

Related publications (63)

Adversarial Robustness by Design Through Analog Computing And Synthetic Gradients

Florent Gérard Krzakala, Julien Marcel Daniel Emmanuel Launay, Ruben Elie Ohana

We propose a new defense mechanism against adversarial at-tacks inspired by an optical co-processor, providing robustness without compromising natural accuracy in both white-box and black-box settings. This hardware co-processor performs a nonlinear fixed ...

IEEE2022

Geometry-Aware Deep Recurrent Neural Networks for Hyperspectral Image Classification

Mathieu Salzmann, Wei Wang, Siyuan Hao

Variants of deep networks have been widely used for hyperspectral image (HSI)-classification tasks. Among them, in recent years, recurrent neural networks (RNNs) have attracted considerable attention in the remote sensing community. However, complex geomet ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021

Unraveling brain interactions in vision: the example of crowding

Michael Herzog, Bogdan Draganski, Vitaly Chicherov, Maya Anna Jastrzebowska

In visual crowding, the presence of neighboring elements impedes the perception of a target. Crowding is traditionally explained with feedforward, local models. However, increasing the number of neighboring elements can decrease crowding, i.e., lead to unc ...

2021

Controlling spatiotemporal nonlinearities in multimode fibers with deep neural networks

Demetri Psaltis, Navid Borhani, Eirini Kakkava, Babak Rahmani, Ugur Tegin

Spatiotemporal nonlinear interactions in multimode fibers are of interest for beam shaping and frequency conversion by exploiting the nonlinear interaction of different pump modes from quasi-continuous wave to ultrashort pulses centered around visible to i ...

2020

Reservoir Computing meets Recurrent Kernels and Structured Transforms

Florent Gérard Krzakala, Jonathan Yuelin Dong, Ruben Elie Ohana

Reservoir Computing is a class of simple yet efficient Recurrent Neural Networks where internal weights are fixed at random and only a linear output layer is trained. In the large size limit, such random neural networks have a deep connection with kernel m ...

Curran Associates, Inc.2020

Crowding and the Architecture of the Visual System

Adrien Christophe Doerig

Classically, vision is seen as a cascade of local, feedforward computations. This framework has been tremendously successful, inspiring a wide range of ground-breaking findings in neuroscience and computer vision. Recently, feedforward Convolutional Neural ...

EPFL2020

Capsule networks as recurrent models of grouping and segmentation

Michael Herzog, Adrien Christophe Doerig, Bilge Sayim, Mauro Manassi, Lynn Schmittwilken

Classically, visual processing is described as a cascade of local feedforward computations. Feedforward Convolutional Neural Networks (ffCNNs) have shown how powerful such models can be. However, using visual crowding as a well-controlled challenge, we pre ...

2020

Learning Activation Functions in Deep (Spline) Neural Networks

Michaël Unser, Pakshal Narendra Bohra, Shayan Aziznejad, Harshit Gupta, Joaquim Gonçalves Garcia Barreto Campos

We develop an efficient computational solution to train deep neural networks (DNN) with free-form activation functions. To make the problem well-posed, we augment the cost functional of the DNN by adding an appropriate shape regularization: the sum of the ...

2020

Multilingual Training and Adaptation in Speech Recognition

Sibo Tong

State-of-the-art acoustic models for Automatic Speech Recognition (ASR) are based on Hidden Markov Models (HMM) and Deep Neural Networks (DNN) and often require thousands of hours of transcribed speech data during training. Therefore, building multilingual ...

EPFL2020

Learning from demonstration for semi-autonomous teleoperation

Sylvain Calinon

Teleoperation in domains such as deep-sea or space often requires the completion of a set of recurrent tasks. We present a framework that uses a probabilistic approach to learn from demonstration models of manipulation tasks. We show how such a framework c ...

2019

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.