Publications related to An exact mapping from ReLU networks to spiking neural networks

Exponential Pattern Retrieval Capacity with Non-Binary Associative Memory

Mohammad Amin Shokrollahi, Krishna Kumar, Amir Hesam Salavati

We consider the problem of neural association for a network of non-binary neurons. Here, the task is to recall a previously memorized pattern from its noisy version using a network of neurons whose states assume values from a finite number of non-negative ...

Ieee Service Center, 445 Hoes Lane, Po Box 1331, Piscataway, Nj 08855-1331 Usa2011

Analysis of MLP Based Hierarchical Phoneme Posterior Probability Estimator

Hervé Bourlard, Hynek Hermansky, Joel Praveen Pinto

We analyze a simple hierarchical architecture consisting of two multilayer perceptron (MLP) classifiers in tandem to estimate the phonetic class conditional probabilities. In this hierarchical setup, the first MLP classifier is trained using standard acous ...

2010

Reservoir optimization in recurrent neural networks using properties of Kronecker product

Martin Hasler, Ali Ajdari Rad, Mahdi Jalili

Recurrent neural networks based on reservoir computing are increasingly being used in many applications. Optimization of the topological structure of the reservoir and the internal connection weights for a given task is one of the most important problems i ...

2010

Culture, gaze and the neural processing of fear expressions

Nouchine Hadjikhani

The direction of others' eye gaze has important influences on how we perceive their emotional expressions. Here, we examined differences in neural activation to direct-versus averted-gaze fear faces as a function of culture of the participant (Japanese ver ...

2010

Hierarchical Tandem Features for ASR in Mandarin

Hervé Bourlard, Joel Praveen Pinto

We apply multilayer perceptron (MLP) based hierarchical Tandem features to large vocabulary continuous speech recognition in Mandarin. Hierarchical Tandem features are estimated using a cascade of two MLP classifiers which are trained independently. The fi ...

Idiap2010

Network Simplification: the Gaussian N-Relay Diamond Network

Christina Fragouli, Ayfer Özgür Aydin

We consider the Gaussian

N

-relay diamond network, where a source wants to communicate to a destination through a layer of

N

-relay nodes. We investigate the following question: What fraction of the capacity can we maintain by using only

k

out of the $ ...

2010

Reaction Enthalpies Using the Neural-Network-Based X1 Approach: The Important Choice of Input Descriptors

Matthew Wodrich

Artificial neural networks represent a simple but efficient way to model and correct known errors existing between commonly used density functional computations and experimental data. The recently proposed X1 approach combines B3LYP energies with a neural- ...

2009

MLP Based Hierarchical System for Task Adaptation in ASR

Hervé Bourlard, Joel Praveen Pinto

We investigate a multilayer perceptron (MLP) based hierarchical approach for task adaptation in automatic speech recognition. The system consists of two MLP classifiers in tandem. A well-trained MLP available off-the-shelf is used at the first stage of the ...

2009

A Data-driven Approach to Speech/Non-speech Detection

Hynek Hermansky, Sree Hari Krishnan Parthasarathi

We present a data-driven approach to weighting the temporal context of signal energy to be used in a simple speech/non-speech detector (SND). The optimal weights are obtained using linear discriminant analysis (LDA). Regularization is performed to handle n ...

IDIAP2008

An oscillatory neuromotor model of handwriting generation

A neuromotor model of handwritten stroke generation, in which stroke velocities are expressed as a Fourier-style decomposition of oscillatory neural activities, is presented. The neural network architecture consists of an input or stroke-selection layer, a ...

Springer Verlag2007

An exact mapping from ReLU networks to spiking neural networks

Graph Chatbot

Chat with Graph Search

Exponential Pattern Retrieval Capacity with Non-Binary Associative Memory

Analysis of MLP Based Hierarchical Phoneme Posterior Probability Estimator

Reservoir optimization in recurrent neural networks using properties of Kronecker product

Culture, gaze and the neural processing of fear expressions

Hierarchical Tandem Features for ASR in Mandarin

Network Simplification: the Gaussian N-Relay Diamond Network

Reaction Enthalpies Using the Neural-Network-Based X1 Approach: The Important Choice of Input Descriptors

MLP Based Hierarchical System for Task Adaptation in ASR

A Data-driven Approach to Speech/Non-speech Detection

An oscillatory neuromotor model of handwriting generation

Reservoir optimization in recurrent neural networks using properties of Kronecker product

Exponential Pattern Retrieval Capacity with Non-Binary Associative Memory

Analysis of MLP Based Hierarchical Phoneme Posterior Probability Estimator

Hierarchical Tandem Features for ASR in Mandarin

Culture, gaze and the neural processing of fear expressions

Network Simplification: the Gaussian N-Relay Diamond Network

Reaction Enthalpies Using the Neural-Network-Based X1 Approach: The Important Choice of Input Descriptors

An oscillatory neuromotor model of handwriting generation

A Data-driven Approach to Speech/Non-speech Detection

MLP Based Hierarchical System for Task Adaptation in ASR