Publications related to Long short-term memory

Learning Trajectory Dependencies for Human Motion Prediction

Human motion prediction, i.e., forecasting future body poses given observed pose sequence, has typically been tackled with recurrent neural networks (RNNs). However, as evidenced by prior work, the resulted RNN models suffer from prediction errors accumula ...

IEEE2019

End-to-End Acoustic Modeling using Convolutional Neural Networks for HMM-based Automatic Speech Recognition

Ronan Collobert, Dimitri Palaz

In hidden Markov model (HMM) based automatic speech recognition (ASR) system, modeling the statistical relationship between the acoustic speech signal and the HMM states that represent linguistically motivated subword units such as phonemes is a crucial st ...

ELSEVIER SCIENCE BV2019

Overcoming Multi-model Forgetting

Mathieu Salzmann, Anthony Christopher Davison, Martin Jaggi, Yassine Benyahia, Claudiu-Cristian Musat, Kaicheng Yu

We identify a phenomenon, which we refer to as multi-model forgetting, that occurs when sequentially training multiple deep networks with partially-shared parameters; the performance of previously-trained models degrades as one optimizes a subsequent one, ...

JMLR2019

Robust Recovery of Temporal Overlap Between Network Activity Using Transient-Informed Spatio-Temporal Regression

Dimitri Nestor Alice Van De Ville, Thomas William Arthur Bolton, Marie Schaer, Fikret Isik Karahanoglu, Daniela Maria Zöller

Functional magnetic resonance imaging is a non-invasive tomographic imaging modality that has provided insights into system-level brain function. New analysis methods are emerging to study the dynamic behavior of brain activity. The innovation-driven co-ac ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2019

CONTEXT-AWARE ATTENTION MECHANISM FOR SPEECH EMOTION RECOGNITION

Philip Neil Garner, Gaétan Ramet

In this work, we study the use of attention mechanisms to enhance the performance of the state-of-the-art deep learning model in Speech Emotion Recognition (SER). We introduce a new Long Short-Term Memory (LSTM)-based neural network attention model which i ...

IEEE2018

Cross-lingual Adaptation of a CTC-based multilingual Acoustic Model

Hervé Bourlard, Philip Neil Garner, Sibo Tong

Multilingual models for Automatic Speech Recognition (ASR) are attractive as they have been shown to benefit from more training data, and better lend themselves to adaptation to under-resourced languages. However, initialisation from monolingual context-de ...

ELSEVIER SCIENCE BV2018

Fast Language Adaptation Using Phonological Information

Hervé Bourlard, Philip Neil Garner, Sibo Tong

Phoneme-based multilingual connectionist temporal classification (CTC) model is easily extensible to a new language by concatenating parameters of the new phonemes to the output layer. In the present paper, we improve cross-lingual adaptation in the contex ...

ISCA-INT SPEECH COMMUNICATION ASSOC2018

SLANG: Fast Structured Covariance Approximations for Bayesian Deep Learning with Natural Gradient

Mohammad Emtiyaz Khan

Uncertainty estimation in large deep-learning models is a computationally challenging task, where it is difficult to form even a Gaussian approximation to the posterior distribution. In such situations, existing methods usually resort to a diagonal approxi ...

NEURAL INFORMATION PROCESSING SYSTEMS (NIPS)2018

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Long short-term memory

Learning Trajectory Dependencies for Human Motion Prediction

Learning agile and dynamic motor skills for legged robots

End-to-End Acoustic Modeling using Convolutional Neural Networks for HMM-based Automatic Speech Recognition

Overcoming Multi-model Forgetting

Robust Recovery of Temporal Overlap Between Network Activity Using Transient-Informed Spatio-Temporal Regression

Trustworthy speaker recognition with minimal prior knowledge using neural networks

CONTEXT-AWARE ATTENTION MECHANISM FOR SPEECH EMOTION RECOGNITION

Cross-lingual Adaptation of a CTC-based multilingual Acoustic Model

Fast Language Adaptation Using Phonological Information

SLANG: Fast Structured Covariance Approximations for Bayesian Deep Learning with Natural Gradient

Graph Chatbot

Chat with Graph Search

Overcoming Multi-model Forgetting

Robust Recovery of Temporal Overlap Between Network Activity Using Transient-Informed Spatio-Temporal Regression

Trustworthy speaker recognition with minimal prior knowledge using neural networks

CONTEXT-AWARE ATTENTION MECHANISM FOR SPEECH EMOTION RECOGNITION

Cross-lingual Adaptation of a CTC-based multilingual Acoustic Model

Fast Language Adaptation Using Phonological Information

SLANG: Fast Structured Covariance Approximations for Bayesian Deep Learning with Natural Gradient

Learning agile and dynamic motor skills for legged robots

End-to-End Acoustic Modeling using Convolutional Neural Networks for HMM-based Automatic Speech Recognition

Learning Trajectory Dependencies for Human Motion Prediction