Publication

Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention

Related publications (58)

About
Privacy
Disclaimer

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention

Graph Chatbot

Chat with Graph Search

CNN based Query by Example Spoken Term Detection

CONTEXT-AWARE ATTENTION MECHANISM FOR SPEECH EMOTION RECOGNITION

Eigendecomposition-free Training of Deep Networks with Zero Eigenvalue-based Losses

Convergence of the Exponentiated Gradient Method with Armijo Line Search

Learning to Find Good Correspondences

Learning to Find Good Correspondences

Evaluating Attention Networks for Anaphora Resolution

Redundant Hash Addressing for Large-Scale Query by Example Spoken Query Detection

Recurrent Attention Models for Depth-Based Person Identification

Parallel algorithms for tensor completion in the CP format

Eigendecomposition-free Training of Deep Networks with Zero Eigenvalue-based Losses

CNN based Query by Example Spoken Term Detection

CONTEXT-AWARE ATTENTION MECHANISM FOR SPEECH EMOTION RECOGNITION

Parallel algorithms for tensor completion in the CP format

Learning to Find Good Correspondences

Redundant Hash Addressing for Large-Scale Query by Example Spoken Query Detection

Recurrent Attention Models for Depth-Based Person Identification

Convergence of the Exponentiated Gradient Method with Armijo Line Search

Learning to Find Good Correspondences

Evaluating Attention Networks for Anaphora Resolution