Publications associées à Efficient Transformer-Based Speech Recognition

Linear Complexity Self-Attention With 3rd Order Polynomials

Self-attention mechanisms and non-local blocks have become crucial building blocks for state-of-the-art neural architectures thanks to their unparalleled ability in capturing long-range dependencies in the input. However their cost is quadratic with the nu ...

Los Alamitos2023

Stop Pre-Training: Adapt Visual-Language Models to Unseen Languages

Karl Aberer, Rémi Philippe Lebret, Negar Foroutan Eghlidi

Vision-Language Pre-training (VLP) has advanced the performance of many visionlanguage tasks, such as image-text retrieval, visual entailment, and visual reasoning. The pre-training mostly utilizes lexical databases and image queries in English. Previous w ...

Assoc Computational Linguistics-Acl2023

Robust direct acoustic impedance control using two microphones for mixed feedforward-feedback controller

Hervé Lissek, Maxime Volery, Xinxin Guo

This paper presents an acoustic impedance control architecture for an electroacoustic absorber combining both feedforward and feedback microphone-based strategies on a current-driven loudspeaker. Feedforward systems enable good performance for direct imped ...

EDP SCIENCES S A2023

Detection of Settlements in Tanzania and Mozambique by Many Regional Few-Shot Models

Devis Tuia, Marc Conrad Russwurm, Lloyd Haydn Hughes

In this work, we propose an approach to aid in mapping small settlements, which are often misclassified by models trained on a large-scale context (global or regional). We leverage pre-trained land cover models and few-shot learning to enhance the detectio ...

2023

Global information processing in feedforward deep networks

Michael Herzog, Ben Henrik Lönnqvist, Adrien Christophe Doerig, Alban Bornet

While deep neural networks are state-of-the-art models of many parts of the human visual system, here we show that they fail to process global information in a humanlike manner. First, using visual crowding as a probe into global visual information process ...

2022

Language Transformers for Remote Sensing Visual Question Answering

Devis Tuia, Sylvain Lobry, Christel Marie Tartini-Chappuis, Vincent Alexandre Mendez

Remote sensing visual question answering (RSVQA) opens new avenues to promote the use of satellites data, by interfacing satellite image analysis with natural language processing. Capitalizing on the remarkable advances in natural language processing and c ...

2022

Generalization of an Encoder-Decoder LSTM model for flood prediction in ungauged catchments

Olga Fink, Yi Zhang, Peter Molnar, Silvan Ragettli

Flood prediction in ungauged catchments is usually conducted by hydrological models that are parameterized based on nearby and similar gauged catchments. As an alternative to this process-based modelling, deep learning (DL) models have demonstrated their a ...

ELSEVIER2022

RayTran: 3D Pose Estimation and Shape Reconstruction of Multiple Objects from Videos with Ray-Traced Transformers

Michal Jan Tyszkiewicz, Vittorio Ferrari, Kevis-Kokitsi Maninis

We propose a transformer-based neural network architecture for multi-object 3D reconstruction from RGB videos. It relies on two alternative ways to represent its knowledge: as a global 3D grid of features and an array of view-specific 2D grids. We progress ...

Springer2022

Chattez avec Graph Search

Posez n’importe quelle question sur les cours, conférences, exercices, recherches, actualités, etc. de l’EPFL ou essayez les exemples de questions ci-dessous.

AVERTISSEMENT : Le chatbot Graph n'est pas programmé pour fournir des réponses explicites ou catégoriques à vos questions. Il transforme plutôt vos questions en demandes API qui sont distribuées aux différents services informatiques officiellement administrés par l'EPFL. Son but est uniquement de collecter et de recommander des références pertinentes à des contenus que vous pouvez explorer pour vous aider à répondre à vos questions.

Efficient Transformer-Based Speech Recognition

Linear Complexity Self-Attention With 3rd Order Polynomials

Stop Pre-Training: Adapt Visual-Language Models to Unseen Languages

Robust direct acoustic impedance control using two microphones for mixed feedforward-feedback controller

Detection of Settlements in Tanzania and Mozambique by Many Regional Few-Shot Models

Global information processing in feedforward deep networks

Stop Wasting my FLOPS: Improving the Efficiency of Deep Learning Models

COBRA: Enhancing DNN Latency Prediction with Language Models trained on Source Code

Language Transformers for Remote Sensing Visual Question Answering

Generalization of an Encoder-Decoder LSTM model for flood prediction in ungauged catchments

RayTran: 3D Pose Estimation and Shape Reconstruction of Multiple Objects from Videos with Ray-Traced Transformers

Graph Chatbot

Chattez avec Graph Search

Robust direct acoustic impedance control using two microphones for mixed feedforward-feedback controller

Stop Pre-Training: Adapt Visual-Language Models to Unseen Languages

Stop Wasting my FLOPS: Improving the Efficiency of Deep Learning Models

Generalization of an Encoder-Decoder LSTM model for flood prediction in ungauged catchments

Detection of Settlements in Tanzania and Mozambique by Many Regional Few-Shot Models

Linear Complexity Self-Attention With 3rd Order Polynomials

Global information processing in feedforward deep networks

COBRA: Enhancing DNN Latency Prediction with Language Models trained on Source Code

Language Transformers for Remote Sensing Visual Question Answering

RayTran: 3D Pose Estimation and Shape Reconstruction of Multiple Objects from Videos with Ray-Traced Transformers