MuseReduce: A Generic Framework for Hierarchical Music Analysis

Publications associées (30)

Page 2 sur 3

À propos
Confidentialité
Mentions légales

Graph Chatbot

Framing the News: From Human Perception to Large Language Model Inferences

Daniel Gatica-Perez

Identifying the frames of news is important to understand the articles' vision, intention, message to be conveyed, and which aspects of the news are emphasized. Framing is a widely studied concept in journalism, and has emerged as a new topic in computing, ...

Assoc Computing Machinery2023

Multi-task prompt-RSVQA to explicitly count objects on aerial images

Devis Tuia, Christel Marie Tartini-Chappuis, Sylvain Lobry, Javiera Francisca Castillo Navarro, Nicola Antonio Santacroce

Introduced to enable a wider use of Earth Observation images using natural language, Remote Sensing Visual Question Answering (RSVQA) remains a challenging task, in particular for questions related to counting. To address this specific challenge, we propos ...

2023

Modeling Structured Data in Attention-based Models

Alireza Mohammadshahi

Natural language processing has experienced significant improvements with the development of Transformer-based models, which employ self-attention mechanism and pre-training strategies. However, these models still present several obstacles. A notable issue ...

EPFL2023

XTab: Cross-table Pretraining for Tabular Transformers

Mahsa Shoaran, Bingzhao Zhu

The success of self-supervised learning in computer vision and natural language processing has motivated pretraining methods on tabular data. However, most existing tabular self-supervised learning models fail to leverage information across multiple data t ...

JMLR.org2023

Text Representation Learning for Low Cost Natural Language Understanding

Jan Frederik Jonas Florian Mai

Natural language processing and other artificial intelligence fields have witnessed impressive progress over the past decade. Although some of this progress is due to algorithmic advances in deep learning, the majority has arguably been enabled by scaling ...

EPFL2023

Improving Generalization of Pretrained Language Models

Rabeeh Karimi Mahabadi

In this dissertation, we propose multiple methods to improve transfer learning for pretrained language models (PLMs). Broadly, transfer learning is a powerful technique in natural language processing, where a language model is first pre-trained on a data-r ...

EPFL2023

Backpropagation-free training of deep physical neural networks

Romain Christophe Rémy Fleury, Ali Momeni, Babak Rahmani, Matthieu Francis Malléjac, Marc Philipp Del Hougne

Recent successes in deep learning for vision and natural language processing are attributed to larger models but come with energy consumption and scalability issues. Current training of digital deep-learning models primarily relies on backpropagation that ...

American Association for the Advancement of Science2023

TiC-SAT: Tightly-coupled Systolic Accelerator for Transformers

David Atienza Alonso, Giovanni Ansaloni, Alireza Amirshahi, Joshua Alexander Harrison Klein

Transformer models have achieved impressive results in various AI scenarios, ranging from vision to natural language processing. However, their computational complexity and their vast number of parameters hinder their implementations on resource-constraine ...

2023

Hearing functional harmony in jazz: A perceptual study on music-theoretical accounts of extended tonality

Martin Alois Rohrmeier, Daniel Harasim, Steffen Alexander Herff, Gabriele Cecchetti, Christoph Finkensiep

Functional harmony is an integral part of many repertoires in the Western musical practices, including both diatonic and extended tonality. In the latter context, music-theoretical accounts suggest that the three octatonic equivalence classes (OECs) consis ...

SAGE PUBLICATIONS LTD2022

Prompt–RSVQA: Prompting visual context to a language model for Remote Sensing Visual Question Answering

Devis Tuia, Christel Marie Tartini-Chappuis, Sylvain Lobry, Valérie Zermatten

Remote sensing visual question answering (RQA) was recently proposed with the aim of interfacing natural language and vision to ease the access of information contained in Earth Observation data for a wide audience, which is granted by simple questions in ...

2022

Page 2 sur 3