Publications associées à Yes but.. Can ChatGPT Identify Entities in Historical Documents?

Interpreting Language Models Through Knowledge Graph Extraction

Martin Jaggi, Vinitra Swamy, Angeliki Romanou

Transformer-based language models trained on large text corpora have enjoyed immense popularity in the natural language processing community and are commonly used as a starting point for downstream tasks. While these models are undeniably useful, it is a c ...

2021

Self-training Improves Pre-training for Few-shot Learning in Task-oriented Dialog Systems

Boi Faltings, Fei Mi, Lingjing Kong, Fengyu Cai, Wanhao Zhou

As the labeling cost for different modules in task-oriented dialog (ToD) systems is expensive, a major challenge is to train different modules with the least amount of labeled data. Recently, large-scale pre-trained language models, have shown promising re ...

ASSOC COMPUTATIONAL LINGUISTICS-ACL2021

Direction is what you need: Improving Word Embedding Compression in Large Language Models

Karl Aberer, Rémi Philippe Lebret, Mohammadreza Banaei

The adoption of Transformer-based models in natural language processing (NLP) has led to great success using a massive number of parameters. However, due to deployment constraints in edge devices, there has been a rising interest in the compression of thes ...

ASSOC COMPUTATIONAL LINGUISTICS-ACL2021

Transfer Learning from Pre-trained BERT for Pronoun Resolution

Qianqian Qiao, Xingce Bao

The paper describes the submission of the team "We used bert!" to the shared task Gendered Pronoun Resolution (Pair pronouns to their correct entities). Our final submission model based on the fine-tuned BERT (Bidirectional Encoder Representations from Tra ...

ASSOC COMPUTATIONAL LINGUISTICS-ACL2019

A Text Mining Pipeline Using Active and Deep Learning Aimed at Curating Information in Computational Neuroscience

Christian O'Reilly, Elisabetta Iavarone

The curation of neuroscience entities is crucial to ongoing efforts in neuroinformatics and computational neuroscience, such as those being deployed in the context of continuing large-scale brain modelling projects. However, manually sifting through thousa ...

Springer2019

Building a Question-Answering Chatbot using Forum Data in the Semantic Space

Pierre Dillenbourg, Marc Laperrouza, Khalil Mrini

We build a conversational agent which knowledge base is an online forum for parents of autistic children. We collect about 35,000 threads totalling some 600,000 replies, and label 1% of them for usefulness using Amazon Mechanical Turk. We train a Random Fo ...

2018