Concept
Origin of language
Related publications (73)
Driving and suppressing the human language network using large language models
Transformer models such as GPT generate human-like language and are predictive of human brain responses to language. Here, using functional-MRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict t ...
Berlin2024Stop Pre-Training: Adapt Visual-Language Models to Unseen Languages
Karl Aberer, Rémi Philippe Lebret, Negar Foroutan Eghlidi
Vision-Language Pre-training (VLP) has advanced the performance of many visionlanguage tasks, such as image-text retrieval, visual entailment, and visual reasoning. The pre-training mostly utilizes lexical databases and image queries in English. Previous w ...
Assoc Computational Linguistics-Acl2023Cellularization across eukaryotes: Conserved mechanisms and novel strategies
Many eukaryotes form multinucleated cells during their devel-opment. Some cells persist as such during their lifetime, others choose to cleave each nucleus individually using a specialized cytokinetic process known as cellularization. What is cellula-rizat ...
CURRENT BIOLOGY LTD2023BLACK-BOX ATTACKS ON IMAGE ACTIVITY PREDICTION AND ITS NATURAL LANGUAGE EXPLANATIONS
Explainable AI (XAI) methods aim to describe the decision process of deep neural networks. Early XAI methods produced visual explanations, whereas more recent techniques generate multimodal explanations that include textual information and visual represent ...
Los Alamitos2023The evolution of behavioral cues and signaling in displaced communication
Dario Floreano, Laurent Keller
Displaced communication, whereby individuals communicate regarding a subject that is not immediately present (spatially or temporally), is one of the key features of human language. It also occurs in a few animal species, most notably the honeybee, where t ...
2023Ontology-centric industrial requirements validation for aircraft assembly system design
The development of an aircraft industrial system faces the challenge of integrative requirements validation with de-correlated modelling languages and distributed proprietary formats. This paper specifies an ontology-centric industrial requirements validat ...
ELSEVIER2022Multitask adaptation with Lattice-Free MMI for multi-genre speech recognition of low resource languages
In this paper, we develop Automatic Speech Recognition (ASR) systems for multi-genre speech recognition of low-resource languages where training data is predominantly conversational speech but test data can be in one of the following genres: news broadcast ...
ISCA-INT SPEECH COMMUNICATION ASSOC2021PARSINLU: A Suite of Language Understanding Challenges for Persian
Despite the progress made in recent years in addressing natural language understanding (NLU) challenges, the majority of this progress remains to be concentrated on resource-rich languages like English. This work focuses on Persian language, one of the wid ...
2021LaMBERT: Light and Multigranular BERT
Pre-training complex language models is essential for the success of the recent methods such as BERT or OpenAI GPT. Their size makes not only the pre-training phase, but also consecutive applications to be computationally expensive. BERT-like models excel ...
2020High gamma response tracks different syntactic structures in homophonous phrases
Silvestro Micera, Fiorenzo Artoni
Syntax is a species-specific component of human language combining a finite set of words in a potentially infinite number of sentences. Since words are by definition expressed by sound, factoring out syntactic information is normally impossible. Here, we c ...
NATURE PUBLISHING GROUP2020