Concept
Word2vec
Related publications (95)
Examining European Press Coverage of the Covid-19 No-Vax Movement: An NLP Framework
This paper examines how the European press dealt with the no-vax reactions against the Covid-19 vaccine and the dis- and misinformation associated with this movement. Using a curated dataset of 1786 articles from 19 European newspapers on the anti-vaccine ...
ASSOC COMPUTING MACHINERY2023Learnable latent embeddings for joint behavioural and neural analysis
Mackenzie Mathis, Steffen Schneider, Jin Hwa Lee
Mapping behavioural actions to neural activity is a fundamental goal of neuroscience. As our ability to record large neural and behavioural data increases, there is growing interest in modelling neural dynamics during adaptive behaviours to probe neural re ...
NATURE PORTFOLIO20234M: Massively Multimodal Masked Modeling
Shuqing Teresa Yeo, Amir Roshan Zamir, Oguzhan Fatih Kar, Roman Christian Bachmann, David Mizrahi
Current machine learning models for vision are often highly specialized and limited to a single modality and task. In contrast, recent large language models exhibit a wide range of capabilities, hinting at a possibility for similarly versatile models in co ...
Neural Information Processing Systems (Nips)2023Revisiting Offline Compression: Going Beyond Factorization-based Methods for Transformer Language Models
Karl Aberer, Rémi Philippe Lebret, Mohammadreza Banaei
Recent transformer language models achieve outstanding results in many natural language processing (NLP) tasks. However, their enormous size often makes them impractical on memory-constrained devices, requiring practitioners to compress them to smaller net ...
Assoc Computational Linguistics-Acl2023Network Alignment With Holistic Embeddings
Thanh Trung Huynh, Quoc Viet Hung Nguyen, Thành Tâm Nguyên, Chi Thang Duong
Network alignment is the task of identifying topologically and semantically similar nodes across (two) different networks. It plays an important role in various applications ranging from social network analysis to bioinformatic network interactions. Howeve ...
IEEE COMPUTER SOC2023Natural Language Processing (NLP) driven categorisation and detection of discourse in historical US patents
Jérôme Baudry, Nicolas Christophe Chachereau, Bhargav Srinivasa Desikan, Prakhar Gupta
Patents have traditionally been used in the history of technology as an indication of the thinking process of the inventors, of the challenges or “reverse salients” they faced, or of the social groups influencing the construction of technology. More recent ...
2022Robustness, replicability and scalability in topic modelling
Approaches for estimating the similarity between individual publications are an area of long -standing interest in the scientometrics and informetrics communities. Traditional techniques have generally relied on references and other metadata, while text mi ...
ELSEVIER2022Bias at a Second Glance: A Deep Dive into Bias for German Educational Peer-Review Data Modeling
Vinitra Swamy, Thiemo Wambsganss
Natural Language Processing (NLP) has become increasingly utilized to provide adaptivity in educational applications. However, recent research has highlighted a variety of biases in pre-trained language models. While existing studies investigate bias in di ...
2022Efficient Transformer-Based Speech Recognition
Training deep neural network based Automatic Speech Recognition (ASR) models often requires thousands of hours of transcribed data, limiting their use to only a few languages. Moreover, current state-of-the-art acoustic models are based on the Transformer ...
EPFL2022Further results on latent discourse models and word embeddings
We discuss some properties of generative models for word embeddings. Namely, (Arora et al., 2016) proposed a latent discourse model implying the concentration of the partition function of the word vectors. This concentration phenomenon led to an asymptotic ...
MICROTOME PUBL2021