Association for Computational LinguisticsL’Association for Computational Linguistics (ACL) est la principale société savante en traitement automatique des langues. Elle organise tous les ans la plus prestigieuse conférence scientifique du domaine. Avant 1968, l'association était nommé Association for Machine Translation and Computational Linguistics (AMTCL). Elle est également responsable d'une revue scientifique publiée par MIT Press depuis 1988.
Attention (machine learning)Machine learning-based attention is a mechanism mimicking cognitive attention. It calculates "soft" weights for each word, more precisely for its embedding, in the context window. It can do it either in parallel (such as in transformers) or sequentially (such as recursive neural networks). "Soft" weights can change during each runtime, in contrast to "hard" weights, which are (pre-)trained and fine-tuned and remain frozen afterwards. Multiple attention heads are used in transformer-based large language models.
