Lecture

Machine Translation: Sequence-to-Sequence and Attention

Description

This lecture covers the evolution of Machine Translation from Statistical Machine Translation to Neural Machine Translation (NMT) with a focus on Sequence-to-Sequence models and Attention mechanisms. It explains the challenges faced in modeling translation, the architecture of NMT models, the role of Attention in NMT, and the benefits of using Attention instead of Recurrence. The lecture also delves into the concepts of self-attention, position representations, nonlinearities, and masking in the context of building blocks for NMT systems.

About this result
This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.