Lecture
Words and Tokens: Language Models and Probabilities
Description
This lecture reviews key concepts related to language models in natural language processing, focusing on the input of NLP systems, tokenization, and language identification. It also covers the estimation of probabilities using n-grams and techniques like Laplace smoothing and Good-Turing smoothing. The instructor emphasizes the importance of choosing the best sequence in language models and discusses the challenges of comparing probabilities in different spaces.
This video is available exclusively on Mediaspace for a restricted audience. Please log in to MediaSpace to access it if you have the necessary permissions.
Watch on MediaspaceOfficial source
About this result
This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.