Modern NLP: IntroductionBy Antoine Bosselut introduces Natural Language Processing and its challenges, advancements in neural models, and course goals.
Pretraining: Transformers & ModelsExplores pretraining models like BERT, T5, and GPT, discussing their training objectives and applications in natural language processing.
Model AnalysisExplores neural model analysis in NLP, covering evaluation, probing, and ablation studies to understand model behavior and interpretability.