Lecture

Understanding Learning Dynamics of Neural Networks

Description

This lecture delves into the learning dynamics of neural networks, exploring topics such as optimization, interference during learning, and continual learning. It discusses the challenges of credit assignment, plasticity, and the efficiency of linear recurrences. The instructor presents insights on preventing exploding and vanishing gradients, the benefits of linear recurrences, and the efficiency of different models in various tasks.

About this result
This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.