Explores the learning dynamics of deep neural networks using linear networks for analysis, covering two-layer and multi-layer networks, self-supervised learning, and benefits of decoupled initialization.
Explores the evolution of image representation, challenges in supervised learning, benefits of self-supervised learning, and recent advancements in SSL.