Deep Neural NetworksCovers the back-propagation algorithm for deep neural networks and the importance of locality in CNN.
Splines and Machine LearningExplores supervised learning as an ill-posed problem and the integration of sparse adaptive splines into neural architectures.
Long Short-Term Memory NetworksIntroduces Long Short-Term Memory (LSTM) networks as a solution to vanishing and exploding gradients in recurrent neural networks.
Dynamics of Linear Neural NetworksExplores the learning dynamics of deep neural networks using linear networks for analysis, covering two-layer and multi-layer networks, self-supervised learning, and benefits of decoupled initialization.
Neural Networks: Multilayer PerceptronsCovers Multilayer Perceptrons, artificial neurons, activation functions, matrix notation, flexibility, regularization, regression, and classification tasks.