Multi-layer Neural NetworksCovers the fundamentals of multi-layer neural networks and the training process of fully connected networks with hidden layers.
Long Short-Term Memory NetworksIntroduces Long Short-Term Memory (LSTM) networks as a solution to vanishing and exploding gradients in recurrent neural networks.
Neural Networks: Multilayer PerceptronsCovers Multilayer Perceptrons, artificial neurons, activation functions, matrix notation, flexibility, regularization, regression, and classification tasks.
Deep Learning FundamentalsIntroduces deep learning, from logistic regression to neural networks, emphasizing the need for handling non-linearly separable data.
Non-Conceptual Knowledge SystemsDelves into the impact of deep learning on non-conceptual knowledge systems and the advancements in transformers and generative adversarial networks.
Neural Networks OptimizationExplores neural networks optimization, including backpropagation, batch normalization, weight initialization, and hyperparameter search strategies.