Boltzmann MachineCovers the Boltzmann Machine, a type of stochastic recurrent neural network.
Nonlinear Supervised LearningExplores the inductive bias of different nonlinear supervised learning methods and the challenges of hyper-parameter tuning.
Feed-forward NetworksIntroduces feed-forward networks, covering neural network structure, training, activation functions, and optimization, with applications in forecasting and finance.
Neural Networks OptimizationExplores neural networks optimization, including backpropagation, batch normalization, weight initialization, and hyperparameter search strategies.
Neural Networks for NLPCovers modern Neural Network approaches to NLP, focusing on word embeddings, Neural Networks for NLP tasks, and future Transfer Learning techniques.
Statistical Physics of LearningOffers insights into the statistical physics of learning, exploring the relationship between neural network structure and disordered systems.