Cross-validation & RegularizationExplores polynomial curve fitting, kernel functions, and regularization techniques, emphasizing the importance of model complexity and overfitting.
Careful Cross-validationEmphasizes the significance of careful cross-validation in deep neural networks, including the split of data and the concept of K-fold cross-validation.
Nonlinear ML AlgorithmsIntroduces nonlinear ML algorithms, covering nearest neighbor, k-NN, polynomial curve fitting, model complexity, overfitting, and regularization.
Probabilistic Linear RegressionExplores probabilistic linear regression, covering joint and conditional probability, ridge regression, and overfitting mitigation.
Prediction testsExplores out-of-sample validation and the methodology of cross-validation for testing predictive models.