Model Assessment and Hyperparameter Tuning

This lecture covers the concepts of model assessment and hyperparameter tuning in machine learning. It explains the process of splitting data, estimating parameters, and finding the best hyperparameters using techniques like the validation set approach and cross-validation. The instructor demonstrates how to estimate test errors, select optimal degrees in polynomial regression, and apply resampling strategies. The lecture emphasizes the importance of tuning models to improve performance and avoid underfitting or overfitting. Practical examples and applications, such as using the bootstrap method for uncertainty estimation, are discussed.

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related lectures (1,000)

Related concepts (161)

BIO-322: Introduction to machine learning for bioengineers

Students understand basic concepts and methods of machine learning. They can describe them in mathematical terms and can apply them to data using a high-level programming language (julia/python/R).

Cross-validation, sometimes called rotation estimation or out-of-sample testing, is any of various similar model validation techniques for assessing how the results of a statistical analysis will generalize to an independent data set. Cross-validation is a resampling method that uses different portions of the data to test and train a model on different iterations. It is mainly used in settings where the goal is prediction, and one wants to estimate how accurately a predictive model will perform in practice.

Supervised learning (SL) is a paradigm in machine learning where input objects (for example, a vector of predictor variables) and a desired output value (also known as human-labeled supervisory signal) train a model. The training data is processed, building a function that maps new data on expected output values. An optimal scenario will allow for the algorithm to correctly determine output values for unseen instances. This requires the learning algorithm to generalize from the training data to unseen situations in a "reasonable" way (see inductive bias).

In machine learning, feature learning or representation learning is a set of techniques that allows a system to automatically discover the representations needed for feature detection or classification from raw data. This replaces manual feature engineering and allows a machine to both learn the features and use them to perform a specific task. Feature learning is motivated by the fact that machine learning tasks such as classification often require input that is mathematically and computationally convenient to process.

Self-supervised learning (SSL) is a paradigm in machine learning for processing data of lower quality, rather than improving ultimate outcomes. Self-supervised learning more closely imitates the way humans learn to classify objects. The typical SSL method is based on an artificial neural network or other model such as a decision list. The model learns in two steps. First, the task is solved based on an auxiliary or pretext classification task using pseudo-labels which help to initialize the model parameters.

Unsupervised learning, is paradigm in machine learning where, in contrast to supervised learning and semi-supervised learning, algorithms learn patterns exclusively from unlabeled data. Neural network tasks are often categorized as discriminative (recognition) or generative (imagination). Often but not always, discriminative tasks use supervised methods and generative tasks use unsupervised (see Venn diagram); however, the separation is very hazy. For example, object recognition favors supervised learning but unsupervised learning can also cluster objects into groups.

Model Evaluation

Explores underfitting, overfitting, hyperparameters, bias-variance trade-off, and model evaluation in machine learning.

Bias-Variance Trade-Off

Explores underfitting, overfitting, and the bias-variance trade-off in machine learning models.

Supervised Learning: Linear Regression BIO-322: Introduction to machine learning for bioengineers

Covers supervised learning with a focus on linear regression, including topics like digit classification, spam detection, and wind speed prediction.

Document Analysis: Topic Modeling DH-406: Machine learning for DH

Explores document analysis, topic modeling, and generative models for data generation in machine learning.

Supervised Learning: Regression Methods

Explores supervised learning with a focus on regression methods, including model fitting, regularization, model selection, and performance evaluation.