General Linear Model: Model Selection

This lecture covers the General Linear Model, including significance testing and model selection. Topics include the mathematical formulation of the model, a pesticide toxicity example, comparing candidate models, and parameter inference using summary statistics. The instructor explains how to compare models using ANOVA and drop1 methods, emphasizing the importance of nested models and the consequences of correlated predictors. The lecture also delves into the Multiple R-squared concept, the Additional Sum-of-Squares principle, and provides examples to illustrate these statistical concepts.

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related lectures (221)

Related concepts (63)

MATH-493: Applied biostatistics

This course covers topics in applied biostatistics, with an emphasis on practical aspects of data analysis using R statistical software. Topics include types of studies and their design and analysis,

Linear least squares

Linear least squares (LLS) is the least squares approximation of linear functions to data. It is a set of formulations for solving statistical problems involved in linear regression, including variants for ordinary (unweighted), weighted, and generalized (correlated) residuals. Numerical methods for linear least squares include inverting the matrix of the normal equations and orthogonal decomposition methods. The three main linear least squares formulations are: Ordinary least squares (OLS) is the most common estimator.

Tool

A tool is an object that can extend an individual's ability to modify features of the surrounding environment or help them accomplish a particular task. Although many animals use simple tools, only human beings, whose use of stone tools dates back hundreds of millennia, have been observed using tools to make other tools. Early human tools, made of such materials as stone, bone, and wood, were used for the preparation of food, hunting, the manufacture of weapons, and the working of materials to produce clothing and useful artifacts and crafts such as pottery, along with the construction of housing, businesses, infrastructure, and transportation.

Linear regression

In statistics, linear regression is a linear approach for modelling the relationship between a scalar response and one or more explanatory variables (also known as dependent and independent variables). The case of one explanatory variable is called simple linear regression; for more than one, the process is called multiple linear regression. This term is distinct from multivariate linear regression, where multiple correlated dependent variables are predicted, rather than a single scalar variable.

Multicollinearity

In statistics, multicollinearity (also collinearity) is a phenomenon in which one predictor variable in a multiple regression model can be linearly predicted from the others with a substantial degree of accuracy. In this situation, the coefficient estimates of the multiple regression may change erratically in response to small changes in the model or the data. Multicollinearity does not reduce the predictive power or reliability of the model as a whole, at least within the sample data set; it only affects calculations regarding individual predictors.

Hand tool

A hand tool is any tool that is powered by hand rather than a motor. Categories of hand tools include wrenches, pliers, cutters, , striking tools, struck or hammered tools, screwdrivers, vises, clamps, snips, hacksaws, drills, and knives. Outdoor tools such as garden forks, pruning shears, and rakes are additional forms of hand tools. Portable power tools are not hand tools. Hand tools have been used by humans since the Stone Age when stone tools were used for hammering and cutting.

Linear Regression: Ozone Data Analysis MATH-131: Probability and statistics

Explores linear regression analysis of ozone data using statistical models.

Linear Regression: Mean-square-error Inference EE-566: Adaptation and learning

Covers the MSE problem in linear regression models, focusing on the optimal estimator and data fusion methods.

Model Selection Criteria: AIC, BIC, Cp MATH-413: Statistics for data science

Explores model selection criteria like AIC, BIC, and Cp in statistics for data science.

Regularization in Machine Learning BIO-322: Introduction to machine learning for bioengineers

Explores Ridge and Lasso Regression for regularization in machine learning models, emphasizing hyperparameter tuning and visualization of parameter coefficients.

Linear Regression Essentials CS-411: Digital education

Covers the essentials of linear regression, focusing on using multiple quantitative explanatory variables to predict a quantitative outcome.