Linear Models for Classification

This lecture introduces linear models for classification, focusing on logistic regression. It covers the transition from regression to classification, hyperplanes, linear regression, multi-output prediction, and the logistic sigmoid function. The instructor explains the training process for logistic regression, including the cross-entropy loss function and gradient computation. The lecture also discusses model evaluation metrics such as accuracy, precision, recall, and ROC curves. Practical examples and exercises illustrate the concepts, emphasizing the importance of decision boundaries in different classifiers.

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related lectures (507)

Related concepts (188)

CS-233(a): Introduction to machine learning (BA3)

Machine learning and data analysis are becoming increasingly central in many sciences and applications. In this course, fundamental principles and methods of machine learning will be introduced, analy

Linear regression

In statistics, linear regression is a linear approach for modelling the relationship between a scalar response and one or more explanatory variables (also known as dependent and independent variables). The case of one explanatory variable is called simple linear regression; for more than one, the process is called multiple linear regression. This term is distinct from multivariate linear regression, where multiple correlated dependent variables are predicted, rather than a single scalar variable.

Logistic regression

In statistics, the logistic model (or logit model) is a statistical model that models the probability of an event taking place by having the log-odds for the event be a linear combination of one or more independent variables. In regression analysis, logistic regression (or logit regression) is estimating the parameters of a logistic model (the coefficients in the linear combination).

Multinomial logistic regression

In statistics, multinomial logistic regression is a classification method that generalizes logistic regression to multiclass problems, i.e. with more than two possible discrete outcomes. That is, it is a model that is used to predict the probabilities of the different possible outcomes of a categorically distributed dependent variable, given a set of independent variables (which may be real-valued, binary-valued, categorical-valued, etc.).

Precision and recall

In pattern recognition, information retrieval, object detection and classification (machine learning), precision and recall are performance metrics that apply to data retrieved from a collection, corpus or sample space. Precision (also called positive predictive value) is the fraction of relevant instances among the retrieved instances. Written as a formula:. Recall (also known as sensitivity) is the fraction of relevant instances that were retrieved. Written as a formula: . Both precision and recall are therefore based on relevance.

Logistic function

A logistic function or logistic curve is a common S-shaped curve (sigmoid curve) with the equation where For values of in the domain of real numbers from to , the S-curve shown on the right is obtained, with the graph of approaching as approaches and approaching zero as approaches . The logistic function finds applications in a range of fields, including biology (especially ecology), biomathematics, chemistry, demography, economics, geoscience, mathematical psychology, probability, sociology, political science, linguistics, statistics, and artificial neural networks.

Logistic Regression: Fundamentals and Applications ENG-209: Data science for engineers with Python

Explores logistic regression fundamentals, including cost functions, regularization, and classification boundaries, with practical examples using scikit-learn.

Logistic Regression: Vegetation Prediction MGT-448: Statistical inference and machine learning

Explores logistic regression for predicting vegetation proportions in the Amazon region through remote sensing data analysis.

Generalized Linear Regression: Classification BIO-322: Introduction to machine learning for bioengineers

Explores Generalized Linear Regression, Classification, confusion matrices, ROC curves, and noise in data.

Linear Models: Basics DH-406: Machine learning for DH

Introduces linear models in machine learning, covering basics, parametric models, multi-output regression, and evaluation metrics.

Linear Models: Recap and Logistic Regression CS-233(a): Introduction to machine learning (BA3)

Covers linear models, binary classification, logistic regression, and model evaluation metrics.