Logistic Regression: Model Interpretation and Comparison

This lecture covers the application of logistic regression in statistical modeling, focusing on interpreting model parameters and assessing model fit. Topics include the use of indicator variables for categorical predictors, the logit transformation, odds ratios, and deviance as a measure of model quality. The instructor explains how to estimate probabilities and odds for different scenarios, conduct inference tests for coefficients, and compare models using likelihood ratio tests. The lecture also delves into the importance of deviance in logistic regression and the significance of model comparison in statistical analysis.

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related lectures (438)

Related concepts (124)

MATH-236: Probability and statistics II

Linear statistical methods, analysis of experiments, logistic regression.

Statistical inference

Statistical inference is the process of using data analysis to infer properties of an underlying distribution of probability. Inferential statistical analysis infers properties of a population, for example by testing hypotheses and deriving estimates. It is assumed that the observed data set is sampled from a larger population. Inferential statistics can be contrasted with descriptive statistics. Descriptive statistics is solely concerned with properties of the observed data, and it does not rest on the assumption that the data come from a larger population.

Model selection

Model selection is the task of selecting a model from among various candidates on the basis of performance criterion to choose the best one. In the context of learning, this may be the selection of a statistical model from a set of candidate models, given data. In the simplest cases, a pre-existing set of data is considered. However, the task can also involve the design of experiments such that the data collected is well-suited to the problem of model selection.

Likelihood-ratio test

In statistics, the likelihood-ratio test assesses the goodness of fit of two competing statistical models, specifically one found by maximization over the entire parameter space and another found after imposing some constraint, based on the ratio of their likelihoods. If the constraint (i.e., the null hypothesis) is supported by the observed data, the two likelihoods should not differ by more than sampling error. Thus the likelihood-ratio test tests whether this ratio is significantly different from one, or equivalently whether its natural logarithm is significantly different from zero.

Logistic regression

In statistics, the logistic model (or logit model) is a statistical model that models the probability of an event taking place by having the log-odds for the event be a linear combination of one or more independent variables. In regression analysis, logistic regression (or logit regression) is estimating the parameters of a logistic model (the coefficients in the linear combination).

Likelihood principle

In statistics, the likelihood principle is the proposition that, given a statistical model, all the evidence in a sample relevant to model parameters is contained in the likelihood function. A likelihood function arises from a probability density function considered as a function of its distributional parameterization argument.

Probability and Statistics MATH-232: Probability and statistics

Covers p-quantile, normal approximation, joint distributions, and exponential families in probability and statistics.

Probabilistic Linear Regression PHYS-467: Machine learning for physicists

Explores probabilistic linear regression, covering joint and conditional probability, ridge regression, and overfitting mitigation.

Probability and Statistics MATH-232: Probability and statistics

Introduces probability, statistics, distributions, inference, likelihood, and combinatorics for studying random events and network modeling.

Linear Regression: Ozone Data Analysis MATH-131: Probability and statistics

Explores linear regression analysis of ozone data using statistical models.

Model Selection Criteria: AIC, BIC, Cp MATH-413: Statistics for data science

Explores model selection criteria like AIC, BIC, and Cp in statistics for data science.