In statistics, the likelihood-ratio test assesses the goodness of fit of two competing statistical models, specifically one found by maximization over the entire parameter space and another found after imposing some constraint, based on the ratio of their likelihoods. If the constraint (i.e., the null hypothesis) is supported by the observed data, the two likelihoods should not differ by more than sampling error. Thus the likelihood-ratio test tests whether this ratio is significantly different from one, or equivalently whether its natural logarithm is significantly different from zero. The likelihood-ratio test, also known as Wilks test, is the oldest of the three classical approaches to hypothesis testing, together with the Lagrange multiplier test and the Wald test. In fact, the latter two can be conceptualized as approximations to the likelihood-ratio test, and are asymptotically equivalent. In the case of comparing two models each of which has no unknown parameters, use of the likelihood-ratio test can be justified by the Neyman–Pearson lemma. The lemma demonstrates that the test has the highest power among all competitors. Suppose that we have a statistical model with parameter space . A null hypothesis is often stated by saying that the parameter is in a specified subset of . The alternative hypothesis is thus that is in the complement of , i.e. in , which is denoted by . The likelihood ratio test statistic for the null hypothesis is given by: where the quantity inside the brackets is called the likelihood ratio. Here, the notation refers to the supremum. As all likelihoods are positive, and as the constrained maximum cannot exceed the unconstrained maximum, the likelihood ratio is bounded between zero and one. Often the likelihood-ratio test statistic is expressed as a difference between the log-likelihoods where is the logarithm of the maximized likelihood function , and is the maximal value in the special case that the null hypothesis is true (but not necessarily a value that maximizes for the sampled data) and denote the respective arguments of the maxima and the allowed ranges they're embedded in.

About this result
This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.
Related courses (32)
PHYS-467: Machine learning for physicists
Machine learning and data analysis are becoming increasingly central in sciences including physics. In this course, fundamental principles and methods of machine learning will be introduced and practi
MATH-442: Statistical theory
-This course gives a mostly rigourous treatment of some statistical methods outside the context of standard likelihood theory.
MATH-232: Probability and statistics (for IC)
A basic course in probability and statistics
Show more
Related lectures (187)
Inference Problems & Spin Glass Game
Covers inference problems related to the Spin Glass Game and the challenges of making mistakes with preb P.
Likelihood Ratio Test: Detection & Estimation
Covers the likelihood ratio test for detection and estimation in statistical analysis.
Frame Synchronization: Systematic Derivation with Likelihood Test
Covers the systematic derivation of a synchronization algorithm with a generalized likelihood test in wireless receivers.
Show more
Related publications (218)

Boosting likelihood learning with event reweighting

Andrea Wulzer, Alfredo Glioti, Siyu Chen

Extracting maximal information from experimental data requires access to the likelihood function, which however is never directly available for complex experiments like those performed at high energy colliders. Theoretical predictions are obtained in this ...
Springer2024

Transportation-based functional ANOVA and PCA for covariance operators

Victor Panaretos, Yoav Zemel, Valentina Masarotto

We consider the problem of comparing several samples of stochastic processes with respect to their second-order structure, and describing the main modes of variation in this second order structure, if present. These tasks can be seen as an Analysis of Vari ...
Inst Mathematical Statistics-Ims2024
Show more

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.