Maximum Likelihood Estimation

This lecture by the instructor covers the topic of Maximum Likelihood Estimation (MLE) in statistics. It delves into the concept of estimation, specifically focusing on ML Estimation-Distribution, Shrinkage Estimation, and Loss functions. The lecture explores the theoretical foundations of MLE, including the Central Limit Theorem and the Stein theorem. It also discusses the application of MLE in real-world scenarios, such as in the context of exponential distribution and decision theory. The presentation emphasizes the importance of understanding risk, loss functions, and hypothesis testing in statistical inference.

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related lectures (759)

Related concepts (103)

MATH-413: Statistics for data science

Statistics lies at the foundation of data science, providing a unifying theoretical and methodological backbone for the diverse tasks enountered in this emerging field. This course rigorously develops

Maximum likelihood estimation

In statistics, maximum likelihood estimation (MLE) is a method of estimating the parameters of an assumed probability distribution, given some observed data. This is achieved by maximizing a likelihood function so that, under the assumed statistical model, the observed data is most probable. The point in the parameter space that maximizes the likelihood function is called the maximum likelihood estimate. The logic of maximum likelihood is both intuitive and flexible, and as such the method has become a dominant means of statistical inference.

Estimation theory

Estimation theory is a branch of statistics that deals with estimating the values of parameters based on measured empirical data that has a random component. The parameters describe an underlying physical setting in such a way that their value affects the distribution of the measured data. An estimator attempts to approximate the unknown parameters using the measurements.

Bias of an estimator

In statistics, the bias of an estimator (or bias function) is the difference between this estimator's expected value and the true value of the parameter being estimated. An estimator or decision rule with zero bias is called unbiased. In statistics, "bias" is an property of an estimator. Bias is a distinct concept from consistency: consistent estimators converge in probability to the true value of the parameter, but may be biased or unbiased; see bias versus consistency for more.

German tank problem

In the statistical theory of estimation, the German tank problem consists of estimating the maximum of a discrete uniform distribution from sampling without replacement. In simple terms, suppose there exists an unknown number of items which are sequentially numbered from 1 to N. A random sample of these items is taken and their sequence numbers observed; the problem is to estimate N from these observed numbers. The problem can be approached using either frequentist inference or Bayesian inference, leading to different results.

Normal distribution

In statistics, a normal distribution or Gaussian distribution is a type of continuous probability distribution for a real-valued random variable. The general form of its probability density function is The parameter is the mean or expectation of the distribution (and also its median and mode), while the parameter is its standard deviation. The variance of the distribution is . A random variable with a Gaussian distribution is said to be normally distributed, and is called a normal deviate.

Maximum Likelihood Estimation MATH-413: Statistics for data science

Explores Maximum Likelihood Estimation, covering assumptions, properties, distribution, shrinkage estimation, and loss functions.

Interval Estimation: Method of Moments MATH-232: Probability and statistics

Covers the method of moments for estimating parameters and constructing confidence intervals based on empirical moments matching distribution moments.

Air Pollution Analysis ENV-409: Air pollution

Explores air pollution analysis using wind data, probability distributions, and trajectory models for air quality assessment.

Probability and Statistics MATH-232: Probability and statistics

Covers p-quantile, normal approximation, joint distributions, and exponential families in probability and statistics.

Maximum Likelihood Estimation: Multivariate Statistics MATH-444: Multivariate statistics

Explores maximum likelihood estimation and multivariate hypothesis testing, including challenges and strategies for testing multiple hypotheses.