Monte Carlo Method: Simulation and Inference

This lecture introduces the Monte Carlo method as a simulation tool for making statistical inferences based on random events. The instructor explains how to compute statistical quantities using a stochastic model, realizations of random variables, and sample mean estimators. The lecture covers the properties of the estimator, unbiasedness, accuracy quantification, variance estimation, and confidence intervals. It also discusses the consistency and asymptotic normality of the estimator, error control, adaptive strategies for choosing sample sizes, and the probabilistic nature of Monte Carlo simulations.

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related lectures (37)

Related concepts (33)

Estimator

In statistics, an estimator is a rule for calculating an estimate of a given quantity based on observed data: thus the rule (the estimator), the quantity of interest (the estimand) and its result (the estimate) are distinguished. For example, the sample mean is a commonly used estimator of the population mean. There are point and interval estimators. The point estimators yield single-valued results. This is in contrast to an interval estimator, where the result would be a range of plausible values.

Minimum-variance unbiased estimator

In statistics a minimum-variance unbiased estimator (MVUE) or uniformly minimum-variance unbiased estimator (UMVUE) is an unbiased estimator that has lower variance than any other unbiased estimator for all possible values of the parameter. For practical statistics problems, it is important to determine the MVUE if one exists, since less-than-optimal procedures would naturally be avoided, other things being equal. This has led to substantial development of statistical theory related to the problem of optimal estimation.

Bias of an estimator

In statistics, the bias of an estimator (or bias function) is the difference between this estimator's expected value and the true value of the parameter being estimated. An estimator or decision rule with zero bias is called unbiased. In statistics, "bias" is an property of an estimator. Bias is a distinct concept from consistency: consistent estimators converge in probability to the true value of the parameter, but may be biased or unbiased; see bias versus consistency for more.

Sample mean and covariance

The sample mean (sample average) or empirical mean (empirical average), and the sample covariance or empirical covariance are statistics computed from a sample of data on one or more random variables. The sample mean is the average value (or mean value) of a sample of numbers taken from a larger population of numbers, where "population" indicates not number of people but the entirety of relevant data, whether collected or not. A sample of 40 companies' sales from the Fortune 500 might be used for convenience instead of looking at the population, all 500 companies' sales.

Statistical inference

Statistical inference is the process of using data analysis to infer properties of an underlying distribution of probability. Inferential statistical analysis infers properties of a population, for example by testing hypotheses and deriving estimates. It is assumed that the observed data set is sampled from a larger population. Inferential statistics can be contrasted with descriptive statistics. Descriptive statistics is solely concerned with properties of the observed data, and it does not rest on the assumption that the data come from a larger population.

MATH-414: Stochastic simulation

The student who follows this course will get acquainted with computational tools used to analyze systems with uncertainty arising in engineering, physics, chemistry, and economics. Focus will be on s

Statistical Inference MATH-232: Probability and statistics

Covers likelihood ratio statistic, confidence intervals, and hypothesis testing concepts.

Confidence Intervals: Definition and Estimation MATH-234(b): Probability and statistics

Explains confidence intervals, parameter estimation methods, and the central limit theorem in statistical inference.

Statistical Theory: Maximum Likelihood Estimation MATH-442: Statistical theory

Explores the consistency and asymptotic properties of the Maximum Likelihood Estimator, including challenges in proving its consistency and constructing MLE-like estimators.

The Stein Phenomenon and Superefficiency MATH-442: Statistical theory

Explores the Stein Phenomenon, showcasing the benefits of bias in high-dimensional statistics and the superiority of the James-Stein Estimator over the Maximum Likelihood Estimator.

Optimality in Decision Theory: Unbiased Estimation MATH-442: Statistical theory

Explores optimality in decision theory and unbiased estimation, emphasizing sufficiency, completeness, and lower bounds for risk.