Statistical model specification

In statistics, model specification is part of the process of building a statistical model: specification consists of selecting an appropriate functional form for the model and choosing which variables to include. For example, given personal income together with years of schooling and on-the-job experience , we might specify a functional relationship as follows: where is the unexplained error term that is supposed to comprise independent and identically distributed Gaussian variables. The statistician Sir David Cox has said, "How [the] translation from subject-matter problem to statistical model is done is often the most critical part of an analysis". Specification error occurs when the functional form or the choice of independent variables poorly represent relevant aspects of the true data-generating process. In particular, bias (the expected value of the difference of an estimated parameter and the true underlying value) occurs if an independent variable is correlated with the errors inherent in the underlying process. There are several different possible causes of specification error; some are listed below. An inappropriate functional form could be employed. A variable omitted from the model may have a relationship with both the dependent variable and one or more of the independent variables (causing omitted-variable bias). An irrelevant variable may be included in the model (although this does not create bias, it involves overfitting and so can lead to poor predictive performance). The dependent variable may be part of a system of simultaneous equations (giving simultaneity bias). Additionally, measurement errors may affect the independent variables: while this is not a specification error, it can create statistical bias. Note that all models will have some specification error. Indeed, in statistics there is a common aphorism that "all models are wrong". In the words of Burnham & Anderson, "Modeling is an art as well as a science and is directed toward finding a good approximating model ...

À propos de ce résultat

Cette page est générée automatiquement et peut contenir des informations qui ne sont pas correctes, complètes, à jour ou pertinentes par rapport à votre recherche. Il en va de même pour toutes les autres pages de ce site. Veillez à vérifier les informations auprès des sources officielles de l'EPFL.

Publications associées (61)

Personnes associées (12)

Unités associées (13)

Concepts associés (7)

Cours associés (17)

Séances de cours associées (51)

Statistical model validation

In statistics, model validation is the task of evaluating whether a chosen statistical model is appropriate or not. Oftentimes in statistical inference, inferences from models that appear to fit their data may be flukes, resulting in a misunderstanding by researchers of the actual relevance of their model. To combat this, model validation is used to test whether a statistical model can hold up to permutations in the data.

Regression validation

In statistics, regression validation is the process of deciding whether the numerical results quantifying hypothesized relationships between variables, obtained from regression analysis, are acceptable as descriptions of the data. The validation process can involve analyzing the goodness of fit of the regression, analyzing whether the regression residuals are random, and checking whether the model's predictive performance deteriorates substantially when applied to data that were not used in model estimation.

Relative likelihood

In statistics, when selecting a statistical model for given data, the relative likelihood compares the relative plausibilities of different candidate models or of different values of a parameter of a single model. Assume that we are given some data x for which we have a statistical model with parameter θ. Suppose that the maximum likelihood estimate for θ is . Relative plausibilities of other θ values may be found by comparing the likelihoods of those other values with the likelihood of .

Bed Topography Inference from Velocity Field Using Deep Learning.

Christophe Ancey, Mehrdad Kiani Oshtorjani

Measuring bathymetry has always been a major scientific and technological challenge. In this work, we used a deep learning technique for inferring bathymetry from the depth-averaged velocity field. The training of the neural network is based on 5742 labora ...

2023

Efficient Model-based Multi-agent Reinforcement Learning via Optimistic Equilibrium Computation

Maryam Kamgarpour, Andreas Krause

We consider model-based multi-agent reinforcement learning, where the environment transition model is unknown and can only be learned via expensive interactions with the environment. We propose H-MARL (Hallucinated Multi-Agent Reinforcement Learning), a no ...

JMLR-JOURNAL MACHINE LEARNING RESEARCH2022

Mutual information for low-rank even-order symmetric tensor estimation

Nicolas Macris, Jean François Emmanuel Barbier, Clément Dominique Luneau

We consider a statistical model for finite-rank symmetric tensor factorization and prove a single-letter variational expression for its asymptotic mutual information when the tensor is of even order. The proof applies the adaptive interpolation method orig ...

OXFORD UNIV PRESS2021

ENV-524: Hydrological risks and structures

Le cours est une introduction à la théorie des valeurs extrêmes et son utilisation pour la gestion des risques hydrologiques (essentiellement crues). Une ouverture plus large sur la gestion des danger

FIN-417: Quantitative risk management

This course is an introduction to quantitative risk management that covers standard statistical methods, multivariate risk factor models, non-linear dependence structures (copula models), as well as p

MATH-562: Statistical inference

Inference from the particular to the general based on probability models is central to the statistical method. This course gives a graduate-level account of the main ideas of statistical inference.

Apprentissage automatique dans la modélisation du risque de crédit FIN-417: Quantitative risk management

Se penche sur les défis et les possibilités de l'apprentissage automatique dans la modélisation du risque de crédit, en comparant les modèles statistiques traditionnels avec les méthodes d'apprentissage automatique.

Apprentissage automatique dans la modélisation du risque de crédit FIN-417: Quantitative risk management

Comparer l'apprentissage automatique avec les modèles traditionnels de modélisation du risque de crédit, en mettant l'accent sur les relations non linéaires et les améliorations prédictives.

Critères de sélection du modèle : AIC, BIC, Cp MATH-413: Statistics for data science

Explore les critères de sélection des modèles comme l'AIC, le BIC et le Cp en statistique pour la science des données.