Unbiased estimation of standard deviationIn statistics and in particular statistical theory, unbiased estimation of a standard deviation is the calculation from a statistical sample of an estimated value of the standard deviation (a measure of statistical dispersion) of a population of values, in such a way that the expected value of the calculation equals the true value. Except in some important situations, outlined later, the task has little relevance to applications of statistics since its need is avoided by standard procedures, such as the use of significance tests and confidence intervals, or by using Bayesian analysis.
Estimation of covariance matricesIn statistics, sometimes the covariance matrix of a multivariate random variable is not known but has to be estimated. Estimation of covariance matrices then deals with the question of how to approximate the actual covariance matrix on the basis of a sample from the multivariate distribution. Simple cases, where observations are complete, can be dealt with by using the sample covariance matrix.
Shrinkage (statistics)In statistics, shrinkage is the reduction in the effects of sampling variation. In regression analysis, a fitted relationship appears to perform less well on a new data set than on the data set used for fitting. In particular the value of the coefficient of determination 'shrinks'. This idea is complementary to overfitting and, separately, to the standard adjustment made in the coefficient of determination to compensate for the subjunctive effects of further sampling, like controlling for the potential of new explanatory terms improving the model by chance: that is, the adjustment formula itself provides "shrinkage.
Complément orthogonalEn mathématiques, plus précisément en algèbre linéaire et en analyse fonctionnelle, le complément orthogonal W d'un sous-espace vectoriel W d'un espace préhilbertien V est l'ensemble des vecteurs de V qui sont orthogonaux à tout vecteur de W, c'est-à-dire Le complément orthogonal est toujours un sous-espace vectoriel fermé. Pour un espace de Hilbert, d'après le théorème du supplémentaire orthogonal, le complément orthogonal du complément orthogonal de W est l'adhérence de W, soit File:Orthogonal1.
