Mean squared error

Assessment | Biopsychology | Comparative | Cognitive | Developmental | Language | Individual differences | Personality | Philosophy | Social |
Methods | Statistics | Clinical | Educational | Industrial | Professional items | World psychology |

Statistics: Scientific method · Research methods · Experimental design · Undergraduate statistics courses · Statistical tests · Game theory · Decision theory

---

In statistics, the mean squared error or MSE of an estimator is the expected value of the square of the "error." The error is the amount by which the estimator differs from the quantity to be estimated. The difference occurs because of randomness or because the estimator doesn't account for information that could produce a more accurate estimate.

Definition and basic properties

The MSE of an estimator $\hat{\theta}$ with respect to the estimated parameter $\theta$ is defined as

$\operatorname{MSE}(\hat{\theta})=\operatorname{E}((\hat{\theta}-\theta)^2).$

It can be shown that the MSE is the sum of the variance and the bias of the estimator

$\operatorname{MSE}(\hat{\theta})=\operatorname{Var}\left(\hat{\theta}\right)+ \left(\operatorname{Bias}(\hat{\theta},\theta)\right)^2.$

In that sense, the MSE assess the quality of the estimator in terms of its variation and unbiasedness. Note, that the MSE is not equivalent to the expected value of the absolute error.

The root mean squared error (RMSE) (or root mean squared deviation (RMSD)) is then simply defined as the square root of the MSE.

$\operatorname{RMSE}(\hat{\theta}) = \sqrt{\operatorname{MSE}(\hat{\theta})}.$

The defined MSE (as well as the RMSE) is a random variable, that needs to be estimated itself. This usually done by the sample mean

$\operatorname{\widehat{MSE}}(\hat{\theta}) = \frac{1}{n} \sum_{j=1}^n \left(\theta_j-\theta\right)^2$

with $\theta_{j}$ being realizations of the estimator $\hat{\theta}$ of size $n$.

Examples

Suppose we have a random sample of size n from a normally distributed population, $X_1,\dots,X_n\sim\operatorname{N}(\mu,\sigma^2)$.

Some commonly-used estimators of the true parameters of the population, μ and σ², are:

True value	Estimator	Mean squared error
θ = μ	$\hat{\theta}$ = the unbiased estimator of the sample mean, $\overline{X}=\frac{1}{n}\sum_{i=1}^n(X_i)$	$\operatorname{MSE}(\overline{X})=\operatorname{E}((\overline{X}-\mu)^2)=\left(\frac{\sigma}{\sqrt{n}}\right)^2$
θ = σ2	$\hat{\theta}$ = the unbiased estimator of the sample variance, $S^2 = \frac{1}{n-1}\sum_{i=1}^n\left(X_i-\overline{X}\,\right)^2$	$\operatorname{MSE}(S^2)=\operatorname{E}((S^2-\sigma^2)^2)=\operatorname{var}(S^2)$

Notice how these examples also illustrate one facet of the bias-variance decomposition. The MSE of unbiased estimators are just their variance. The MSE of a biased estimator would have a non-zero bias term as well as a variance term. Note that the estimator that minimizes the MSE is not necessarily unbiased; it could compensate for the bias with a smaller variance. In the example above, a biased estimator for the variance, $S^2 = \frac{1}{n}\sum_{i=1}^n\left(X_i-\overline{X}\,\right)^2$, actually has a smaller mean squared error than the formula given, despite being biased by $- \frac{1}{n} \sigma^2$.

Applications

• In statistical modelling, the MSE is defined as the difference between the actual observations and the response predicted by the model and is used to determine whether the model does not fit the data or whether the model can be simplified by removing terms.

See also

• Mean squared prediction error
• Minimum mean-square error
• Peak signal-to-noise ratio
• Root mean square deviation

External links

• Program for MSE measurements in images and video

de:Mittlere quadratische Abweichung es:Error Cuadrático Medio zh:均方差