Psychology Wiki

Degrees of freedom

34,136pages on
this wiki
Revision as of 14:55, February 14, 2006 by Lifeartist (Talk | contribs)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Assessment | Biopsychology | Comparative | Cognitive | Developmental | Language | Individual differences | Personality | Philosophy | Social |
Methods | Statistics | Clinical | Educational | Industrial | Professional items | World psychology |

Statistics: Scientific method · Research methods · Experimental design · Undergraduate statistics courses · Statistical tests · Game theory · Decision theory

In statistics, the term degrees of freedom has two meanings:


In fitting statistical models to data, the vectors of residuals are often constrained to lie in a space of smaller dimension than the number of components in the vector. That smaller dimension is the number of degrees of freedom for error.

Perhaps the simplest example is this. Suppose


are random variables each with expected value μ, and let

\overline{X}_n={X_1+\cdots+X_n \over n}

be the "sample mean". Then the quantities


are residuals that may be considered estimates of the errors Xi − μ. The sum of the residuals (unlike the sum of the errors) is necessarily 0. That means they are constrained to lie in a space of dimension n − 1. If one knows the values of any n − 1 of the residuals, one can thus find the last one. One says that "there are n − 1 degrees of freedom for error."

An only slightly less simple example is that of least squares estimation of a and b in the model

Y_i=a+bx_i+\varepsilon_i\ \mathrm{for}\ i=1,\dots,n

where εi, and hence Yi are random. Let \widehat{a} and \widehat{b} be the least-squares estimates of a and b. Then the residuals


are constrained to lie within the space defined by the two equations

x_1 e_1+\cdots+x_n e_n=0.\,

One says that "there are n − 2 degrees of freedom for error."

(The fastidious will note that capital Y is used in specifying the model, and lower-case y in the definition of the residuals. That is because the former are hypothesized random variables and the latter are data.)

Another simple and frequently seen example arises in multiple comparisons.

[more to come here]

Parameters in probability distributionsEdit

The probability distributions of residuals are often parametrized by these numbers of degrees of freedom. Thus one speaks of a chi-square distribution with a specified number of degrees of freedom, an F-distribution, a Student's t-distribution, or a Wishart distribution with specified numbers of degrees of freedom in the numerator and the denominator respectively.

In the familiar uses of these distributions, the number of degrees of freedom takes only integer values. The underlying mathematics in most cases allows for fractional degrees of freedom, which can arise in more sophisticated uses.

See alsoEdit

This page uses Creative Commons Licensed content from Wikipedia (view authors).

Around Wikia's network

Random Wiki