Wikia

Psychology Wiki

Rank difference correlation

Talk0
34,139pages on
this wiki
Revision as of 21:04, January 7, 2009 by Dr Joe Kiff (Talk | contribs)

Assessment | Biopsychology | Comparative | Cognitive | Developmental | Language | Individual differences | Personality | Philosophy | Social |
Methods | Statistics | Clinical | Educational | Industrial | Professional items | World psychology |

Statistics: Scientific method · Research methods · Experimental design · Undergraduate statistics courses · Statistical tests · Game theory · Decision theory


This article is in need of attention from a psychologist/academic expert on the subject.
Please help recruit one, or improve this page yourself if you are qualified.
This banner appears on articles that are weak and whose contents should be approached with academic caution
.

Rank difference correlation is an approach to statistical correlation. In statistics, Spearman's rank correlation coefficient or Spearman's rho, named after Charles Spearman and often denoted by the Greek letter \rho (rho) or as r_s, is a non-parametric measure of correlation – that is, it assesses how well an arbitrary monotonic function could describe the relationship between two variables, without making any assumptions about the frequency distribution of the variables.

Calculation

In principle, ρ is simply a special case of the Pearson product-moment coefficient in which two sets of data X_i and Y_i are converted to rankings x_i and y_i before calculating the coefficient.[1] In practice, however, a simpler procedure is normally used to calculate ρ. The raw scores are converted to ranks, and the differences d_i between the ranks of each observation on the two variables are calculated.

If there are no tied ranks, i.e. \neg\exists_{i,j} (i\ne j \wedge (X_i=X_j \vee Y_i=Y_j))

then ρ is given by:

 \rho = 1- {\frac {6 \sum d_i^2}{n(n^2 - 1)}}

where:

d_i = x_i - y_i = the difference between the ranks of corresponding values X_i and Y_i, and
n = the number of values in each data set (same for both sets).

If tied ranks exist, classic Pearson's correlation coefficient between ranks has to be used instead of this formula:[1]


\rho=\frac{n(\sum x_iy_i)-(\sum x_i)(\sum y_i)}
{\sqrt{n(\sum x_i^2)-(\sum x_i)^2}~\sqrt{n(\sum y_i^2)-(\sum y_i)^2}}.

One has to assign the same rank to each of the equal values. It is an average of their positions in the ascending order of the values:

An example of averaging ranks

In the table below, notice how the rank of values that are the same is the mean of what their ranks would otherwise be.

Variable X_i Position in the descending order Rank x_i
0.855
1.24\frac{4+3}{2}=3.5\
1.23\frac{4+3}{2}=3.5\
2.322
1811

In this case we cannot use the shortcut formula (because of the tied ranks in the data) and must use the second, product-moment form.

Example

The raw data used in this example is shown below where we want to calculate the correlation between the IQ of someone with the number of hours spent in front of TV per week.

IQ, X_i Hours of TV per week, Y_i
106 7
86 0
100 27
101 50
99 28
103 29
97 20
113 12
112 6
110 17

The first step is to sort this data by the second column. Next, two more columns are created (x_i and y_i). The last of these columns (y_i) is assigned 1,2,3,...n, and then the data is sorted by the first original column (X_i). The first of the newly created columns (x_i) is assigned 1,2,3,...n. Then a column d_i is created to hold the differences between the two rank columns (x_i and y_i). Finally another column d^2_i should be created. This is just column d_i squared.

After doing this process with the example data you should end up with something like:

IQ, X_i Hours of TV per week, Y_i rank x_i rank y_i d_i d^2_i
86 0 1 1 0 0
97 20 2 6 -4 16
99 28 3 8 -5 25
100 27 4 7 -3 9
101 50 5 10 -5 25
103 29 6 9 -3 9
106 7 7 3 4 16
110 17 8 5 3 9
112 6 9 2 7 49
113 12 10 4 6 36

The values in the d^2_i column can now be added to find \sum d_i^2 = 194. The value of n is 10. So these values can now be substituted back into the equation,

 \rho = 1- {\frac {6\times194}{10(10^2 - 1)}}

which evaluates to  \rho = -0.175758 which shows that the correlation between IQ and hours spent watching TV is very low (barely any correlation). In the case of ties in the original values, this formula should not be used. Instead, the Pearson correlation coefficient should be calculated on the ranks (where ties are given ranks, as described above).

Determining significance

The modern approach to testing whether an observed value of ρ is significantly different from zero (we will always have 1 ≥ ρ ≥ −1) is to calculate the probability that it would be greater than or equal to the observed ρ, given the null hypothesis, by using a permutation test. This approach is almost always superior to traditional methods, unless the data set is so large that computing power is not sufficient to generate permutations, or unless an algorithm for creating permutations that are logical under the null hypothesis is difficult to devise for the particular case (but usually these algorithms are straightforward).

Although the permutation test is often trivial to perform for anyone with computing resources and programming experience, traditional methods for determining significance are still widely used. The most basic approach is to compare the observed ρ with published tables for various levels of significance. This is a simple solution if the significance only needs to be known within a certain range or less than a certain value, as long as tables are available that specify the desired ranges. A reference to such a table is given below. However, generating these tables is computationally intensive and complicated mathematical tricks have been used over the years to generate tables for larger and larger sample sizes, so it is not practical for most people to extend existing tables.

An alternative approach available for sufficiently large sample sizes is an approximation to the Student's t-distribution with degrees of freedom N-2. For sample sizes above about 20, the variable

t = \frac{\rho}{\sqrt{(1-\rho^2)/(n-2)}}
\rho = \frac{t}{\sqrt{n-2+t^2}}

has a Student's t-distribution in the null case (zero correlation). In the non-null case (i.e. to test whether an observed ρ is significantly different from a theoretical value, or whether two observed ρs differ significantly) tests are much less powerful, though the t-distribution can again be used.

A generalization of the Spearman coefficient is useful in the situation where there are three or more conditions, a number of subjects are all observed in each of them, and we predict that the observations will have a particular order. For example, a number of subjects might each be given three trials at the same task, and we predict that performance will improve from trial to trial. A test of the significance of the trend between conditions in this situation was developed by E. B. Page and is usually referred to as Page's trend test for ordered alternatives.

Correspondence analysis based on Spearman's rho

Classic correspondence analysis is a statistical method which gives a score to every value of two nominal variables, in this way that Pearson's correlation coefficient between them is maximized.

There exists an equivalent of this method, called grade correspondence analysis, which maximizes Spearman's rho or Kendall's tau[2].

See also

Notes

  1. 1.0 1.1 Myers, Jerome L.; Arnold D. Well (2003). Research Design and Statistical Analysis, second edition, 508, Lawrence Erlbaum.
  2. Kowalczyk, T.; Pleszczyńska E. , Ruland F. (eds.) (2004). Grade Models and Methods for Data Analysis with Applications for the Analysis of Data Populations, Berlin Heidelberg New York: Springer Verlag.

References

  • C. Spearman, "The proof and measurement of association between two things" Amer. J. Psychol. , 15 (1904) pp. 72–101
  • M.G. Kendall, "Rank correlation methods" , Griffin (1962)
  • M. Hollander, D.A. Wolfe, "Nonparametric statistical methods" , Wiley (1973)

External links



This page uses Creative Commons Licensed content from Wikipedia (view authors).

Around Wikia's network

Random Wiki