Talk:Kendall tau rank correlation coefficient

From Wikipedia, the free encyclopedia
Jump to: navigation, search
WikiProject Statistics (Rated Start-class, High-importance)
WikiProject icon

This article is within the scope of the WikiProject Statistics, a collaborative effort to improve the coverage of statistics on Wikipedia. If you would like to participate, please visit the project page or join the discussion.

Start-Class article Start  This article has been rated as Start-Class on the quality scale.
 High  This article has been rated as High-importance on the importance scale.
 
WikiProject Mathematics (Rated Start-class, Low-importance)
WikiProject Mathematics
This article is within the scope of WikiProject Mathematics, a collaborative effort to improve the coverage of Mathematics on Wikipedia. If you would like to participate, please visit the project page, where you can join the discussion and see a list of open tasks.
Mathematics rating:
Start Class
Low Importance
 Field: Probability and statistics

Suggest reformulation of kendall's tau definition[edit]

I notice there's been some debate here (more than 4 years ago!) over the definition of kendall's tau. While the current definition is technically correct, it's not the most intuitive definition. The way I've usually seen it defined is \tau = \frac{\text{number of concordant pairs - number discordant pairs}}{\text{number of concordant pairs + number of discordant pairs}}

This is the same as what's currently given because the sum of concordant and discordant pairs is just the total number of pairs, given by N choose 2 and equal to \frac{1}{2} n(n-1). See e.g. http://ir.cis.udel.edu/~carteret/papers/sigir09.pdf

Ttodorovv (talk) 00:36, 16 February 2013 (UTC)


Replace the current formulation with the following...?[edit]

I found the current formulation and explanation to be wrong and misleading. I've prepared the following change:

"Kendall tau coefficient is defined

\tau = \frac{n_c-n_d}{\frac{1}{2}{n(n-1)}}

where n_c is the number of concordant pairs, and n_d is the number of discordant pairs in the data set.

The denominator in the definition of \tau can be interpreted as the total number of pairs of items. So, a high value in the numerator means that most pairs are concordant, indicating that the two rankings are consistent. Note that a tied pair is not regarded as concordant or discordant. If there is a large number of ties, the total number of pairs (in the denominator of the expression of \tau) should be adjusted accordingly."

This is from http://www.statsdirect.com/help/nonparametric_methods/kend.htm and I've confirmed it to be correct. Understanding it simply requires understanding concordant pairs, for which there is already a rather good entry. —Preceding unsigned comment added by Squeakywaffle (talkcontribs) 23:32, 18 September 2008 (UTC)

Well if nobody has any objections I'm going to go ahead and make this change. I will have to remove the example, but this talk page is dominated by comments questioning the validity of the current formulation and explanation, and IMO having those correct is more important than having an example.

Maybe I will come back and do an example, or maybe someone else can do it. --Squeakywaffle (talk) 22:22, 23 September 2008 (UTC)

Error in equation?[edit]

According to http://www.rsscse.org.uk/TS/bts/noether/text.html and my experiments, I think the equation should be 1 - 4P/n(n-1) NOT 4P/n(n-1) - 1 —Preceding unsigned comment added by 74.95.2.89 (talk) 23:35, 11 December 2007 (UTC)

142.103.8.44 (talk) 23:16, 1 May 2008 (UTC) I'm pretty sure that \tau = \frac{4P}{n(n-1)} - 1 works.

Error in explanation[edit]

The phrasing of the actual definition needs work:

"where n is the number of items, and P is the sum, over all the items, of the number of items ranked after the given item by both rankings." —Preceding unsigned comment added by 76.191.205.197 (talk) 01:39, 3 July 2008 (UTC)

The last paragraph of the definition has a problem: it says

P can also be interpreted as the number of concordant pairs subtracted by the number of discordant pairs.

This can't be literally true: P (as defined above) is a positive number, while this subtraction doesn't have to be.

Instead, while tau = 2P/N-1 (when N=n*(n-1)/2)), if we write S="number of concordant pairs subtracted by the number of discorant pairs", I think that tau = S/N, so that we have S=(2P-N).

Or am I missing something?

Nyh

Example[edit]

shouldn't the example be P = 5 + 4 + 4 + 4 + 3 + 1 + 0 + 0 = 22. instead of P = 5 + 4 + 5 + 4 + 3 + 1 + 0 + 0 = 22?

Sboehringer 17:00, 5 March 2007 (UTC)

Example as described on main page appears to be correct -- —Preceding unsigned comment added by 76.31.253.197 (talk) 13:43, 14 April 2008 (UTC)

Significance tests[edit]

Article needs some discussion of how to generate p-values in order for hypothesis testing. —Preceding unsigned comment added by 128.200.138.197 (talk) 17:55, August 27, 2007 (UTC)

I agree. Cazort (talk) 21:17, 20 November 2008 (UTC)


Incomplete definition?[edit]

The definition section says: "They are said to be discordant, if xi > xj and yi < yj or if xi < xj and yi > yj."

Shouldn't this be stated more generally: "They are said to be discordant, if xi > xj and yi ≤ yj or if xi < xj and yi ≥ yj."?

Alopdahl (talk) 09:19, 15 March 2013 (UTC)

I don't think so. Any evidence? — Arthur Rubin (talk) 16:03, 15 March 2013 (UTC)

Empirical estimation vs formal definition[edit]

What is given in the section of the definition appears to me more like the estimator of Kendall's tau for a given sample.

The probabilistic definition should probably more look like:

 \tau = \operatorname{E}[ \operatorname{sign} ( ( X_1 - X_1') ( X_2 - X_2' ) ) ]

where (X_1', X_2') is an independent copy of (X_1', X_2').

77.56.29.47 (talk) 16:44, 19 January 2014 (UTC)

Definition[edit]

The definition asssumes the uniqueness of the values xi, yet makes a statement about the case xi=xj(?) 82.75.155.228 (talk) 21:20, 28 April 2014 (UTC)