Jonckheere's trend test
In statistics, the Jonckheere trend test (sometimes called the Jonckheere–Terpstra test) is a test for an ordered alternative hypothesis within an independent samples (between-participants) design. It is similar to the Kruskal–Wallis test in that the null hypothesis is that several independent samples are from the same population. However, with the Kruskal–Wallis test there is no a priori ordering of the populations from which the samples are drawn. When there is an a priori ordering, the Jonckheere test has more statistical power than the Kruskal–Wallis test. The test was developed by A. R. Jonckheere, who was a psychologist and statistician at University College London.
The null and alternative hypotheses can be conveniently expressed in terms of population medians for k populations (where k > 2). Letting θi be the population median for the ith population, the null hypothesis is:
The alternative hypothesis is that the population medians have an a priori ordering e.g.:
- ≤ ≤ ≤
with at least one strict inequality.
The ‘direct counting’ method
- Arrange the samples in the predicted order
- For each score in turn, count how many scores in the samples to the right are larger than the score in question. This is P.
- For each score in turn, count how many scores in the samples to the right are smaller than the score in question. This is Q.
- S = P – Q
The ‘nautical’ method
- Cast the data into an ordered contingency table, with the levels of the independent variable increasing from left to right, and values of the dependent variable increasing from top to bottom.
- For each entry in the table, count all other entries that lie to the ‘South East’ of the particular entry. This is P.
- For each entry in the table, count all other entries that lie to the ‘South West’ of the particular entry. This is Q.
- S = P – Q
Note that there will always be ties in the independent variable (individuals are ‘tied’ in the sense that they are in the same group) but there may or may not be ties in the dependent variable. If there are no ties – or the ties occur within a particular sample (which does not affect the value of the test statistic) – exact tables of S are available; for example, Jonckheere provided selected tables for values of k from 3 to 6 and equal samples sizes (m) from 2 to 5. Leach presented critical values of S for k = 3 with sample sizes ranging from 2,2,1 to 5,5,5.
Normal approximation to S
The standard normal distribution can be used to approximate the distribution of S under the null hypothesis for cases in which exact tables are not available. The mean of the distribution of S will always be zero, and assuming that there are no ties scores between the values in two (or more) different samples the variance is given by
Where n is the total number of scores, and ti is the number of scores in the ith sample. The approximation to the standard normal distribution can be improved by the use of a continuity correction: Sc = |S| – 1. Thus 1 is subtracted from a positive S value and 1 is added to a negative S value. The z-score equivalent is then given by
If scores are tied between the values in two (or more) different samples there are no exact table for the S distribution and an approximation to the normal distribution has to be used. In this case no continuity correction is applied to the value of S and the variance is given by
where ti is a row marginal total and ui a column marginal total in the contingency table. The z-score equivalent is then given by
A numerical example
In a partial replication of a study by Loftus and Palmer participants were assigned at random to one of three groups, and then shown a film of two cars crashing into each other. After viewing the film, the participants in one group were asked the following question: “About how fast were the cars going when they contacted each other?” Participants in a second group were asked, “About how fast were the cars going when they bumped into each other?” Participants in the third group were asked, “About how fast were the cars going when they smashed into each other?” Loftus and Palmer predicted that the action verb used (contacted, bumped, smashed) would influence the speed estimates in miles per hour (mph) such that action verbs implying greater energy would lead to higher estimated speeds. The following results were obtained (simulated data):
Contacted Bumped Smashed 10 12 20 12 18 25 14 20 27 16 22 30 mdn = 13 mdn = 19 mdn = 26
The ‘direct counting’ method
- The samples are already in the predicted order
- For each score in turn, count how many scores in the samples to the right are larger than the score in question to obtain P:
- P = 8 + 7 + 7 + 7 + 4 + 4 + 3 + 3 = 43
- For each score in turn, count how many scores in the samples to the right are smaller than the score in question to obtain Q:
- Q = 0 + 0 + 1 + 1 + 0 + 0 + 0 + 1 = 3
- S = P - Q = 43 - 3
- S = 40
The 'nautical' method
- Cast the data into an ordered contingency table
mph Contacted Bumped Smashed Totals (ti) 10 1 0 0 1 12 1 1 0 2 14 1 0 0 1 16 1 0 0 1 18 0 1 0 1 20 0 1 1 2 22 0 1 0 1 25 0 0 1 1 27 0 0 1 1 30 0 0 1 1 Totals (ui) 4 4 4 12
- For each entry in the table, count all other entries that lie to the 'South East' of the particular entry. This is P:
- P = (1 × 8) + (1 × 7) + (1 × 7) + (1 × 7) + (1 × 4) + (1 × 4) + (1 × 3) + ( 1 × 3) = 43
- For each entry in the table, count all other entries that lie to the 'South West' of the particular entry. This is Q:
- Q = (1 × 2) + (1 × 1) = 3
- S = P − Q = 43 − 3
- S = 40
Using exact tables
When the ties between samples are few (as in this example) Leach suggested that ignoring the ties and using exact tables would provide a reasonably accurate result. Jonckheere suggested breaking the ties against the alternative hypothesis and then using exact tables. In the current example where tied scores only appear in adjacent groups, the value of S is unchanged if the ties are broken against the alternative hypothesis. This may be verified by substituting 11 mph in place of 12 mph in the Bumped sample, and 19 mph in place of 20 mph in the Smashed and re-computing the test statistic. From tables with k = 3, and m = 4, the critical S value for α = 0.05 is 36 and thus the result would be declared statistically significant at this level.
Computing a standard normal approximation
The variance of S is then
And z is given by
For α = 0.05 (one-sided) the critical z value is 1.645, so again the result would be declared significant at this level. A similar test for trend within the context of repeated measures (within-participants) designs and based on Spearman's rank correlation coefficient was developed by Page.
- Jonckheere, A. R. (1954). "A distribution-free k-sample test against ordered alternatives". Biometrika. 41: 133–145. doi:10.2307/2333011.
- Terpstra, T. J. (1952). "The asymptotic normality and consistency of Kendall's test against trend, when ties are present in one ranking" (PDF). Indagationes Mathematicae. 14: 327–333.
- Kendall, M. G. (1962). Rank correlation methods (3rd ed.). London: Charles Griffin.
- Leach, C. (1979). Introduction to Statistics: A non-parametric approach for the social sciences. Chichester: John Wiley.
- Loftus, E. F.; Palmer, J. C. (1974). "Reconstruction of automobile destruction: An example of the interaction between language and memory". Journal of Verbal Learning and Verbal Behavior. 13: 585–589. doi:10.1016/S0022-5371(74)80011-3.
- Page, E. B. (1963). "Ordered hypotheses for multiple treatments: A significance test for linear ranks". Journal of the American Statistical Association. 58 (301): 216–30. doi:10.2307/2282965.
- Daniel, Wayne W. (1990). "Jonckheere–Terpstra tst for ordered alternatives". Applied Nonparametric Statistics (2nd ed.). Boston: PWS-Kent. pp. 234–240. ISBN 0-534-91976-6.