In statistics, Scheffé's method, named after the American statistician Henry Scheffé, is a method for adjusting significance levels in a linear regression analysis to account for multiple comparisons. It is particularly useful in analysis of variance, and in constructing simultaneous confidence bands for regressions involving basis functions.
Scheffé's method is a single-step multiple comparison procedure which applies to the set of estimates of all possible contrasts among the factor level means, not just the pairwise differences considered by the Tukey–Kramer method.
Let μ1, ..., μr be the means of some variable in r disjoint populations.
An arbitrary contrast is defined by
If μ1, ..., μr are all equal to each other, then all contrasts among them are 0. Otherwise, some contrasts differ from 0.
Technically there are infinitely many contrasts. The simultaneous confidence coefficient is exactly 1 − α, whether the factor level sample sizes are equal or unequal. (Usually only a finite number of comparisons are of interest. In this case, Scheffé's method is typically quite conservative, and the experimental error rate will generally be much smaller than α.)
We estimate C by
for which the estimated variance is
- ni is the size of the sample taken from the ith population (the one whose mean is μi), and
- is the estimated variance of the errors.
It can be shown that the probability is 1 − α that all confidence limits of the type
are simultaneously correct, where as usual N is the size of the whole population.
Denoting Scheffé significance in a table
Frequently, superscript letters are used to indicate which values are significantly different using the Scheffé method. For example, when mean values of variables that have been analyzed using an ANOVA are presented in a table, they are assigned a different letter superscript based on a Scheffé contrast. Values that are not significantly different based on the post-hoc Scheffé contrast will have the same superscript and values that are significantly different will have different superscripts (i.e. 15a, 17a, 34b would mean that the first and second variables both differ from the third variable but not each other because they are both assigned the superscript "a").
Comparison with the Tukey–Kramer method
If only pairwise comparisons are to be made, the Tukey–Kramer method will result in a narrower confidence limit, which is preferable. In the general case when many or all contrasts might be of interest, the Scheffé method tends to give narrower confidence limits and is therefore the preferred method.
- Bohrer, Robert (1967) "On Sharpening Scheffé Bounds", Journal of the Royal Statistical Society, Series B, 29 (1), 110–114 JSTOR 2984571
- Scheffé, H. (1959). The Analysis of Variance. Wiley, New York. (reprinted 1999, ISBN 0-471-34505-9)