Levene's test

In statistics, Levene's test is an inferential statistic used to assess the equality of variances for a variable calculated for two or more groups.^[1] Some common statistical procedures assume that variances of the populations from which different samples are drawn are equal. Levene's test assesses this assumption. It tests the null hypothesis that the population variances are equal (called homogeneity of variance or homoscedasticity). If the resulting p-value of Levene's test is less than some significance level (typically 0.05), the obtained differences in sample variances are unlikely to have occurred based on random sampling from a population with equal variances. Thus, the null hypothesis of equal variances is rejected and it is concluded that there is a difference between the variances in the population.

Some of the procedures typically assuming homoscedasticity, for which one can use Levene's tests, include analysis of variance and t-tests.

Levene's test is often used before a comparison of means. When Levene's test shows significance, one should switch to more generalized tests that is free from homoscedasticity assumptions (sometimes even non-parametric tests). Welch's t-test, or unequal variances t-test are more conservative test.

Levene's test may also be used as a main test for answering a stand-alone question of whether two sub-samples in a given population have equal or different variances.^[2]

Definition

Levene's test is equivalent to a 1-way between-groups analysis of variance (ANOVA) with the dependent variable being the absolute value of the difference between a score and the mean of the group to which the score belongs (shown below as $Z_{ij}=|Y_{ij}-{\bar {Y}}_{i\cdot }|$ ). The test statistic, $W$ , is equivalent to the $F$ statistic that would be produced by such an ANOVA, and is defined as follows:

W={\frac {(N-k)}{(k-1)}}\cdot {\frac {\sum _{i=1}^{k}N_{i}(Z_{i\cdot }-Z_{\cdot \cdot })^{2}}{\sum _{i=1}^{k}\sum _{j=1}^{N_{i}}(Z_{ij}-Z_{i\cdot })^{2}}},

where

$k$ is the number of different groups to which the sampled cases belong,
$N_{i}$ is the number of cases in the $i$ th group,
$N$ is the total number of cases in all groups,
$Y_{ij}$ is the value of the measured variable for the $j$ th case from the $i$ th group,
$Z_{ij}={\begin{cases}|Y_{ij}-{\bar {Y}}_{i\cdot }|,&{\bar {Y}}_{i\cdot }{\text{ is a mean of the }}i{\text{-th group}},\\|Y_{ij}-{\tilde {Y}}_{i\cdot }|,&{\tilde {Y}}_{i\cdot }{\text{ is a median of the }}i{\text{-th group}}.\end{cases}}$

(Both definitions are in use though the second one is, strictly speaking, the Brown–Forsythe test – see below for comparison.)

$Z_{i\cdot }={\frac {1}{N_{i}}}\sum _{j=1}^{N_{i}}Z_{ij}$ is the mean of the $Z_{ij}$ for group $i$ ,
$Z_{\cdot \cdot }={\frac {1}{N}}\sum _{i=1}^{k}\sum _{j=1}^{N_{i}}Z_{ij}$ is the mean of all $Z_{ij}$ .

The test statistic $W$ is approximately F-distributed with $k-1$ and $N-k$ degrees of freedom, and hence is the significance of the outcome $w$ of $W$ tested against $F(\alpha ,k-1,N-k)$ where $F$ is a quantile of the F-distribution, with $k-1$ and $N-k$ degrees of freedom, and $\alpha$ is the chosen level of significance (usually 0.05 or 0.01).

Comparison with the Brown–Forsythe test

The Brown–Forsythe test uses the median instead of the mean in computing the spread within each group ( ${\bar {Y}}$ vs. ${\tilde {Y}}$ , above). Although the optimal choice depends on the underlying distribution, the definition based on the median is recommended as the choice that provides good robustness against many types of non-normal data while retaining good statistical power.^[2] If one has knowledge of the underlying distribution of the data, this may indicate using one of the other choices. Brown and Forsythe performed Monte Carlo studies that indicated that using the trimmed mean performed best when the underlying data followed a Cauchy distribution (a heavy-tailed distribution) and the median performed best when the underlying data followed a chi-squared distribution with four degrees of freedom (a heavily skewed distribution). Using the mean provided the best power for symmetric, moderate-tailed, distributions.

References

^ Levene, Howard (1960). "Robust tests for equality of variances". In Ingram Olkin; Harold Hotelling; et al. (eds.). Contributions to Probability and Statistics: Essays in Honor of Harold Hotelling. Stanford University Press. pp. 278–292.
^ ^a ^b Derrick, B; Ruck, A; Toher, D; White, P (2018). "Tests for equality of variances between two samples which contain both paired observations and independent observations" (PDF). Journal of Applied Quantitative Methods. 13 (2): 36–47.

External links

[Levene1960-1] Levene, Howard (1960). "Robust tests for equality of variances". In Ingram Olkin; Harold Hotelling; et al. (eds.). Contributions to Probability and Statistics: Essays in Honor of Harold Hotelling. Stanford University Press. pp. 278–292.

[patvar-2] Derrick, B; Ruck, A; Toher, D; White, P (2018). "Tests for equality of variances between two samples which contain both paired observations and independent observations" (PDF). Journal of Applied Quantitative Methods. 13 (2): 36–47.

[1]

[2]

Definition

Comparison with the Brown–Forsythe test

See also

References

External links