It is often used in statistics as a tool to prove independence of two statistics, by first demonstrating one is complete sufficient and the other is ancillary, then appealing to the theorem. An example of this is to show that the sample mean and sample variance of a normal distribution are independent statistics, which is done in the Examples section below. This property (independence of sample mean and sample variance) characterizes normal distributions.
Let Pθ be a family of distributions on a measurable space (X, Σ). Then if T is a boundedly complete sufficient statistic for θ, and A is ancillary to θ, then T is independent of A.
Let PθT and PθA be the marginal distributions of T and A respectively.
The PθA does not depend on θ because A is ancillary. Likewise, Pθ(·|T = t) does not depend on θ because T is sufficient. Therefore:
Note the integrand (the function inside the intergal) is a function of t and not θ. Therefore, since T is boundedly complete:
Therefore, A is independent of T.
Independence of sample mean and sample variance of a normal distribution
Then with respect to the parameter μ, one can show that
the sample mean, is a complete sufficient statistic – it is all the information one can derive to estimate μ, and no more – and
the sample variance, is an ancillary statistic – its distribution does not depend on μ.
Therefore, from Basu's theorem it follows that these statistics are independent.
This independence result can also be proven by Cochran's theorem.
||This article includes a list of references, but its sources remain unclear because it has insufficient inline citations. (December 2009)|
- Basu, D. (1955). "On Statistics Independent of a Complete Sufficient Statistic". Sankhyā 15 (4): 377–380. JSTOR 25048259. MR 74745. Zbl 0068.13401.
- Mukhopadhyay, Nitis (2000). Probability and Statistical Inference. Statistics: A Series of Textbooks and Monographs. 162. Florida: CRC Press USA. ISBN 0-8247-0379-0.
- Boos, Dennis D.; Oliver, Jacqueline M. Hughes (Aug 1998). "Applications of Basu's Theorem". The American Statistician (Boston: American Statistical Association) 52 (3): 218–221. doi:10.2307/2685927. JSTOR 2685927. MR 1650407.
- Ghosh, Malay (October 2002). "Basu's Theorem with Applications: A Personalistic Review". Sankhyā: the Indian Journal of Statistics, Series A 64 (3): 509–531. JSTOR 25051412. MR 1985397.