Analytic and enumerative statistical studies
Analytic and enumerative statistical studies are two types of scientific studies:
In any statistical study the ultimate aim is to provide a rational basis for action. Enumerative and analytic studies differ by where the action is taken. Deming first published on this topic in 1942.[1] Deming summarized the distinction between enumerative and analytic studies as follows:[2]
Enumerative study: A statistical study in which action will be taken on the material in the frame being studied.
Analytic study: A statistical study in which action will be taken on the process or cause-system that produced the frame being studied. The aim being to improve practice in the future.
(In a statistical study, the frame is the set from which the sample is taken.)
These terms were introduced in Some Theory of Sampling (1950, Chapter 7) by W. Edwards Deming.
In other words, an enumerative study is a statistical study in which the focus is on judgment of results, and an analytic study is one in which the focus is on improvement of the process or system which created the results being evaluated and which will continue creating results in the future. A statistical study can be enumerative or analytic, but it cannot be both.
Statistical theory in enumerative studies is used to describe the precision of estimates and the validity of hypotheses for the population studied. In analytical studies, the standard error of a statistic does not address the most important source of uncertainty, namely, the change in study conditions in the future. Although analytical studies need to take into account the uncertainty due to sampling, as in enumerative studies, the attributes of the study design and analysis of the data primarily deal with the uncertainty resulting from extrapolation to the future (generalisation to the conditions in future time periods). The methods used in analytical studies encourage the exploration of mechanisms through multifactor designs, contextual variables introduced through blocking and replication over time.[3]
This distinction between enumerative and analytic studies is the theory behind the Fourteen Points for Management. Dr. Deming's philosophy is that management should be analytic instead of enumerative. In other words, management should focus on improvement of processes for the future instead of on judgment of current results.
"Use of data requires knowledge about the different sources of uncertainty.
Measurement is a process. Is the system of measurement stable or unstable? Use
of data requires also understanding of the distinction between enumerative studies and analytic problems."
"The interpretation of results of a test or experiment is something else. It is prediction that a specific change in a process or procedure will be a wise choice, or that no change would be better. Either way the choice is prediction. This is known as an analytic problem, or a problem of inference, prediction."[4]
Statistician Dr. Mike Tveite has pointed out the dangers of attempting to use an enumerative study for prediction.[citation needed]
Co-presenter and author Henry Neave discusses the issues associated with enumerative and analytic studies along with the many contributions made by Deming in his 1990 book, "The Deming Dimension {reference added} and the 12 Days to Deming Course made accessible by the British Deming Association at: http://www.franbo.uk/deming/the-course/
Provost wrote about the distinction of analytic studies in health care.[5]
Notes
- ^ Deming, W. Edwards (June 1942). "On a Classification of the Problems of Statistical Inference". Journal of the American Statistical Association. 37 (218): 173. doi:10.2307/2279212. ISSN 0162-1459.
- ^ Deming, W. Edwards "On probability as a basis for action" The American Statistician, volume 29, 1975
- ^ Kimbler, D. L. (May 1992). "Review of: "Improving Quality Through Planned Experimentation" Ronald D. Moen, Thomas W. Nolan, and Lloyd P. Provost McGraw Hill, Inc. 1991". IIE Transactions. 24 (2): 188–189. doi:10.1080/07408179208964218. ISSN 0740-817X.
- ^ Deming, W. Edwards The New Economics for Industry, Government, Education - 1st Edition
- ^ Provost, L. P. (2011-03-30). "Analytical studies: a framework for quality improvement design and analysis". BMJ Quality & Safety. 20 (Suppl 1): i92–i96. doi:10.1136/bmjqs.2011.051557. ISSN 2044-5415. PMC 3066849.
Neave HR. The deming dimension. Knoxville, Tenn: SPC Press; 1990:440.
External links
- On the distinction between enumerative and analytic surveys by W. Edwards Deming
- Statistics and Reality by David and Sarah Kerridge at the Wayback Machine (archived September 20, 2010)
Neave HR. The deming dimension. Knoxville, Tenn: SPC Press; 1990:440.