Jump to content

Kirkwood approximation

From Wikipedia, the free encyclopedia

This is the current revision of this page, as edited by E2ipi (talk | contribs) at 00:54, 30 January 2022 (Correct the formula according to paper. [via comparing Eq (2.4), (2.8), (2.9) of Matsuda, Hiroyuki (2000-09-01)]). The present address (URL) is a permanent link to this version.

(diff) ← Previous revision | Latest revision (diff) | Newer revision → (diff)

The Kirkwood superposition approximation was introduced in 1935 by John G. Kirkwood as a means of representing a discrete probability distribution.[1] The Kirkwood approximation for a discrete probability density function is given by

where

is the product of probabilities over all subsets of variables of size i in variable set . This kind of formula has been considered by Watanabe (1960) and, according to Watanabe, also by Robert Fano. For the three-variable case, it reduces to simply

The Kirkwood approximation does not generally produce a valid probability distribution (the normalization condition is violated). Watanabe claims that for this reason informational expressions of this type are not meaningful, and indeed there has been very little written about the properties of this measure. The Kirkwood approximation is the probabilistic counterpart of the interaction information.

Judea Pearl (1988 §3.2.4) indicates that an expression of this type can be exact in the case of a decomposable model, that is, a probability distribution that admits a graph structure whose cliques form a tree. In such cases, the numerator contains the product of the intra-clique joint distributions and the denominator contains the product of the clique intersection distributions.

References

[edit]
  1. ^ Kirkwood, John G. (1935). "Statistical Mechanics of Fluid Mixtures". The Journal of Chemical Physics. 3 (5). AIP Publishing: 300–313. Bibcode:1935JChPh...3..300K. doi:10.1063/1.1749657. ISSN 0021-9606.
  • Jakulin, A. & Bratko, I. (2004), Quantifying and visualizing attribute interactions: An approach based on entropy, Journal of Machine Learning Research, (submitted) pp. 38–43.
  • Matsuda, Hiroyuki (2000-09-01). "Physical nature of higher-order mutual information: Intrinsic correlations and frustration". Physical Review E. 62 (3). American Physical Society (APS): 3096–3102. Bibcode:2000PhRvE..62.3096M. doi:10.1103/physreve.62.3096. ISSN 1063-651X. PMID 11088803.
  • Pearl, J. (1988). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Mateo, CA: Morgan Kaufmann/Elsevier. doi:10.1016/c2009-0-27609-4. ISBN 978-0-08-051489-5.
  • Watanabe, Satosi (1960). "Information Theoretical Analysis of Multivariate Correlation". IBM Journal of Research and Development. 4 (1). IBM: 66–82. doi:10.1147/rd.41.0066. ISSN 0018-8646.