Bayesian statistics: Difference between revisions
m Bot: link syntax and minor changes |
KolbertBot (talk | contribs) m Bot: HTTP→HTTPS (v478) |
||
Line 33: | Line 33: | ||
* {{cite web| author=Eliezer S. Yudkowsky | title = An Intuitive Explanation of Bayes' Theorem | url=http://www.yudkowsky.net/rational/bayes|type=webpage|accessdate=2015-06-15}} |
* {{cite web| author=Eliezer S. Yudkowsky | title = An Intuitive Explanation of Bayes' Theorem | url=http://www.yudkowsky.net/rational/bayes|type=webpage|accessdate=2015-06-15}} |
||
* {{cite web| author=Theo Kypraios| title=A Gentle Tutorial in Bayesian Statistics| url=http://www.maths.nott.ac.uk/personal/tk/files/talks/nott_radiology_01_11.pdf| type=PDF| accessdate=2013-11-03}}{{dead link|date=July 2017 |bot=InternetArchiveBot |fix-attempted=yes }} |
* {{cite web| author=Theo Kypraios| title=A Gentle Tutorial in Bayesian Statistics| url=http://www.maths.nott.ac.uk/personal/tk/files/talks/nott_radiology_01_11.pdf| type=PDF| accessdate=2013-11-03}}{{dead link|date=July 2017 |bot=InternetArchiveBot |fix-attempted=yes }} |
||
* {{cite web| author=Jordi Vallverdu | title = Bayesians Versus Frequentists A Philosophical Debate on Statistical Reasoning | url= |
* {{cite web| author=Jordi Vallverdu | title = Bayesians Versus Frequentists A Philosophical Debate on Statistical Reasoning | url=https://www.springer.com/gp/book/9783662486368}} |
||
* [http://www.scholarpedia.org/article/Bayesian_statistics Bayesian statistics] [[David Spiegelhalter]], Kenneth Rice [[Scholarpedia]] 4(8):5230. [[doi:10.4249/scholarpedia.5230]] |
* [http://www.scholarpedia.org/article/Bayesian_statistics Bayesian statistics] [[David Spiegelhalter]], Kenneth Rice [[Scholarpedia]] 4(8):5230. [[doi:10.4249/scholarpedia.5230]] |
||
* [http://bayesmodels.com/ Bayesian modeling book] and examples available for downloading. |
* [http://bayesmodels.com/ Bayesian modeling book] and examples available for downloading. |
Revision as of 08:58, 20 December 2017
This article needs additional citations for verification. (May 2016) |
Part of a series on |
Bayesian statistics |
---|
Posterior = Likelihood × Prior ÷ Evidence |
Background |
Model building |
Posterior approximation |
Estimators |
Evidence approximation |
Model evaluation |
Bayesian statistics, named for Thomas Bayes (1701–1761), is a theory in the field of statistics in which the evidence about the true state of the world is expressed in terms of degrees of belief known as Bayesian probabilities. Such an interpretation is only one of a number of interpretations of probability and there are other statistical techniques that are not based on 'degrees of belief'. One of the key ideas of Bayesian statistics is that "probability is orderly opinion, and that inference from data is nothing other than the revision of such opinion in the light of relevant new information."[1]
Outline
The general set of statistical techniques can be divided into a number of activities, many of which have special Bayesian versions.
Statistical inference
Bayesian inference is an approach to statistical inference that is distinct from frequentist inference. It is specifically based on the use of Bayesian probability to summarize evidence.
Statistical modeling
The formulation of statistical models using Bayesian statistics has the identifying feature of requiring the specification of prior distributions for any unknown parameters. Indeed, parameters of prior distributions may themselves have prior distributions, leading to Bayesian hierarchical modeling, or may be interrelated, leading to Bayesian networks.
Design of experiments
The Bayesian design of experiments includes a concept called 'influence of prior beliefs'. This approach uses sequential analysis techniques to include the outcome of earlier experiments in the design of the next experiment. This is achieved by updating 'beliefs' through the use of prior and posterior distribution. This allows the design of experiments to make good use of resources of all types. An example of this is the multi-armed bandit problem.
Statistical graphics
Statistical graphics includes methods for data exploration, for model validation, etc. The use of certain modern computational techniques for Bayesian inference, specifically the various types of Markov chain Monte Carlo techniques, have led to the need for checks, often made in graphical form, on the validity of such computations in expressing the required posterior distributions.
References
- ^ Edwards, W.; Lindman, H.; Savage, L. J. (1963). "Bayesian Statistical Inference for Psychological Research". Psychological Review. 70: 193–242. doi:10.1037/h0044139 (quote: pp 519-520). Cited as per Dennis Fryback's preface in O’Hagan, A.; Luce, B. (2003). "A primer on Bayesian Statistics in Health Economics and Outcomes Research" (PDF). Bayesian Initiative in Health Economics & Outcomes Research and the Centre for Bayesian Statistics in Health Economics. Retrieved June 9, 2015.
Further reading
- Think Bayes, Allen B. Downey
- Bayesian Statistics: Why and How
- Puga JL, Krzywinski M, Altman N (May 2015). "Bayesian Statistics". Points of Significance. Nature Methods. 12 (5): 377–8. doi:10.1038/nmeth.3368. Retrieved 31 May 2016.
External links
- Eliezer S. Yudkowsky. "An Intuitive Explanation of Bayes' Theorem" (webpage). Retrieved 2015-06-15.
- Theo Kypraios. "A Gentle Tutorial in Bayesian Statistics" (PDF) (PDF). Retrieved 2013-11-03.[permanent dead link]
- Jordi Vallverdu. "Bayesians Versus Frequentists A Philosophical Debate on Statistical Reasoning".
- Bayesian statistics David Spiegelhalter, Kenneth Rice Scholarpedia 4(8):5230. doi:10.4249/scholarpedia.5230
- Bayesian modeling book and examples available for downloading.
- Rens Van De Schoot. "A Gentle Introduction to Bayesian Analysis" (PDF).
- Bayesian A/B Testing Calculator Dynamic Yield